=== RUN TestAddons/serial/Volcano
addons_test.go:905: volcano-admission stabilized in 49.245901ms
addons_test.go:897: volcano-scheduler stabilized in 49.378903ms
addons_test.go:913: volcano-controller stabilized in 49.438766ms
addons_test.go:919: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-576bc46687-dnf49" [91988a25-8ef5-41d8-b857-a71aba4c4dc8] Running
addons_test.go:919: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.003453981s
addons_test.go:923: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-77d7d48b68-wjb2c" [f0870e9e-520b-432d-9c7b-f7e1cd9b1cc6] Running
addons_test.go:923: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.004019451s
addons_test.go:927: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-56675bb4d5-qq9rb" [01ca3422-e88e-4229-8811-7962aa3c8b77] Running
addons_test.go:927: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.003692025s
addons_test.go:932: (dbg) Run: kubectl --context addons-726754 delete -n volcano-system job volcano-admission-init
addons_test.go:938: (dbg) Run: kubectl --context addons-726754 create -f testdata/vcjob.yaml
addons_test.go:946: (dbg) Run: kubectl --context addons-726754 get vcjob -n my-volcano
addons_test.go:964: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [c3bbd2eb-385a-41b4-b65c-dd12312d7cda] Pending
helpers_test.go:344: "test-job-nginx-0" [c3bbd2eb-385a-41b4-b65c-dd12312d7cda] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: rate: Wait(n=1) would exceed context deadline
addons_test.go:964: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:964: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-726754 -n addons-726754
addons_test.go:964: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-08-27 23:08:49.780820951 +0000 UTC m=+438.183524608
addons_test.go:964: (dbg) Run: kubectl --context addons-726754 describe po test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-726754 describe po test-job-nginx-0 -n my-volcano:
Name: test-job-nginx-0
Namespace: my-volcano
Priority: 0
Service Account: default
Node: <none>
Labels: volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations: scheduling.k8s.io/group-name: test-job-a2a04201-5354-4354-80cc-85b050c4b25f
volcano.sh/job-name: test-job
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status: Pending
IP:
IPs: <none>
Controlled By: Job/test-job
Containers:
nginx:
Image: nginx:latest
Port: <none>
Host Port: <none>
Command:
sleep
10m
Limits:
cpu: 1
Requests:
cpu: 1
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-vnt72 (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-vnt72:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 2m59s volcano 0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:964: (dbg) Run: kubectl --context addons-726754 logs test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-726754 logs test-job-nginx-0 -n my-volcano:
addons_test.go:965: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-726754
helpers_test.go:235: (dbg) docker inspect addons-726754:
-- stdout --
[
{
"Id": "319dc7f1aee59bc84eb2c16051b30669bb72533aded72416f1cb1e689f7550fd",
"Created": "2024-08-27T23:02:20.564361542Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 1740984,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-08-27T23:02:20.694563375Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:0985147309945253cbe7e881ef8b47b2eeae8c92bbeecfbcb5398ea2f50c97c6",
"ResolvConfPath": "/var/lib/docker/containers/319dc7f1aee59bc84eb2c16051b30669bb72533aded72416f1cb1e689f7550fd/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/319dc7f1aee59bc84eb2c16051b30669bb72533aded72416f1cb1e689f7550fd/hostname",
"HostsPath": "/var/lib/docker/containers/319dc7f1aee59bc84eb2c16051b30669bb72533aded72416f1cb1e689f7550fd/hosts",
"LogPath": "/var/lib/docker/containers/319dc7f1aee59bc84eb2c16051b30669bb72533aded72416f1cb1e689f7550fd/319dc7f1aee59bc84eb2c16051b30669bb72533aded72416f1cb1e689f7550fd-json.log",
"Name": "/addons-726754",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-726754:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-726754",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/0d3e668c08e4b0e37ea3e03496a12864147f74c09fde612aef9c0598b023ec6f-init/diff:/var/lib/docker/overlay2/dff060cd4e9382e758ba60bffaaeeca22b78e3466a4ecd4887c9950dd9c3672c/diff",
"MergedDir": "/var/lib/docker/overlay2/0d3e668c08e4b0e37ea3e03496a12864147f74c09fde612aef9c0598b023ec6f/merged",
"UpperDir": "/var/lib/docker/overlay2/0d3e668c08e4b0e37ea3e03496a12864147f74c09fde612aef9c0598b023ec6f/diff",
"WorkDir": "/var/lib/docker/overlay2/0d3e668c08e4b0e37ea3e03496a12864147f74c09fde612aef9c0598b023ec6f/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-726754",
"Source": "/var/lib/docker/volumes/addons-726754/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-726754",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-726754",
"name.minikube.sigs.k8s.io": "addons-726754",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "63efac2b58e97cbdfcdfc0750dae022b5c2e8ce80d22b4c2a24d72c5bee61939",
"SandboxKey": "/var/run/docker/netns/63efac2b58e9",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33534"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33535"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33538"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33536"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33537"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-726754": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "9e8c6653f07f7d8ed78cb0de75273ce75b49c92bdeb49b5637651604d53531a3",
"EndpointID": "c8e7fde893fb82a3081332597e79677b93ba6f2a3afabe9e5386d9647f5646c2",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-726754",
"319dc7f1aee5"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-726754 -n addons-726754
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-726754 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-726754 logs -n 25: (1.695555581s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-040557 | jenkins | v1.33.1 | 27 Aug 24 23:01 UTC | |
| | -p download-only-040557 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.33.1 | 27 Aug 24 23:01 UTC | 27 Aug 24 23:01 UTC |
| delete | -p download-only-040557 | download-only-040557 | jenkins | v1.33.1 | 27 Aug 24 23:01 UTC | 27 Aug 24 23:01 UTC |
| start | -o=json --download-only | download-only-783356 | jenkins | v1.33.1 | 27 Aug 24 23:01 UTC | |
| | -p download-only-783356 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.33.1 | 27 Aug 24 23:01 UTC | 27 Aug 24 23:01 UTC |
| delete | -p download-only-783356 | download-only-783356 | jenkins | v1.33.1 | 27 Aug 24 23:01 UTC | 27 Aug 24 23:01 UTC |
| delete | -p download-only-040557 | download-only-040557 | jenkins | v1.33.1 | 27 Aug 24 23:01 UTC | 27 Aug 24 23:01 UTC |
| delete | -p download-only-783356 | download-only-783356 | jenkins | v1.33.1 | 27 Aug 24 23:01 UTC | 27 Aug 24 23:01 UTC |
| start | --download-only -p | download-docker-558946 | jenkins | v1.33.1 | 27 Aug 24 23:01 UTC | |
| | download-docker-558946 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-558946 | download-docker-558946 | jenkins | v1.33.1 | 27 Aug 24 23:01 UTC | 27 Aug 24 23:01 UTC |
| start | --download-only -p | binary-mirror-264953 | jenkins | v1.33.1 | 27 Aug 24 23:01 UTC | |
| | binary-mirror-264953 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:43903 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-264953 | binary-mirror-264953 | jenkins | v1.33.1 | 27 Aug 24 23:01 UTC | 27 Aug 24 23:01 UTC |
| addons | disable dashboard -p | addons-726754 | jenkins | v1.33.1 | 27 Aug 24 23:01 UTC | |
| | addons-726754 | | | | | |
| addons | enable dashboard -p | addons-726754 | jenkins | v1.33.1 | 27 Aug 24 23:01 UTC | |
| | addons-726754 | | | | | |
| start | -p addons-726754 --wait=true | addons-726754 | jenkins | v1.33.1 | 27 Aug 24 23:01 UTC | 27 Aug 24 23:05 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/08/27 23:01:56
Running on machine: ip-172-31-30-239
Binary: Built with gc go1.22.5 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0827 23:01:56.628023 1740482 out.go:345] Setting OutFile to fd 1 ...
I0827 23:01:56.628213 1740482 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0827 23:01:56.628227 1740482 out.go:358] Setting ErrFile to fd 2...
I0827 23:01:56.628234 1740482 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0827 23:01:56.628539 1740482 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19522-1734325/.minikube/bin
I0827 23:01:56.629043 1740482 out.go:352] Setting JSON to false
I0827 23:01:56.630040 1740482 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":24266,"bootTime":1724775451,"procs":159,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1068-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I0827 23:01:56.630112 1740482 start.go:139] virtualization:
I0827 23:01:56.632511 1740482 out.go:177] * [addons-726754] minikube v1.33.1 on Ubuntu 20.04 (arm64)
I0827 23:01:56.634848 1740482 out.go:177] - MINIKUBE_LOCATION=19522
I0827 23:01:56.634972 1740482 notify.go:220] Checking for updates...
I0827 23:01:56.638864 1740482 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0827 23:01:56.640645 1740482 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19522-1734325/kubeconfig
I0827 23:01:56.642322 1740482 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19522-1734325/.minikube
I0827 23:01:56.644100 1740482 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0827 23:01:56.645870 1740482 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0827 23:01:56.647949 1740482 driver.go:392] Setting default libvirt URI to qemu:///system
I0827 23:01:56.673943 1740482 docker.go:123] docker version: linux-27.2.0:Docker Engine - Community
I0827 23:01:56.674068 1740482 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0827 23:01:56.742660 1740482 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-08-27 23:01:56.733300539 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214843392 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0827 23:01:56.742769 1740482 docker.go:307] overlay module found
I0827 23:01:56.744855 1740482 out.go:177] * Using the docker driver based on user configuration
I0827 23:01:56.746910 1740482 start.go:297] selected driver: docker
I0827 23:01:56.746929 1740482 start.go:901] validating driver "docker" against <nil>
I0827 23:01:56.746942 1740482 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0827 23:01:56.747555 1740482 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0827 23:01:56.816695 1740482 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-08-27 23:01:56.807322573 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214843392 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.2.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:472731909fa34bd7bc9c087e4c27943f9835f111 Expected:472731909fa34bd7bc9c087e4c27943f9835f111} RuncCommit:{ID:v1.1.13-0-g58aa920 Expected:v1.1.13-0-g58aa920} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0827 23:01:56.816860 1740482 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0827 23:01:56.817095 1740482 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0827 23:01:56.818783 1740482 out.go:177] * Using Docker driver with root privileges
I0827 23:01:56.820429 1740482 cni.go:84] Creating CNI manager for ""
I0827 23:01:56.820455 1740482 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0827 23:01:56.820471 1740482 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0827 23:01:56.820545 1740482 start.go:340] cluster config:
{Name:addons-726754 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-726754 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0827 23:01:56.822554 1740482 out.go:177] * Starting "addons-726754" primary control-plane node in "addons-726754" cluster
I0827 23:01:56.824343 1740482 cache.go:121] Beginning downloading kic base image for docker with containerd
I0827 23:01:56.826139 1740482 out.go:177] * Pulling base image v0.0.44-1724667927-19511 ...
I0827 23:01:56.827901 1740482 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0827 23:01:56.827966 1740482 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4
I0827 23:01:56.827985 1740482 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 in local docker daemon
I0827 23:01:56.827989 1740482 cache.go:56] Caching tarball of preloaded images
I0827 23:01:56.828073 1740482 preload.go:172] Found /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0827 23:01:56.828083 1740482 cache.go:59] Finished verifying existence of preloaded tar for v1.31.0 on containerd
I0827 23:01:56.828504 1740482 profile.go:143] Saving config to /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/config.json ...
I0827 23:01:56.828534 1740482 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/config.json: {Name:mk64aad033d3c0556d71a4c1d4ff26e28a9622bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:01:56.843001 1740482 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 to local cache
I0827 23:01:56.843105 1740482 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 in local cache directory
I0827 23:01:56.843127 1740482 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 in local cache directory, skipping pull
I0827 23:01:56.843132 1740482 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 exists in cache, skipping pull
I0827 23:01:56.843143 1740482 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 as a tarball
I0827 23:01:56.843148 1740482 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 from local cache
I0827 23:02:14.545904 1740482 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 from cached tarball
I0827 23:02:14.545945 1740482 cache.go:194] Successfully downloaded all kic artifacts
I0827 23:02:14.545992 1740482 start.go:360] acquireMachinesLock for addons-726754: {Name:mkbd04d8b968309578ca3eaa7c634587e47bdbce Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0827 23:02:14.546679 1740482 start.go:364] duration metric: took 660.721µs to acquireMachinesLock for "addons-726754"
I0827 23:02:14.546718 1740482 start.go:93] Provisioning new machine with config: &{Name:addons-726754 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-726754 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0827 23:02:14.546796 1740482 start.go:125] createHost starting for "" (driver="docker")
I0827 23:02:14.548923 1740482 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0827 23:02:14.549170 1740482 start.go:159] libmachine.API.Create for "addons-726754" (driver="docker")
I0827 23:02:14.549205 1740482 client.go:168] LocalClient.Create starting
I0827 23:02:14.549320 1740482 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca.pem
I0827 23:02:15.034761 1740482 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/cert.pem
I0827 23:02:15.266459 1740482 cli_runner.go:164] Run: docker network inspect addons-726754 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0827 23:02:15.284405 1740482 cli_runner.go:211] docker network inspect addons-726754 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0827 23:02:15.284514 1740482 network_create.go:284] running [docker network inspect addons-726754] to gather additional debugging logs...
I0827 23:02:15.284539 1740482 cli_runner.go:164] Run: docker network inspect addons-726754
W0827 23:02:15.298727 1740482 cli_runner.go:211] docker network inspect addons-726754 returned with exit code 1
I0827 23:02:15.298766 1740482 network_create.go:287] error running [docker network inspect addons-726754]: docker network inspect addons-726754: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-726754 not found
I0827 23:02:15.298780 1740482 network_create.go:289] output of [docker network inspect addons-726754]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-726754 not found
** /stderr **
I0827 23:02:15.298898 1740482 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0827 23:02:15.314837 1740482 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001ae8850}
I0827 23:02:15.314881 1740482 network_create.go:124] attempt to create docker network addons-726754 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0827 23:02:15.314938 1740482 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-726754 addons-726754
I0827 23:02:15.386886 1740482 network_create.go:108] docker network addons-726754 192.168.49.0/24 created
I0827 23:02:15.386921 1740482 kic.go:121] calculated static IP "192.168.49.2" for the "addons-726754" container
I0827 23:02:15.387011 1740482 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0827 23:02:15.402318 1740482 cli_runner.go:164] Run: docker volume create addons-726754 --label name.minikube.sigs.k8s.io=addons-726754 --label created_by.minikube.sigs.k8s.io=true
I0827 23:02:15.419633 1740482 oci.go:103] Successfully created a docker volume addons-726754
I0827 23:02:15.419730 1740482 cli_runner.go:164] Run: docker run --rm --name addons-726754-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-726754 --entrypoint /usr/bin/test -v addons-726754:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 -d /var/lib
I0827 23:02:16.418197 1740482 oci.go:107] Successfully prepared a docker volume addons-726754
I0827 23:02:16.418238 1740482 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0827 23:02:16.418261 1740482 kic.go:194] Starting extracting preloaded images to volume ...
I0827 23:02:16.418345 1740482 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-726754:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 -I lz4 -xf /preloaded.tar -C /extractDir
I0827 23:02:20.500846 1740482 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19522-1734325/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.0-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-726754:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 -I lz4 -xf /preloaded.tar -C /extractDir: (4.082435575s)
I0827 23:02:20.500877 1740482 kic.go:203] duration metric: took 4.08261455s to extract preloaded images to volume ...
W0827 23:02:20.501018 1740482 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0827 23:02:20.501132 1740482 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0827 23:02:20.550551 1740482 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-726754 --name addons-726754 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-726754 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-726754 --network addons-726754 --ip 192.168.49.2 --volume addons-726754:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760
I0827 23:02:20.852790 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Running}}
I0827 23:02:20.873013 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:20.893406 1740482 cli_runner.go:164] Run: docker exec addons-726754 stat /var/lib/dpkg/alternatives/iptables
I0827 23:02:20.966651 1740482 oci.go:144] the created container "addons-726754" has a running status.
I0827 23:02:20.966680 1740482 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa...
I0827 23:02:21.312777 1740482 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0827 23:02:21.335350 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:21.356197 1740482 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0827 23:02:21.356222 1740482 kic_runner.go:114] Args: [docker exec --privileged addons-726754 chown docker:docker /home/docker/.ssh/authorized_keys]
I0827 23:02:21.439909 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:21.464780 1740482 machine.go:93] provisionDockerMachine start ...
I0827 23:02:21.464894 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:21.482553 1740482 main.go:141] libmachine: Using SSH client type: native
I0827 23:02:21.482821 1740482 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33534 <nil> <nil>}
I0827 23:02:21.482830 1740482 main.go:141] libmachine: About to run SSH command:
hostname
I0827 23:02:21.664213 1740482 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-726754
I0827 23:02:21.664246 1740482 ubuntu.go:169] provisioning hostname "addons-726754"
I0827 23:02:21.664318 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:21.690648 1740482 main.go:141] libmachine: Using SSH client type: native
I0827 23:02:21.690924 1740482 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33534 <nil> <nil>}
I0827 23:02:21.690943 1740482 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-726754 && echo "addons-726754" | sudo tee /etc/hostname
I0827 23:02:21.874306 1740482 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-726754
I0827 23:02:21.874480 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:21.899470 1740482 main.go:141] libmachine: Using SSH client type: native
I0827 23:02:21.899719 1740482 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3e49d0] 0x3e7230 <nil> [] 0s} 127.0.0.1 33534 <nil> <nil>}
I0827 23:02:21.899735 1740482 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-726754' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-726754/g' /etc/hosts;
else
echo '127.0.1.1 addons-726754' | sudo tee -a /etc/hosts;
fi
fi
I0827 23:02:22.048965 1740482 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0827 23:02:22.048992 1740482 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19522-1734325/.minikube CaCertPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19522-1734325/.minikube}
I0827 23:02:22.049025 1740482 ubuntu.go:177] setting up certificates
I0827 23:02:22.049035 1740482 provision.go:84] configureAuth start
I0827 23:02:22.049101 1740482 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-726754
I0827 23:02:22.066229 1740482 provision.go:143] copyHostCerts
I0827 23:02:22.066314 1740482 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19522-1734325/.minikube/cert.pem (1123 bytes)
I0827 23:02:22.066433 1740482 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19522-1734325/.minikube/key.pem (1675 bytes)
I0827 23:02:22.066499 1740482 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.pem (1078 bytes)
I0827 23:02:22.066546 1740482 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca-key.pem org=jenkins.addons-726754 san=[127.0.0.1 192.168.49.2 addons-726754 localhost minikube]
I0827 23:02:22.308961 1740482 provision.go:177] copyRemoteCerts
I0827 23:02:22.309060 1740482 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0827 23:02:22.309117 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:22.325859 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:22.424948 1740482 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0827 23:02:22.449543 1740482 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0827 23:02:22.473288 1740482 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0827 23:02:22.498281 1740482 provision.go:87] duration metric: took 449.231925ms to configureAuth
I0827 23:02:22.498312 1740482 ubuntu.go:193] setting minikube options for container-runtime
I0827 23:02:22.498511 1740482 config.go:182] Loaded profile config "addons-726754": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0827 23:02:22.498525 1740482 machine.go:96] duration metric: took 1.033722936s to provisionDockerMachine
I0827 23:02:22.498532 1740482 client.go:171] duration metric: took 7.949316507s to LocalClient.Create
I0827 23:02:22.498553 1740482 start.go:167] duration metric: took 7.949383583s to libmachine.API.Create "addons-726754"
I0827 23:02:22.498569 1740482 start.go:293] postStartSetup for "addons-726754" (driver="docker")
I0827 23:02:22.498587 1740482 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0827 23:02:22.498647 1740482 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0827 23:02:22.498692 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:22.515277 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:22.619332 1740482 ssh_runner.go:195] Run: cat /etc/os-release
I0827 23:02:22.623245 1740482 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0827 23:02:22.623281 1740482 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0827 23:02:22.623292 1740482 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0827 23:02:22.623299 1740482 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0827 23:02:22.623309 1740482 filesync.go:126] Scanning /home/jenkins/minikube-integration/19522-1734325/.minikube/addons for local assets ...
I0827 23:02:22.623376 1740482 filesync.go:126] Scanning /home/jenkins/minikube-integration/19522-1734325/.minikube/files for local assets ...
I0827 23:02:22.623402 1740482 start.go:296] duration metric: took 124.82ms for postStartSetup
I0827 23:02:22.623719 1740482 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-726754
I0827 23:02:22.642750 1740482 profile.go:143] Saving config to /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/config.json ...
I0827 23:02:22.643036 1740482 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0827 23:02:22.643097 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:22.660777 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:22.761928 1740482 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0827 23:02:22.768146 1740482 start.go:128] duration metric: took 8.22133343s to createHost
I0827 23:02:22.768173 1740482 start.go:83] releasing machines lock for "addons-726754", held for 8.221477632s
I0827 23:02:22.768246 1740482 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-726754
I0827 23:02:22.786487 1740482 ssh_runner.go:195] Run: cat /version.json
I0827 23:02:22.786555 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:22.786784 1740482 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0827 23:02:22.786857 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:22.805255 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:22.816991 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:23.039576 1740482 ssh_runner.go:195] Run: systemctl --version
I0827 23:02:23.044218 1740482 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0827 23:02:23.049254 1740482 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0827 23:02:23.075620 1740482 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0827 23:02:23.075703 1740482 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0827 23:02:23.104093 1740482 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0827 23:02:23.104120 1740482 start.go:495] detecting cgroup driver to use...
I0827 23:02:23.104153 1740482 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0827 23:02:23.104202 1740482 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0827 23:02:23.117187 1740482 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0827 23:02:23.129021 1740482 docker.go:217] disabling cri-docker service (if available) ...
I0827 23:02:23.129131 1740482 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0827 23:02:23.143711 1740482 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0827 23:02:23.158085 1740482 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0827 23:02:23.238834 1740482 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0827 23:02:23.331904 1740482 docker.go:233] disabling docker service ...
I0827 23:02:23.332020 1740482 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0827 23:02:23.352791 1740482 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0827 23:02:23.364679 1740482 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0827 23:02:23.453515 1740482 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0827 23:02:23.544496 1740482 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0827 23:02:23.556102 1740482 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0827 23:02:23.573595 1740482 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0827 23:02:23.583703 1740482 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0827 23:02:23.593882 1740482 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0827 23:02:23.593988 1740482 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0827 23:02:23.604082 1740482 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0827 23:02:23.614329 1740482 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0827 23:02:23.624565 1740482 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0827 23:02:23.634759 1740482 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0827 23:02:23.644337 1740482 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0827 23:02:23.654718 1740482 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0827 23:02:23.664979 1740482 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0827 23:02:23.675274 1740482 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0827 23:02:23.684066 1740482 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0827 23:02:23.692556 1740482 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0827 23:02:23.782281 1740482 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0827 23:02:23.907393 1740482 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0827 23:02:23.907482 1740482 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0827 23:02:23.911044 1740482 start.go:563] Will wait 60s for crictl version
I0827 23:02:23.911105 1740482 ssh_runner.go:195] Run: which crictl
I0827 23:02:23.914462 1740482 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0827 23:02:23.955596 1740482 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.20
RuntimeApiVersion: v1
I0827 23:02:23.955677 1740482 ssh_runner.go:195] Run: containerd --version
I0827 23:02:23.977200 1740482 ssh_runner.go:195] Run: containerd --version
I0827 23:02:24.001126 1740482 out.go:177] * Preparing Kubernetes v1.31.0 on containerd 1.7.20 ...
I0827 23:02:24.002651 1740482 cli_runner.go:164] Run: docker network inspect addons-726754 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0827 23:02:24.023081 1740482 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0827 23:02:24.027395 1740482 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0827 23:02:24.040289 1740482 kubeadm.go:883] updating cluster {Name:addons-726754 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-726754 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0827 23:02:24.040475 1740482 preload.go:131] Checking if preload exists for k8s version v1.31.0 and runtime containerd
I0827 23:02:24.040548 1740482 ssh_runner.go:195] Run: sudo crictl images --output json
I0827 23:02:24.077881 1740482 containerd.go:627] all images are preloaded for containerd runtime.
I0827 23:02:24.077907 1740482 containerd.go:534] Images already preloaded, skipping extraction
I0827 23:02:24.077971 1740482 ssh_runner.go:195] Run: sudo crictl images --output json
I0827 23:02:24.123523 1740482 containerd.go:627] all images are preloaded for containerd runtime.
I0827 23:02:24.123549 1740482 cache_images.go:84] Images are preloaded, skipping loading
I0827 23:02:24.123561 1740482 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.0 containerd true true} ...
I0827 23:02:24.123669 1740482 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-726754 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.0 ClusterName:addons-726754 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0827 23:02:24.123744 1740482 ssh_runner.go:195] Run: sudo crictl info
I0827 23:02:24.160156 1740482 cni.go:84] Creating CNI manager for ""
I0827 23:02:24.160227 1740482 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0827 23:02:24.160250 1740482 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0827 23:02:24.160330 1740482 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-726754 NodeName:addons-726754 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0827 23:02:24.160546 1740482 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-726754"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.0
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0827 23:02:24.160628 1740482 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.0
I0827 23:02:24.169833 1740482 binaries.go:44] Found k8s binaries, skipping transfer
I0827 23:02:24.169954 1740482 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0827 23:02:24.178692 1740482 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I0827 23:02:24.196834 1740482 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0827 23:02:24.215537 1740482 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
I0827 23:02:24.233514 1740482 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0827 23:02:24.237089 1740482 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0827 23:02:24.248049 1740482 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0827 23:02:24.339359 1740482 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0827 23:02:24.353717 1740482 certs.go:68] Setting up /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754 for IP: 192.168.49.2
I0827 23:02:24.353739 1740482 certs.go:194] generating shared ca certs ...
I0827 23:02:24.353755 1740482 certs.go:226] acquiring lock for ca certs: {Name:mkd3d47e0a7419f9dbeb7a4e1a68db1090a3adb2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:02:24.354470 1740482 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.key
I0827 23:02:24.876636 1740482 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.crt ...
I0827 23:02:24.876669 1740482 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.crt: {Name:mk2889b552f38a4afa4cc458033d4165e94b5208 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:02:24.877504 1740482 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.key ...
I0827 23:02:24.877524 1740482 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.key: {Name:mkdc2142ec85f1bcaa2c058f81ce45ae59be658b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:02:24.877621 1740482 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/proxy-client-ca.key
I0827 23:02:25.901715 1740482 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19522-1734325/.minikube/proxy-client-ca.crt ...
I0827 23:02:25.901808 1740482 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19522-1734325/.minikube/proxy-client-ca.crt: {Name:mkf24b0e0340b839eae7a612c0be8247a7488339 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:02:25.902650 1740482 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19522-1734325/.minikube/proxy-client-ca.key ...
I0827 23:02:25.902707 1740482 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19522-1734325/.minikube/proxy-client-ca.key: {Name:mk108ce94435cfe2f9b12c1a142159ab2faa1342 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:02:25.902875 1740482 certs.go:256] generating profile certs ...
I0827 23:02:25.902982 1740482 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/client.key
I0827 23:02:25.903018 1740482 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/client.crt with IP's: []
I0827 23:02:26.308642 1740482 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/client.crt ...
I0827 23:02:26.308674 1740482 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/client.crt: {Name:mk8abb04963bdb91bbfc6df840b32092ec1cde85 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:02:26.308871 1740482 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/client.key ...
I0827 23:02:26.308884 1740482 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/client.key: {Name:mkfe570828c0d88aef5600e04e8ebd6bf3d32e87 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:02:26.309532 1740482 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/apiserver.key.59a65641
I0827 23:02:26.309556 1740482 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/apiserver.crt.59a65641 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0827 23:02:26.500272 1740482 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/apiserver.crt.59a65641 ...
I0827 23:02:26.500305 1740482 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/apiserver.crt.59a65641: {Name:mka19e514749aec15d03295ab60ac76283da0a0a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:02:26.501031 1740482 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/apiserver.key.59a65641 ...
I0827 23:02:26.501052 1740482 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/apiserver.key.59a65641: {Name:mk12e8177fe045947dcc93fad4ccd69bda55134a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:02:26.501151 1740482 certs.go:381] copying /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/apiserver.crt.59a65641 -> /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/apiserver.crt
I0827 23:02:26.501236 1740482 certs.go:385] copying /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/apiserver.key.59a65641 -> /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/apiserver.key
I0827 23:02:26.501305 1740482 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/proxy-client.key
I0827 23:02:26.501327 1740482 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/proxy-client.crt with IP's: []
I0827 23:02:27.025079 1740482 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/proxy-client.crt ...
I0827 23:02:27.025117 1740482 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/proxy-client.crt: {Name:mk699453ed207b82472cdf4cbd4f7541af6288c3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:02:27.025315 1740482 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/proxy-client.key ...
I0827 23:02:27.025329 1740482 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/proxy-client.key: {Name:mk4758fa6e49ed1c9710049f3a119b2a23105981 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:02:27.025512 1740482 certs.go:484] found cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca-key.pem (1675 bytes)
I0827 23:02:27.025563 1740482 certs.go:484] found cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/ca.pem (1078 bytes)
I0827 23:02:27.025594 1740482 certs.go:484] found cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/cert.pem (1123 bytes)
I0827 23:02:27.025622 1740482 certs.go:484] found cert: /home/jenkins/minikube-integration/19522-1734325/.minikube/certs/key.pem (1675 bytes)
I0827 23:02:27.026342 1740482 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0827 23:02:27.054318 1740482 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0827 23:02:27.080356 1740482 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0827 23:02:27.105961 1740482 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0827 23:02:27.131102 1740482 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0827 23:02:27.156077 1740482 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0827 23:02:27.180830 1740482 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0827 23:02:27.204179 1740482 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/profiles/addons-726754/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0827 23:02:27.228030 1740482 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19522-1734325/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0827 23:02:27.254786 1740482 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0827 23:02:27.273055 1740482 ssh_runner.go:195] Run: openssl version
I0827 23:02:27.278776 1740482 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0827 23:02:27.288635 1740482 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0827 23:02:27.292098 1740482 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Aug 27 23:02 /usr/share/ca-certificates/minikubeCA.pem
I0827 23:02:27.292184 1740482 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0827 23:02:27.299087 1740482 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0827 23:02:27.308742 1740482 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0827 23:02:27.312083 1740482 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0827 23:02:27.312129 1740482 kubeadm.go:392] StartCluster: {Name:addons-726754 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1724667927-19511@sha256:b76289bde084f8cc5aa1f5685cd851c6acc563e6f33ea479e9ba6777b63de760 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.0 ClusterName:addons-726754 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0827 23:02:27.312209 1740482 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0827 23:02:27.312268 1740482 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0827 23:02:27.349303 1740482 cri.go:89] found id: ""
I0827 23:02:27.349446 1740482 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0827 23:02:27.360700 1740482 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0827 23:02:27.371953 1740482 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0827 23:02:27.372058 1740482 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0827 23:02:27.384549 1740482 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0827 23:02:27.384611 1740482 kubeadm.go:157] found existing configuration files:
I0827 23:02:27.384690 1740482 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0827 23:02:27.398422 1740482 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0827 23:02:27.398528 1740482 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0827 23:02:27.407118 1740482 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0827 23:02:27.416300 1740482 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0827 23:02:27.416482 1740482 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0827 23:02:27.425715 1740482 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0827 23:02:27.435933 1740482 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0827 23:02:27.436033 1740482 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0827 23:02:27.445057 1740482 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0827 23:02:27.454291 1740482 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0827 23:02:27.454388 1740482 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0827 23:02:27.462935 1740482 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0827 23:02:27.503103 1740482 kubeadm.go:310] [init] Using Kubernetes version: v1.31.0
I0827 23:02:27.503436 1740482 kubeadm.go:310] [preflight] Running pre-flight checks
I0827 23:02:27.522843 1740482 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0827 23:02:27.522919 1740482 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1068-aws[0m
I0827 23:02:27.522959 1740482 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0827 23:02:27.523008 1740482 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0827 23:02:27.523058 1740482 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0827 23:02:27.523107 1740482 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0827 23:02:27.523157 1740482 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0827 23:02:27.523207 1740482 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0827 23:02:27.523257 1740482 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0827 23:02:27.523304 1740482 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0827 23:02:27.523356 1740482 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0827 23:02:27.523405 1740482 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0827 23:02:27.587139 1740482 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0827 23:02:27.587249 1740482 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0827 23:02:27.587671 1740482 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0827 23:02:27.596762 1740482 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0827 23:02:27.599670 1740482 out.go:235] - Generating certificates and keys ...
I0827 23:02:27.599769 1740482 kubeadm.go:310] [certs] Using existing ca certificate authority
I0827 23:02:27.599838 1740482 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0827 23:02:28.401782 1740482 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0827 23:02:28.584354 1740482 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0827 23:02:29.665161 1740482 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0827 23:02:29.970251 1740482 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0827 23:02:31.057668 1740482 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0827 23:02:31.058018 1740482 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-726754 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0827 23:02:31.572256 1740482 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0827 23:02:31.572434 1740482 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-726754 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0827 23:02:32.065306 1740482 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0827 23:02:32.489581 1740482 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0827 23:02:33.196459 1740482 kubeadm.go:310] [certs] Generating "sa" key and public key
I0827 23:02:33.196857 1740482 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0827 23:02:33.895350 1740482 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0827 23:02:34.237891 1740482 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0827 23:02:34.775388 1740482 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0827 23:02:35.448775 1740482 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0827 23:02:36.165541 1740482 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0827 23:02:36.167088 1740482 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0827 23:02:36.169438 1740482 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0827 23:02:36.171778 1740482 out.go:235] - Booting up control plane ...
I0827 23:02:36.171905 1740482 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0827 23:02:36.171991 1740482 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0827 23:02:36.172595 1740482 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0827 23:02:36.185561 1740482 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0827 23:02:36.192039 1740482 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0827 23:02:36.192101 1740482 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0827 23:02:36.299338 1740482 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0827 23:02:36.299744 1740482 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0827 23:02:37.301715 1740482 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.002347003s
I0827 23:02:37.301801 1740482 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0827 23:02:43.303081 1740482 kubeadm.go:310] [api-check] The API server is healthy after 6.001398635s
I0827 23:02:43.323471 1740482 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0827 23:02:43.340391 1740482 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0827 23:02:43.372748 1740482 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0827 23:02:43.372939 1740482 kubeadm.go:310] [mark-control-plane] Marking the node addons-726754 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0827 23:02:43.390760 1740482 kubeadm.go:310] [bootstrap-token] Using token: kd7f31.sf1crtudhrh1a6sj
I0827 23:02:43.392908 1740482 out.go:235] - Configuring RBAC rules ...
I0827 23:02:43.393036 1740482 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0827 23:02:43.403285 1740482 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0827 23:02:43.415123 1740482 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0827 23:02:43.419098 1740482 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0827 23:02:43.423741 1740482 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0827 23:02:43.429277 1740482 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0827 23:02:43.710169 1740482 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0827 23:02:44.138176 1740482 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0827 23:02:44.709796 1740482 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0827 23:02:44.711082 1740482 kubeadm.go:310]
I0827 23:02:44.711160 1740482 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0827 23:02:44.711170 1740482 kubeadm.go:310]
I0827 23:02:44.711245 1740482 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0827 23:02:44.711254 1740482 kubeadm.go:310]
I0827 23:02:44.711279 1740482 kubeadm.go:310] mkdir -p $HOME/.kube
I0827 23:02:44.711340 1740482 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0827 23:02:44.711399 1740482 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0827 23:02:44.711408 1740482 kubeadm.go:310]
I0827 23:02:44.711461 1740482 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0827 23:02:44.711468 1740482 kubeadm.go:310]
I0827 23:02:44.711514 1740482 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0827 23:02:44.711522 1740482 kubeadm.go:310]
I0827 23:02:44.711573 1740482 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0827 23:02:44.711649 1740482 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0827 23:02:44.711718 1740482 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0827 23:02:44.711727 1740482 kubeadm.go:310]
I0827 23:02:44.711807 1740482 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0827 23:02:44.711884 1740482 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0827 23:02:44.711895 1740482 kubeadm.go:310]
I0827 23:02:44.711976 1740482 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token kd7f31.sf1crtudhrh1a6sj \
I0827 23:02:44.712079 1740482 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:e879f986fa82e6940b81a691a9ced07ae93cad55f5ba78217e5b550b4c965d8a \
I0827 23:02:44.712103 1740482 kubeadm.go:310] --control-plane
I0827 23:02:44.712114 1740482 kubeadm.go:310]
I0827 23:02:44.712195 1740482 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0827 23:02:44.712203 1740482 kubeadm.go:310]
I0827 23:02:44.712282 1740482 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token kd7f31.sf1crtudhrh1a6sj \
I0827 23:02:44.712418 1740482 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:e879f986fa82e6940b81a691a9ced07ae93cad55f5ba78217e5b550b4c965d8a
I0827 23:02:44.716669 1740482 kubeadm.go:310] W0827 23:02:27.499564 1034 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0827 23:02:44.716961 1740482 kubeadm.go:310] W0827 23:02:27.500618 1034 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0827 23:02:44.717172 1740482 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1068-aws\n", err: exit status 1
I0827 23:02:44.717282 1740482 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0827 23:02:44.717308 1740482 cni.go:84] Creating CNI manager for ""
I0827 23:02:44.717320 1740482 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0827 23:02:44.719475 1740482 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0827 23:02:44.721472 1740482 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0827 23:02:44.725338 1740482 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.0/kubectl ...
I0827 23:02:44.725360 1740482 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0827 23:02:44.745646 1740482 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0827 23:02:45.120213 1740482 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0827 23:02:45.120339 1740482 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-726754 minikube.k8s.io/updated_at=2024_08_27T23_02_45_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=d0790207a2867fe8d040a9642b972c86ef680cdf minikube.k8s.io/name=addons-726754 minikube.k8s.io/primary=true
I0827 23:02:45.120461 1740482 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0827 23:02:45.372624 1740482 ops.go:34] apiserver oom_adj: -16
I0827 23:02:45.372720 1740482 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0827 23:02:45.873589 1740482 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0827 23:02:46.372891 1740482 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0827 23:02:46.872870 1740482 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0827 23:02:47.373731 1740482 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0827 23:02:47.873219 1740482 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0827 23:02:48.373415 1740482 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0827 23:02:48.873733 1740482 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0827 23:02:49.029838 1740482 kubeadm.go:1113] duration metric: took 3.90968901s to wait for elevateKubeSystemPrivileges
I0827 23:02:49.029864 1740482 kubeadm.go:394] duration metric: took 21.717738344s to StartCluster
I0827 23:02:49.029887 1740482 settings.go:142] acquiring lock: {Name:mk2abdfb376a9e7540e648c96e5aaa1709f13213 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:02:49.030009 1740482 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19522-1734325/kubeconfig
I0827 23:02:49.030386 1740482 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19522-1734325/kubeconfig: {Name:mkbc2349839e7e640d3be8c9c9dabdbaf532417a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0827 23:02:49.031215 1740482 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.0 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0827 23:02:49.031387 1740482 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0827 23:02:49.031666 1740482 config.go:182] Loaded profile config "addons-726754": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0827 23:02:49.031696 1740482 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0827 23:02:49.031769 1740482 addons.go:69] Setting yakd=true in profile "addons-726754"
I0827 23:02:49.031791 1740482 addons.go:234] Setting addon yakd=true in "addons-726754"
I0827 23:02:49.031815 1740482 host.go:66] Checking if "addons-726754" exists ...
I0827 23:02:49.032315 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:49.032758 1740482 addons.go:69] Setting inspektor-gadget=true in profile "addons-726754"
I0827 23:02:49.032785 1740482 addons.go:234] Setting addon inspektor-gadget=true in "addons-726754"
I0827 23:02:49.032820 1740482 host.go:66] Checking if "addons-726754" exists ...
I0827 23:02:49.033278 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:49.033806 1740482 addons.go:69] Setting cloud-spanner=true in profile "addons-726754"
I0827 23:02:49.033845 1740482 addons.go:234] Setting addon cloud-spanner=true in "addons-726754"
I0827 23:02:49.033877 1740482 host.go:66] Checking if "addons-726754" exists ...
I0827 23:02:49.034316 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:49.036307 1740482 addons.go:69] Setting metrics-server=true in profile "addons-726754"
I0827 23:02:49.036895 1740482 addons.go:234] Setting addon metrics-server=true in "addons-726754"
I0827 23:02:49.036794 1740482 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-726754"
I0827 23:02:49.036805 1740482 addons.go:69] Setting default-storageclass=true in profile "addons-726754"
I0827 23:02:49.036816 1740482 addons.go:69] Setting gcp-auth=true in profile "addons-726754"
I0827 23:02:49.036820 1740482 addons.go:69] Setting ingress=true in profile "addons-726754"
I0827 23:02:49.036824 1740482 addons.go:69] Setting ingress-dns=true in profile "addons-726754"
I0827 23:02:49.039034 1740482 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-726754"
I0827 23:02:49.039366 1740482 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-726754"
I0827 23:02:49.040679 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:49.045922 1740482 host.go:66] Checking if "addons-726754" exists ...
I0827 23:02:49.046166 1740482 out.go:177] * Verifying Kubernetes components...
I0827 23:02:49.046400 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:49.049723 1740482 addons.go:234] Setting addon ingress=true in "addons-726754"
I0827 23:02:49.049776 1740482 host.go:66] Checking if "addons-726754" exists ...
I0827 23:02:49.050214 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:49.062404 1740482 addons.go:234] Setting addon ingress-dns=true in "addons-726754"
I0827 23:02:49.062463 1740482 host.go:66] Checking if "addons-726754" exists ...
I0827 23:02:49.062919 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:49.064557 1740482 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-726754"
I0827 23:02:49.064595 1740482 host.go:66] Checking if "addons-726754" exists ...
I0827 23:02:49.065013 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:49.039046 1740482 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-726754"
I0827 23:02:49.082590 1740482 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-726754"
I0827 23:02:49.082655 1740482 host.go:66] Checking if "addons-726754" exists ...
I0827 23:02:49.082940 1740482 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-726754"
I0827 23:02:49.083175 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:49.083204 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:49.095202 1740482 mustload.go:65] Loading cluster: addons-726754
I0827 23:02:49.095464 1740482 config.go:182] Loaded profile config "addons-726754": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.0
I0827 23:02:49.039050 1740482 addons.go:69] Setting registry=true in profile "addons-726754"
I0827 23:02:49.095545 1740482 addons.go:234] Setting addon registry=true in "addons-726754"
I0827 23:02:49.095581 1740482 host.go:66] Checking if "addons-726754" exists ...
I0827 23:02:49.095743 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:49.039054 1740482 addons.go:69] Setting storage-provisioner=true in profile "addons-726754"
I0827 23:02:49.098724 1740482 addons.go:234] Setting addon storage-provisioner=true in "addons-726754"
I0827 23:02:49.098765 1740482 host.go:66] Checking if "addons-726754" exists ...
I0827 23:02:49.039058 1740482 addons.go:69] Setting volumesnapshots=true in profile "addons-726754"
I0827 23:02:49.098893 1740482 addons.go:234] Setting addon volumesnapshots=true in "addons-726754"
I0827 23:02:49.039061 1740482 addons.go:69] Setting volcano=true in profile "addons-726754"
I0827 23:02:49.098941 1740482 addons.go:234] Setting addon volcano=true in "addons-726754"
I0827 23:02:49.099075 1740482 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0827 23:02:49.142926 1740482 host.go:66] Checking if "addons-726754" exists ...
I0827 23:02:49.143733 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:49.152941 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:49.098967 1740482 host.go:66] Checking if "addons-726754" exists ...
I0827 23:02:49.162419 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:49.179545 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:49.212595 1740482 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.31.0
I0827 23:02:49.215861 1740482 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0827 23:02:49.215958 1740482 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0827 23:02:49.219801 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:49.234694 1740482 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23
I0827 23:02:49.237107 1740482 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0827 23:02:49.240660 1740482 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0827 23:02:49.240681 1740482 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0827 23:02:49.240754 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:49.254648 1740482 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-726754"
I0827 23:02:49.255271 1740482 host.go:66] Checking if "addons-726754" exists ...
I0827 23:02:49.255835 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:49.254947 1740482 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0827 23:02:49.282834 1740482 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0827 23:02:49.282920 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:49.290212 1740482 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0827 23:02:49.306529 1740482 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0827 23:02:49.308319 1740482 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0827 23:02:49.308902 1740482 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1
I0827 23:02:49.311612 1740482 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0827 23:02:49.311895 1740482 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0827 23:02:49.311909 1740482 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0827 23:02:49.311972 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:49.333703 1740482 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0827 23:02:49.339441 1740482 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0827 23:02:49.339508 1740482 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0827 23:02:49.339617 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:49.361537 1740482 addons.go:234] Setting addon default-storageclass=true in "addons-726754"
I0827 23:02:49.361627 1740482 host.go:66] Checking if "addons-726754" exists ...
I0827 23:02:49.362136 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:49.366996 1740482 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0827 23:02:49.367020 1740482 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0827 23:02:49.367086 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:49.380342 1740482 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0827 23:02:49.380901 1740482 host.go:66] Checking if "addons-726754" exists ...
I0827 23:02:49.382666 1740482 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0827 23:02:49.383494 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:49.399494 1740482 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0827 23:02:49.401806 1740482 out.go:177] - Using image docker.io/busybox:stable
I0827 23:02:49.403782 1740482 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0827 23:02:49.403848 1740482 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0827 23:02:49.404107 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:49.412904 1740482 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0827 23:02:49.413957 1740482 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0827 23:02:49.420697 1740482 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0827 23:02:49.427567 1740482 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0827 23:02:49.427621 1740482 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0827 23:02:49.427700 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:49.429896 1740482 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0827 23:02:49.429922 1740482 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0827 23:02:49.430024 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:49.430072 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:49.452325 1740482 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0827 23:02:49.458189 1740482 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0827 23:02:49.458341 1740482 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0827 23:02:49.460635 1740482 out.go:177] - Using image docker.io/registry:2.8.3
I0827 23:02:49.460762 1740482 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0827 23:02:49.468422 1740482 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0827 23:02:49.468638 1740482 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0827 23:02:49.468654 1740482 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0827 23:02:49.468728 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:49.497884 1740482 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0827 23:02:49.498755 1740482 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0827 23:02:49.499348 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:49.519698 1740482 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0827 23:02:49.521083 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:49.526720 1740482 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0827 23:02:49.526747 1740482 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0827 23:02:49.526826 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:49.527684 1740482 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0827 23:02:49.527709 1740482 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0827 23:02:49.527779 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:49.544621 1740482 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0827 23:02:49.546758 1740482 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0827 23:02:49.546784 1740482 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0827 23:02:49.546902 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:49.561384 1740482 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0827 23:02:49.561404 1740482 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0827 23:02:49.561460 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:49.576952 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:49.578049 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:49.578359 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:49.592009 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:49.631360 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:49.635485 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:49.646754 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
W0827 23:02:49.650502 1740482 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0827 23:02:49.650531 1740482 retry.go:31] will retry after 233.847898ms: ssh: handshake failed: EOF
I0827 23:02:49.664680 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:49.665453 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:49.671341 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:49.682789 1740482 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0827 23:02:49.695817 1740482 ssh_runner.go:195] Run: sudo systemctl start kubelet
W0827 23:02:49.890615 1740482 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0827 23:02:49.890687 1740482 retry.go:31] will retry after 266.767423ms: ssh: handshake failed: EOF
I0827 23:02:50.246333 1740482 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0827 23:02:50.278905 1740482 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0827 23:02:50.285455 1740482 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0827 23:02:50.296504 1740482 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0827 23:02:50.296587 1740482 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0827 23:02:50.305791 1740482 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0827 23:02:50.310615 1740482 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0827 23:02:50.310635 1740482 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0827 23:02:50.332321 1740482 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0827 23:02:50.354224 1740482 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0827 23:02:50.362469 1740482 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0827 23:02:50.362541 1740482 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0827 23:02:50.425509 1740482 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0827 23:02:50.442476 1740482 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0827 23:02:50.442500 1740482 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0827 23:02:50.464277 1740482 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0827 23:02:50.464302 1740482 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0827 23:02:50.479969 1740482 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0827 23:02:50.480037 1740482 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0827 23:02:50.493893 1740482 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0827 23:02:50.493963 1740482 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0827 23:02:50.518879 1740482 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0827 23:02:50.518956 1740482 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0827 23:02:50.537766 1740482 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0827 23:02:50.549035 1740482 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0827 23:02:50.549110 1740482 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0827 23:02:50.576773 1740482 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0827 23:02:50.576848 1740482 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0827 23:02:50.733366 1740482 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0827 23:02:50.733387 1740482 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0827 23:02:50.833636 1740482 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0827 23:02:50.833713 1740482 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0827 23:02:50.850128 1740482 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0827 23:02:50.850205 1740482 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0827 23:02:50.855067 1740482 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0827 23:02:50.855182 1740482 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0827 23:02:50.912647 1740482 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0827 23:02:50.912670 1740482 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0827 23:02:51.025930 1740482 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0827 23:02:51.026012 1740482 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0827 23:02:51.038208 1740482 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0827 23:02:51.038237 1740482 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0827 23:02:51.111509 1740482 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0827 23:02:51.111531 1740482 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0827 23:02:51.121130 1740482 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0827 23:02:51.246333 1740482 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0827 23:02:51.246360 1740482 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0827 23:02:51.426266 1740482 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0827 23:02:51.484518 1740482 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0827 23:02:51.484544 1740482 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0827 23:02:51.490048 1740482 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0827 23:02:51.490068 1740482 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0827 23:02:51.636240 1740482 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0827 23:02:51.636327 1740482 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0827 23:02:51.767666 1740482 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0827 23:02:51.767740 1740482 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0827 23:02:51.888954 1740482 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0827 23:02:51.889001 1740482 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0827 23:02:51.910727 1740482 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0827 23:02:51.954090 1740482 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0827 23:02:52.045145 1740482 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.362318653s)
I0827 23:02:52.045228 1740482 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0827 23:02:52.046422 1740482 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.350579319s)
I0827 23:02:52.047530 1740482 node_ready.go:35] waiting up to 6m0s for node "addons-726754" to be "Ready" ...
I0827 23:02:52.054216 1740482 node_ready.go:49] node "addons-726754" has status "Ready":"True"
I0827 23:02:52.054293 1740482 node_ready.go:38] duration metric: took 6.700902ms for node "addons-726754" to be "Ready" ...
I0827 23:02:52.054319 1740482 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0827 23:02:52.065816 1740482 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-fd2n8" in "kube-system" namespace to be "Ready" ...
I0827 23:02:52.217450 1740482 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0827 23:02:52.217525 1740482 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0827 23:02:52.356766 1740482 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0827 23:02:52.356829 1740482 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0827 23:02:52.384419 1740482 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0827 23:02:52.529931 1740482 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0827 23:02:52.529994 1740482 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0827 23:02:52.549569 1740482 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-726754" context rescaled to 1 replicas
I0827 23:02:52.881785 1740482 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0827 23:02:52.881858 1740482 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0827 23:02:53.144088 1740482 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0827 23:02:53.144162 1740482 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0827 23:02:53.430353 1740482 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0827 23:02:53.430378 1740482 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0827 23:02:53.744034 1740482 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0827 23:02:53.744060 1740482 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0827 23:02:54.038386 1740482 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0827 23:02:54.121507 1740482 pod_ready.go:103] pod "coredns-6f6b679f8f-fd2n8" in "kube-system" namespace has status "Ready":"False"
I0827 23:02:56.130925 1740482 pod_ready.go:103] pod "coredns-6f6b679f8f-fd2n8" in "kube-system" namespace has status "Ready":"False"
I0827 23:02:56.597457 1740482 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0827 23:02:56.597533 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:56.635136 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:56.979230 1740482 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0827 23:02:57.161843 1740482 addons.go:234] Setting addon gcp-auth=true in "addons-726754"
I0827 23:02:57.161893 1740482 host.go:66] Checking if "addons-726754" exists ...
I0827 23:02:57.162351 1740482 cli_runner.go:164] Run: docker container inspect addons-726754 --format={{.State.Status}}
I0827 23:02:57.189027 1740482 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0827 23:02:57.189094 1740482 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-726754
I0827 23:02:57.225790 1740482 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33534 SSHKeyPath:/home/jenkins/minikube-integration/19522-1734325/.minikube/machines/addons-726754/id_rsa Username:docker}
I0827 23:02:58.598341 1740482 pod_ready.go:103] pod "coredns-6f6b679f8f-fd2n8" in "kube-system" namespace has status "Ready":"False"
I0827 23:02:59.543679 1740482 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (9.297304762s)
I0827 23:02:59.543811 1740482 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (9.264883681s)
I0827 23:02:59.543827 1740482 addons.go:475] Verifying addon ingress=true in "addons-726754"
I0827 23:02:59.543966 1740482 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (9.258422635s)
I0827 23:02:59.544001 1740482 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (9.238191389s)
I0827 23:02:59.544201 1740482 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (9.211715427s)
I0827 23:02:59.544249 1740482 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (9.189914886s)
I0827 23:02:59.544287 1740482 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (9.118713748s)
I0827 23:02:59.544350 1740482 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (9.00651646s)
I0827 23:02:59.544505 1740482 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.423347412s)
I0827 23:02:59.544524 1740482 addons.go:475] Verifying addon metrics-server=true in "addons-726754"
I0827 23:02:59.544664 1740482 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (8.118368899s)
I0827 23:02:59.544863 1740482 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (7.634111502s)
I0827 23:02:59.544883 1740482 addons.go:475] Verifying addon registry=true in "addons-726754"
I0827 23:02:59.545151 1740482 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.590986972s)
W0827 23:02:59.545185 1740482 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0827 23:02:59.545209 1740482 retry.go:31] will retry after 285.173413ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0827 23:02:59.545281 1740482 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (7.16078891s)
I0827 23:02:59.548674 1740482 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-726754 service yakd-dashboard -n yakd-dashboard
I0827 23:02:59.548781 1740482 out.go:177] * Verifying ingress addon...
I0827 23:02:59.548814 1740482 out.go:177] * Verifying registry addon...
I0827 23:02:59.552073 1740482 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0827 23:02:59.552073 1740482 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0827 23:02:59.613576 1740482 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0827 23:02:59.613603 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:02:59.614529 1740482 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0827 23:02:59.614550 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
W0827 23:02:59.647175 1740482 out.go:270] ! Enabling 'storage-provisioner-rancher' returned an error: running callbacks: [Error making local-path the default storage class: Error while marking storage class local-path as default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
I0827 23:02:59.830510 1740482 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0827 23:03:00.094414 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:00.102821 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:00.576078 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:00.595586 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:00.599657 1740482 pod_ready.go:103] pod "coredns-6f6b679f8f-fd2n8" in "kube-system" namespace has status "Ready":"False"
I0827 23:03:00.683480 1740482 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.645037986s)
I0827 23:03:00.683514 1740482 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-726754"
I0827 23:03:00.683727 1740482 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.494673543s)
I0827 23:03:00.686687 1740482 out.go:177] * Verifying csi-hostpath-driver addon...
I0827 23:03:00.686772 1740482 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0827 23:03:00.689375 1740482 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0827 23:03:00.691536 1740482 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0827 23:03:00.693220 1740482 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0827 23:03:00.693248 1740482 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0827 23:03:00.694869 1740482 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0827 23:03:00.694896 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:00.736980 1740482 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0827 23:03:00.737004 1740482 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0827 23:03:00.797895 1740482 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0827 23:03:00.797922 1740482 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0827 23:03:00.826250 1740482 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0827 23:03:01.060423 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:01.061028 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:01.195749 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:01.492120 1740482 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.661554912s)
I0827 23:03:01.557856 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:01.558329 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:01.699920 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:01.834173 1740482 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.007881327s)
I0827 23:03:01.837033 1740482 addons.go:475] Verifying addon gcp-auth=true in "addons-726754"
I0827 23:03:01.839227 1740482 out.go:177] * Verifying gcp-auth addon...
I0827 23:03:01.841642 1740482 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0827 23:03:01.852626 1740482 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0827 23:03:02.058096 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:02.058875 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:02.196167 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:02.558199 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:02.559740 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:02.695421 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:03.058909 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:03.061908 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:03.076295 1740482 pod_ready.go:103] pod "coredns-6f6b679f8f-fd2n8" in "kube-system" namespace has status "Ready":"False"
I0827 23:03:03.196044 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:03.559046 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:03.560283 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:03.695039 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:04.056924 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:04.057591 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:04.194364 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:04.560141 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:04.561234 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:04.694517 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:05.061693 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:05.063980 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:05.081032 1740482 pod_ready.go:103] pod "coredns-6f6b679f8f-fd2n8" in "kube-system" namespace has status "Ready":"False"
I0827 23:03:05.195716 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:05.559851 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:05.560917 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:05.695405 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:06.058021 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:06.058552 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:06.195025 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:06.558449 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:06.558905 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:06.694077 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:07.058064 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:07.058260 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:07.193935 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:07.557503 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:07.558433 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:07.573958 1740482 pod_ready.go:103] pod "coredns-6f6b679f8f-fd2n8" in "kube-system" namespace has status "Ready":"False"
I0827 23:03:07.694626 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:08.058649 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:08.061672 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:08.195169 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:08.556216 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:08.556820 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:08.696097 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:09.059603 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:09.060529 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:09.196115 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:09.569781 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:09.572589 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:09.579043 1740482 pod_ready.go:103] pod "coredns-6f6b679f8f-fd2n8" in "kube-system" namespace has status "Ready":"False"
I0827 23:03:09.696654 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:10.079980 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:10.081105 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:10.194690 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:10.558036 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:10.558662 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:10.694768 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:11.057513 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:11.057825 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:11.194577 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:11.557190 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:11.559174 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:11.695456 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:12.056620 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:12.057319 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:12.073704 1740482 pod_ready.go:103] pod "coredns-6f6b679f8f-fd2n8" in "kube-system" namespace has status "Ready":"False"
I0827 23:03:12.196693 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:12.557711 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:12.558120 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:12.695117 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:13.056953 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:13.058976 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:13.195008 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:13.557451 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:13.558344 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:13.694422 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:14.057941 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:14.059463 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:14.073864 1740482 pod_ready.go:103] pod "coredns-6f6b679f8f-fd2n8" in "kube-system" namespace has status "Ready":"False"
I0827 23:03:14.195060 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:14.557349 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:14.557945 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:14.694660 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:15.064136 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:15.065291 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:15.195753 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:15.559482 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:15.578372 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:15.693933 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:16.059799 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:16.062532 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:16.074804 1740482 pod_ready.go:103] pod "coredns-6f6b679f8f-fd2n8" in "kube-system" namespace has status "Ready":"False"
I0827 23:03:16.195350 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:16.560281 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:16.563770 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:16.575032 1740482 pod_ready.go:93] pod "coredns-6f6b679f8f-fd2n8" in "kube-system" namespace has status "Ready":"True"
I0827 23:03:16.575058 1740482 pod_ready.go:82] duration metric: took 24.509168296s for pod "coredns-6f6b679f8f-fd2n8" in "kube-system" namespace to be "Ready" ...
I0827 23:03:16.575069 1740482 pod_ready.go:79] waiting up to 6m0s for pod "coredns-6f6b679f8f-pr4r9" in "kube-system" namespace to be "Ready" ...
I0827 23:03:16.578075 1740482 pod_ready.go:98] error getting pod "coredns-6f6b679f8f-pr4r9" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-pr4r9" not found
I0827 23:03:16.578102 1740482 pod_ready.go:82] duration metric: took 3.025789ms for pod "coredns-6f6b679f8f-pr4r9" in "kube-system" namespace to be "Ready" ...
E0827 23:03:16.578114 1740482 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-6f6b679f8f-pr4r9" in "kube-system" namespace (skipping!): pods "coredns-6f6b679f8f-pr4r9" not found
I0827 23:03:16.578121 1740482 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-726754" in "kube-system" namespace to be "Ready" ...
I0827 23:03:16.586391 1740482 pod_ready.go:93] pod "etcd-addons-726754" in "kube-system" namespace has status "Ready":"True"
I0827 23:03:16.586416 1740482 pod_ready.go:82] duration metric: took 8.286822ms for pod "etcd-addons-726754" in "kube-system" namespace to be "Ready" ...
I0827 23:03:16.586430 1740482 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-726754" in "kube-system" namespace to be "Ready" ...
I0827 23:03:16.592607 1740482 pod_ready.go:93] pod "kube-apiserver-addons-726754" in "kube-system" namespace has status "Ready":"True"
I0827 23:03:16.592632 1740482 pod_ready.go:82] duration metric: took 6.194099ms for pod "kube-apiserver-addons-726754" in "kube-system" namespace to be "Ready" ...
I0827 23:03:16.592645 1740482 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-726754" in "kube-system" namespace to be "Ready" ...
I0827 23:03:16.597945 1740482 pod_ready.go:93] pod "kube-controller-manager-addons-726754" in "kube-system" namespace has status "Ready":"True"
I0827 23:03:16.597972 1740482 pod_ready.go:82] duration metric: took 5.319656ms for pod "kube-controller-manager-addons-726754" in "kube-system" namespace to be "Ready" ...
I0827 23:03:16.597985 1740482 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-bb76v" in "kube-system" namespace to be "Ready" ...
I0827 23:03:16.695091 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:16.769897 1740482 pod_ready.go:93] pod "kube-proxy-bb76v" in "kube-system" namespace has status "Ready":"True"
I0827 23:03:16.769923 1740482 pod_ready.go:82] duration metric: took 171.930752ms for pod "kube-proxy-bb76v" in "kube-system" namespace to be "Ready" ...
I0827 23:03:16.769934 1740482 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-726754" in "kube-system" namespace to be "Ready" ...
I0827 23:03:17.058459 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:17.059002 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:17.171550 1740482 pod_ready.go:93] pod "kube-scheduler-addons-726754" in "kube-system" namespace has status "Ready":"True"
I0827 23:03:17.171626 1740482 pod_ready.go:82] duration metric: took 401.682834ms for pod "kube-scheduler-addons-726754" in "kube-system" namespace to be "Ready" ...
I0827 23:03:17.171651 1740482 pod_ready.go:39] duration metric: took 25.11730722s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0827 23:03:17.171678 1740482 api_server.go:52] waiting for apiserver process to appear ...
I0827 23:03:17.171792 1740482 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0827 23:03:17.196451 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:17.199083 1740482 api_server.go:72] duration metric: took 28.167826495s to wait for apiserver process to appear ...
I0827 23:03:17.199155 1740482 api_server.go:88] waiting for apiserver healthz status ...
I0827 23:03:17.199192 1740482 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0827 23:03:17.208339 1740482 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0827 23:03:17.209489 1740482 api_server.go:141] control plane version: v1.31.0
I0827 23:03:17.209560 1740482 api_server.go:131] duration metric: took 10.383712ms to wait for apiserver health ...
I0827 23:03:17.209583 1740482 system_pods.go:43] waiting for kube-system pods to appear ...
I0827 23:03:17.381378 1740482 system_pods.go:59] 18 kube-system pods found
I0827 23:03:17.381459 1740482 system_pods.go:61] "coredns-6f6b679f8f-fd2n8" [400d6a78-21c9-4db2-86c4-b3bbfae9dd22] Running
I0827 23:03:17.381484 1740482 system_pods.go:61] "csi-hostpath-attacher-0" [e7db069e-9746-4dab-a72a-83196f9b77de] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0827 23:03:17.381508 1740482 system_pods.go:61] "csi-hostpath-resizer-0" [cb02f8e3-50ce-4453-9e13-8c268f0f8981] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0827 23:03:17.381547 1740482 system_pods.go:61] "csi-hostpathplugin-c28vf" [f7a28b36-7024-497b-8bf1-831e8bbdbdb6] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0827 23:03:17.381569 1740482 system_pods.go:61] "etcd-addons-726754" [943a3c44-130c-4253-a264-fa392915e4c1] Running
I0827 23:03:17.381588 1740482 system_pods.go:61] "kindnet-skmvw" [95af43bc-5a22-4726-b71b-21c99cd592b0] Running
I0827 23:03:17.381606 1740482 system_pods.go:61] "kube-apiserver-addons-726754" [c0ffad5a-b37f-4f4b-93bb-cbdd9dde272d] Running
I0827 23:03:17.381637 1740482 system_pods.go:61] "kube-controller-manager-addons-726754" [0919c849-a4b4-4738-b4f6-9099fa9329cc] Running
I0827 23:03:17.381658 1740482 system_pods.go:61] "kube-ingress-dns-minikube" [55708f08-d80b-4b41-97d2-f5be9ff5eca1] Running
I0827 23:03:17.381676 1740482 system_pods.go:61] "kube-proxy-bb76v" [5bc8508f-a216-4ffe-be15-e108c2b52a93] Running
I0827 23:03:17.381693 1740482 system_pods.go:61] "kube-scheduler-addons-726754" [c7dc6fcf-6b09-4c91-b35a-ca289a961bbd] Running
I0827 23:03:17.381724 1740482 system_pods.go:61] "metrics-server-8988944d9-9zq2h" [68f66677-d6fe-47b3-bcbe-1d75b9c9a49f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0827 23:03:17.381747 1740482 system_pods.go:61] "nvidia-device-plugin-daemonset-j96qf" [470c2134-9d9e-48ff-89d0-bf973f12a637] Running
I0827 23:03:17.381768 1740482 system_pods.go:61] "registry-6fb4cdfc84-97j86" [007aa8f4-d9b8-4f63-a5b1-8327bb01249d] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0827 23:03:17.381788 1740482 system_pods.go:61] "registry-proxy-dk9mv" [2e38d268-dcf1-4880-8d79-499746cf6bfe] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0827 23:03:17.381823 1740482 system_pods.go:61] "snapshot-controller-56fcc65765-bth5s" [8b073fe3-b812-4b31-8233-f9a3766dbebb] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0827 23:03:17.381846 1740482 system_pods.go:61] "snapshot-controller-56fcc65765-c6mmv" [625a5a99-0148-46b3-b7a8-6667e4f6678b] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0827 23:03:17.381863 1740482 system_pods.go:61] "storage-provisioner" [f16df684-4726-42ae-ba5b-c51c5cb24c86] Running
I0827 23:03:17.381883 1740482 system_pods.go:74] duration metric: took 172.282243ms to wait for pod list to return data ...
I0827 23:03:17.381903 1740482 default_sa.go:34] waiting for default service account to be created ...
I0827 23:03:17.557217 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:17.558143 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:17.569904 1740482 default_sa.go:45] found service account: "default"
I0827 23:03:17.569936 1740482 default_sa.go:55] duration metric: took 188.007427ms for default service account to be created ...
I0827 23:03:17.569946 1740482 system_pods.go:116] waiting for k8s-apps to be running ...
I0827 23:03:17.694584 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:17.777582 1740482 system_pods.go:86] 18 kube-system pods found
I0827 23:03:17.777618 1740482 system_pods.go:89] "coredns-6f6b679f8f-fd2n8" [400d6a78-21c9-4db2-86c4-b3bbfae9dd22] Running
I0827 23:03:17.777630 1740482 system_pods.go:89] "csi-hostpath-attacher-0" [e7db069e-9746-4dab-a72a-83196f9b77de] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0827 23:03:17.777639 1740482 system_pods.go:89] "csi-hostpath-resizer-0" [cb02f8e3-50ce-4453-9e13-8c268f0f8981] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0827 23:03:17.777647 1740482 system_pods.go:89] "csi-hostpathplugin-c28vf" [f7a28b36-7024-497b-8bf1-831e8bbdbdb6] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0827 23:03:17.777652 1740482 system_pods.go:89] "etcd-addons-726754" [943a3c44-130c-4253-a264-fa392915e4c1] Running
I0827 23:03:17.777658 1740482 system_pods.go:89] "kindnet-skmvw" [95af43bc-5a22-4726-b71b-21c99cd592b0] Running
I0827 23:03:17.777664 1740482 system_pods.go:89] "kube-apiserver-addons-726754" [c0ffad5a-b37f-4f4b-93bb-cbdd9dde272d] Running
I0827 23:03:17.777670 1740482 system_pods.go:89] "kube-controller-manager-addons-726754" [0919c849-a4b4-4738-b4f6-9099fa9329cc] Running
I0827 23:03:17.777676 1740482 system_pods.go:89] "kube-ingress-dns-minikube" [55708f08-d80b-4b41-97d2-f5be9ff5eca1] Running
I0827 23:03:17.777681 1740482 system_pods.go:89] "kube-proxy-bb76v" [5bc8508f-a216-4ffe-be15-e108c2b52a93] Running
I0827 23:03:17.777695 1740482 system_pods.go:89] "kube-scheduler-addons-726754" [c7dc6fcf-6b09-4c91-b35a-ca289a961bbd] Running
I0827 23:03:17.777702 1740482 system_pods.go:89] "metrics-server-8988944d9-9zq2h" [68f66677-d6fe-47b3-bcbe-1d75b9c9a49f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0827 23:03:17.777709 1740482 system_pods.go:89] "nvidia-device-plugin-daemonset-j96qf" [470c2134-9d9e-48ff-89d0-bf973f12a637] Running
I0827 23:03:17.777716 1740482 system_pods.go:89] "registry-6fb4cdfc84-97j86" [007aa8f4-d9b8-4f63-a5b1-8327bb01249d] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0827 23:03:17.777724 1740482 system_pods.go:89] "registry-proxy-dk9mv" [2e38d268-dcf1-4880-8d79-499746cf6bfe] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0827 23:03:17.777731 1740482 system_pods.go:89] "snapshot-controller-56fcc65765-bth5s" [8b073fe3-b812-4b31-8233-f9a3766dbebb] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0827 23:03:17.777738 1740482 system_pods.go:89] "snapshot-controller-56fcc65765-c6mmv" [625a5a99-0148-46b3-b7a8-6667e4f6678b] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0827 23:03:17.777745 1740482 system_pods.go:89] "storage-provisioner" [f16df684-4726-42ae-ba5b-c51c5cb24c86] Running
I0827 23:03:17.777753 1740482 system_pods.go:126] duration metric: took 207.80162ms to wait for k8s-apps to be running ...
I0827 23:03:17.777760 1740482 system_svc.go:44] waiting for kubelet service to be running ....
I0827 23:03:17.777821 1740482 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0827 23:03:17.796460 1740482 system_svc.go:56] duration metric: took 18.689346ms WaitForService to wait for kubelet
I0827 23:03:17.796489 1740482 kubeadm.go:582] duration metric: took 28.765238945s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0827 23:03:17.796510 1740482 node_conditions.go:102] verifying NodePressure condition ...
I0827 23:03:17.970723 1740482 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0827 23:03:17.970755 1740482 node_conditions.go:123] node cpu capacity is 2
I0827 23:03:17.970769 1740482 node_conditions.go:105] duration metric: took 174.253983ms to run NodePressure ...
I0827 23:03:17.970783 1740482 start.go:241] waiting for startup goroutines ...
I0827 23:03:18.058919 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:18.060459 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:18.202098 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:18.558061 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:18.558877 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:18.709921 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:19.058609 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:19.059557 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:19.195241 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:19.556467 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:19.557764 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:19.695306 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:20.057872 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:20.059794 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:20.198263 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:20.557699 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:20.558229 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:20.693956 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:21.069831 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:21.071402 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:21.195823 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:21.560009 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:21.563061 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:21.697734 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:22.059182 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:22.062002 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:22.194752 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:22.558326 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:22.558294 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:22.694668 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:23.059718 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:23.060761 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:23.197631 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:23.557076 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:23.557580 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:23.695888 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:24.057328 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:24.057979 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:24.194339 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:24.557422 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:24.558659 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:24.694462 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:25.056866 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:25.058158 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:25.196245 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:25.557211 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:25.558127 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:25.695305 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:26.057772 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:26.058167 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:26.194818 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:26.564018 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:26.565716 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:26.694600 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:27.057310 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:27.058290 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:27.194231 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:27.557915 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:27.558159 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:27.703532 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:28.058167 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:28.060492 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:28.195236 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:28.568958 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:28.581645 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:28.700289 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:29.058951 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:29.060212 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:29.195647 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:29.561137 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:29.562841 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:29.702745 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:30.059369 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:30.059700 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:30.200390 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:30.563116 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:30.563835 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:30.695669 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:31.058021 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:31.059322 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:31.194786 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:31.558732 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:31.559413 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:31.695187 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:32.057649 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:32.058575 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:32.195336 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:32.556954 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:32.558893 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:32.694865 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:33.057481 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:33.058482 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:33.195364 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:33.557205 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0827 23:03:33.558125 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:33.694536 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:34.057312 1740482 kapi.go:107] duration metric: took 34.505236577s to wait for kubernetes.io/minikube-addons=registry ...
I0827 23:03:34.058305 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:34.194222 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:34.557184 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:34.695514 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:35.061344 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:35.195646 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:35.557636 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:35.694407 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:36.060033 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:36.195959 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:36.556545 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:36.694874 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:37.062739 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:37.195882 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:37.557440 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:37.698594 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:38.058118 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:38.194832 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:38.557797 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:38.697040 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:39.056683 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:39.194175 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:39.557538 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:39.694404 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:40.076945 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:40.195416 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:40.557614 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:40.695206 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:41.056291 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:41.199141 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:41.557222 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:41.693947 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:42.057793 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:42.195692 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:42.556348 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:42.694346 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:43.058129 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:43.195126 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:43.557999 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:43.696024 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:44.057734 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:44.194593 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:44.557262 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:44.693673 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:45.074258 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:45.195570 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:45.556804 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:45.695197 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:46.056590 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:46.193851 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:46.557712 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:46.694669 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:47.056574 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:47.194602 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:47.557816 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:47.694394 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:48.057099 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:48.194835 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:48.558544 1740482 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0827 23:03:48.702199 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:49.062476 1740482 kapi.go:107] duration metric: took 49.510403996s to wait for app.kubernetes.io/name=ingress-nginx ...
I0827 23:03:49.198150 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:49.708900 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:50.195279 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:50.695157 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:51.196636 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:51.696650 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:52.194931 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:52.694765 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:53.194979 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:53.694392 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:54.194977 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:54.695234 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:55.195308 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:55.694708 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:56.194489 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:56.694700 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0827 23:03:57.194696 1740482 kapi.go:107] duration metric: took 56.505322975s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0827 23:04:25.345691 1740482 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0827 23:04:25.345716 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:25.845841 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:26.345599 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:26.845384 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:27.345459 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:27.845464 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:28.345594 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:28.844974 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:29.345422 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:29.846363 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:30.345403 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:30.844752 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:31.345109 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:31.845136 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:32.344977 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:32.845599 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:33.344755 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:33.845193 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:34.344631 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:34.845559 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:35.346018 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:35.845534 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:36.345581 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:36.846470 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:37.345352 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:37.847200 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:38.344854 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:38.845703 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:39.345647 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:39.846173 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:40.345391 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:40.845274 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:41.345345 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:41.846099 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:42.347404 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:42.845307 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:43.345941 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:43.845872 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:44.345750 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:44.845529 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:45.346994 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:45.845644 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:46.345471 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:46.845768 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:47.345929 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:47.845879 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:48.345101 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:48.845626 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:49.344960 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:49.846354 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:50.345966 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:50.845045 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:51.345567 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:51.846001 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:52.346019 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:52.845571 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:53.344936 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:53.846411 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:54.345159 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:54.845557 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:55.344858 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:55.845972 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:56.345191 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:56.845950 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:57.346159 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:57.845525 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:58.345301 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:58.844950 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:59.345984 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:04:59.846118 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:00.351286 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:00.845566 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:01.345764 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:01.846416 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:02.346090 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:02.845269 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:03.346479 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:03.845244 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:04.345217 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:04.844538 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:05.346163 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:05.845831 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:06.345507 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:06.846156 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:07.345096 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:07.845926 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:08.346142 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:08.845637 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:09.344922 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:09.845371 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:10.345432 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:10.846397 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:11.344823 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:11.845761 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:12.346162 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:12.845184 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:13.345286 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:13.845499 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:14.345616 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:14.845591 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:15.345706 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:15.845832 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:16.345445 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:16.846733 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:17.345951 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:17.845672 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:18.345291 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:18.844930 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:19.345406 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:19.852567 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:20.345982 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:20.846035 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:21.346405 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:21.848942 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:22.346191 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:22.845194 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:23.345508 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:23.844781 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:24.345856 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:24.845920 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:25.345582 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:25.845690 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:26.345130 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:26.845204 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:27.345098 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:27.846155 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:28.344892 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:28.845247 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:29.346126 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:29.844689 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:30.346073 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:30.845565 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:31.344963 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:31.847373 1740482 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0827 23:05:32.345374 1740482 kapi.go:107] duration metric: took 2m30.503735655s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0827 23:05:32.347019 1740482 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-726754 cluster.
I0827 23:05:32.349304 1740482 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0827 23:05:32.351335 1740482 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0827 23:05:32.353504 1740482 out.go:177] * Enabled addons: volcano, nvidia-device-plugin, storage-provisioner, cloud-spanner, ingress-dns, metrics-server, inspektor-gadget, yakd, default-storageclass, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth
I0827 23:05:32.355249 1740482 addons.go:510] duration metric: took 2m43.32354382s for enable addons: enabled=[volcano nvidia-device-plugin storage-provisioner cloud-spanner ingress-dns metrics-server inspektor-gadget yakd default-storageclass volumesnapshots registry ingress csi-hostpath-driver gcp-auth]
I0827 23:05:32.355306 1740482 start.go:246] waiting for cluster config update ...
I0827 23:05:32.355339 1740482 start.go:255] writing updated cluster config ...
I0827 23:05:32.355691 1740482 ssh_runner.go:195] Run: rm -f paused
I0827 23:05:32.693868 1740482 start.go:600] kubectl: 1.31.0, cluster: 1.31.0 (minor skew: 0)
I0827 23:05:32.696044 1740482 out.go:177] * Done! kubectl is now configured to use "addons-726754" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
5ee82f965620c e2d3313f65753 2 minutes ago Exited gadget 5 445bae0c40b70 gadget-b9kcp
7090acf9a6e58 6ef582f3ec844 3 minutes ago Running gcp-auth 0 6f9766d3ed3ca gcp-auth-89d5ffd79-wpbz7
b1f2b62e732cc 8b46b1cd48760 4 minutes ago Running admission 0 0f3c31057c37e volcano-admission-77d7d48b68-wjb2c
7033d9b25f3ae ee6d597e62dc8 4 minutes ago Running csi-snapshotter 0 1e7033a883b90 csi-hostpathplugin-c28vf
5f6670fcfc593 642ded511e141 4 minutes ago Running csi-provisioner 0 1e7033a883b90 csi-hostpathplugin-c28vf
cdf2510c91c39 922312104da8a 4 minutes ago Running liveness-probe 0 1e7033a883b90 csi-hostpathplugin-c28vf
05bf03fd22b82 08f6b2990811a 5 minutes ago Running hostpath 0 1e7033a883b90 csi-hostpathplugin-c28vf
44e0c842ead4e 0107d56dbc0be 5 minutes ago Running node-driver-registrar 0 1e7033a883b90 csi-hostpathplugin-c28vf
c60743375e6f4 289a818c8d9c5 5 minutes ago Running controller 0 d474e1d1c9081 ingress-nginx-controller-bc57996ff-dp2pz
31b08ac336c0c 1461903ec4fe9 5 minutes ago Running csi-external-health-monitor-controller 0 1e7033a883b90 csi-hostpathplugin-c28vf
040b14028d8b8 d9c7ad4c226bf 5 minutes ago Running volcano-scheduler 0 0c09500244314 volcano-scheduler-576bc46687-dnf49
db81f5bd8a5a1 9a80d518f102c 5 minutes ago Running csi-attacher 0 4a03e408522c4 csi-hostpath-attacher-0
8c12136263b60 487fa743e1e22 5 minutes ago Running csi-resizer 0 5901a70dc4376 csi-hostpath-resizer-0
b2d6229ec15eb 420193b27261a 5 minutes ago Exited patch 0 3cb6170eaeeb1 ingress-nginx-admission-patch-jj44v
c8a1c3768a8ac 1505f556b3a7b 5 minutes ago Running volcano-controllers 0 3d13cfe91d859 volcano-controllers-56675bb4d5-qq9rb
6eb8e3898f9ba 3410e1561990a 5 minutes ago Running registry-proxy 0 4f5edd525458c registry-proxy-dk9mv
cc5c8d28f0ba4 95dccb4df54ab 5 minutes ago Running metrics-server 0 741bc4ccc9f79 metrics-server-8988944d9-9zq2h
3b459d46f62b6 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 c98aebce9f5e8 snapshot-controller-56fcc65765-bth5s
a1ff5da1bc071 6fed88f43b276 5 minutes ago Running registry 0 f539b33a149a1 registry-6fb4cdfc84-97j86
5c165b2e4f347 420193b27261a 5 minutes ago Exited create 0 764d9bb8b054c ingress-nginx-admission-create-xwvsx
6a84843970522 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 e28559ed2e0db snapshot-controller-56fcc65765-c6mmv
cd505f81e9e50 7ce2150c8929b 5 minutes ago Running local-path-provisioner 0 3e35847cb1b07 local-path-provisioner-86d989889c-q9mbm
7bd054feb119a 77bdba588b953 5 minutes ago Running yakd 0 7f6e32b8817d0 yakd-dashboard-67d98fc6b-x8759
4ba1fd01a9a65 2437cf7621777 5 minutes ago Running coredns 0 f07e355bb1124 coredns-6f6b679f8f-fd2n8
0e4cedd4866a0 8be4bcf8ec607 5 minutes ago Running cloud-spanner-emulator 0 5c3b346834461 cloud-spanner-emulator-769b77f747-vspvs
b77eedbb800ae a9bac31a5be8d 5 minutes ago Running nvidia-device-plugin-ctr 0 1f07f44af3ffd nvidia-device-plugin-daemonset-j96qf
3f0db1d38b863 35508c2f890c4 5 minutes ago Running minikube-ingress-dns 0 48cfa4c72a503 kube-ingress-dns-minikube
2567772b4d1b2 ba04bb24b9575 5 minutes ago Running storage-provisioner 0 0b79e18f831f0 storage-provisioner
3699aee6cec94 6a23fa8fd2b78 5 minutes ago Running kindnet-cni 0 817cbcc124054 kindnet-skmvw
ea7a6397986cb 71d55d66fd4ee 6 minutes ago Running kube-proxy 0 339c1406e9f4b kube-proxy-bb76v
46a124943f4b6 fcb0683e6bdbd 6 minutes ago Running kube-controller-manager 0 6498b2702ca6b kube-controller-manager-addons-726754
b928a40e5a951 cd0f0ae0ec9e0 6 minutes ago Running kube-apiserver 0 a0368bca91fb3 kube-apiserver-addons-726754
cbbae936eec1c fbbbd428abb4d 6 minutes ago Running kube-scheduler 0 b2f429f6883fc kube-scheduler-addons-726754
754d83488f9d8 27e3830e14027 6 minutes ago Running etcd 0 b3aa70dedd8b3 etcd-addons-726754
==> containerd <==
Aug 27 23:06:29 addons-726754 containerd[816]: time="2024-08-27T23:06:29.190054895Z" level=info msg="CreateContainer within sandbox \"445bae0c40b70cc1c4a13e81e90bf7ca139d60e725f380f8e8da2378b96e2b8f\" for container &ContainerMetadata{Name:gadget,Attempt:5,}"
Aug 27 23:06:29 addons-726754 containerd[816]: time="2024-08-27T23:06:29.214579267Z" level=info msg="CreateContainer within sandbox \"445bae0c40b70cc1c4a13e81e90bf7ca139d60e725f380f8e8da2378b96e2b8f\" for &ContainerMetadata{Name:gadget,Attempt:5,} returns container id \"5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b\""
Aug 27 23:06:29 addons-726754 containerd[816]: time="2024-08-27T23:06:29.216064052Z" level=info msg="StartContainer for \"5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b\""
Aug 27 23:06:29 addons-726754 containerd[816]: time="2024-08-27T23:06:29.278746276Z" level=info msg="StartContainer for \"5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b\" returns successfully"
Aug 27 23:06:30 addons-726754 containerd[816]: time="2024-08-27T23:06:30.560258203Z" level=info msg="shim disconnected" id=5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b namespace=k8s.io
Aug 27 23:06:30 addons-726754 containerd[816]: time="2024-08-27T23:06:30.560321595Z" level=warning msg="cleaning up after shim disconnected" id=5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b namespace=k8s.io
Aug 27 23:06:30 addons-726754 containerd[816]: time="2024-08-27T23:06:30.560332515Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Aug 27 23:06:30 addons-726754 containerd[816]: time="2024-08-27T23:06:30.835213732Z" level=error msg="ExecSync for \"5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b\" failed" error="failed to exec in container: container is in CONTAINER_EXITED state"
Aug 27 23:06:30 addons-726754 containerd[816]: time="2024-08-27T23:06:30.835339046Z" level=error msg="ExecSync for \"5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b\" failed" error="failed to exec in container: container is in CONTAINER_EXITED state"
Aug 27 23:06:30 addons-726754 containerd[816]: time="2024-08-27T23:06:30.836217279Z" level=error msg="ExecSync for \"5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b\" failed" error="failed to exec in container: container is in CONTAINER_EXITED state"
Aug 27 23:06:30 addons-726754 containerd[816]: time="2024-08-27T23:06:30.836236069Z" level=error msg="ExecSync for \"5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b\" failed" error="failed to exec in container: container is in CONTAINER_EXITED state"
Aug 27 23:06:30 addons-726754 containerd[816]: time="2024-08-27T23:06:30.837126249Z" level=error msg="ExecSync for \"5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b\" failed" error="failed to exec in container: container is in CONTAINER_EXITED state"
Aug 27 23:06:30 addons-726754 containerd[816]: time="2024-08-27T23:06:30.837141149Z" level=error msg="ExecSync for \"5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b\" failed" error="failed to exec in container: container is in CONTAINER_EXITED state"
Aug 27 23:06:31 addons-726754 containerd[816]: time="2024-08-27T23:06:31.225799961Z" level=info msg="RemoveContainer for \"4e428c82f591790c8e306eb95f92ae3cb086af2b3995769d7e23e01b22adabf4\""
Aug 27 23:06:31 addons-726754 containerd[816]: time="2024-08-27T23:06:31.234186636Z" level=info msg="RemoveContainer for \"4e428c82f591790c8e306eb95f92ae3cb086af2b3995769d7e23e01b22adabf4\" returns successfully"
Aug 27 23:06:44 addons-726754 containerd[816]: time="2024-08-27T23:06:44.152176726Z" level=info msg="RemoveContainer for \"d945a6093af8f0f890698e04a958e5be212dd4a5bcf0d9327a63596555e4ee1f\""
Aug 27 23:06:44 addons-726754 containerd[816]: time="2024-08-27T23:06:44.158359847Z" level=info msg="RemoveContainer for \"d945a6093af8f0f890698e04a958e5be212dd4a5bcf0d9327a63596555e4ee1f\" returns successfully"
Aug 27 23:06:44 addons-726754 containerd[816]: time="2024-08-27T23:06:44.160596525Z" level=info msg="StopPodSandbox for \"b05a79cb2446413fb429a245a0fbd2a83051c7b4e462e6d92cebf2700209db09\""
Aug 27 23:06:44 addons-726754 containerd[816]: time="2024-08-27T23:06:44.168757860Z" level=info msg="TearDown network for sandbox \"b05a79cb2446413fb429a245a0fbd2a83051c7b4e462e6d92cebf2700209db09\" successfully"
Aug 27 23:06:44 addons-726754 containerd[816]: time="2024-08-27T23:06:44.168800329Z" level=info msg="StopPodSandbox for \"b05a79cb2446413fb429a245a0fbd2a83051c7b4e462e6d92cebf2700209db09\" returns successfully"
Aug 27 23:06:44 addons-726754 containerd[816]: time="2024-08-27T23:06:44.169308166Z" level=info msg="RemovePodSandbox for \"b05a79cb2446413fb429a245a0fbd2a83051c7b4e462e6d92cebf2700209db09\""
Aug 27 23:06:44 addons-726754 containerd[816]: time="2024-08-27T23:06:44.169350865Z" level=info msg="Forcibly stopping sandbox \"b05a79cb2446413fb429a245a0fbd2a83051c7b4e462e6d92cebf2700209db09\""
Aug 27 23:06:44 addons-726754 containerd[816]: time="2024-08-27T23:06:44.194404407Z" level=info msg="TearDown network for sandbox \"b05a79cb2446413fb429a245a0fbd2a83051c7b4e462e6d92cebf2700209db09\" successfully"
Aug 27 23:06:44 addons-726754 containerd[816]: time="2024-08-27T23:06:44.200980873Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"b05a79cb2446413fb429a245a0fbd2a83051c7b4e462e6d92cebf2700209db09\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Aug 27 23:06:44 addons-726754 containerd[816]: time="2024-08-27T23:06:44.201105433Z" level=info msg="RemovePodSandbox \"b05a79cb2446413fb429a245a0fbd2a83051c7b4e462e6d92cebf2700209db09\" returns successfully"
==> coredns [4ba1fd01a9a6542fb8a7ef9376cb926b68f4a10e5950ae1fcf0333712b8aae16] <==
[INFO] 10.244.0.8:53634 - 1007 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000424541s
[INFO] 10.244.0.8:51272 - 48976 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002526666s
[INFO] 10.244.0.8:51272 - 30806 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.005223847s
[INFO] 10.244.0.8:58713 - 45014 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.00016199s
[INFO] 10.244.0.8:58713 - 60379 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.00010289s
[INFO] 10.244.0.8:39659 - 9349 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000129934s
[INFO] 10.244.0.8:39659 - 39554 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000194293s
[INFO] 10.244.0.8:55384 - 62203 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000087719s
[INFO] 10.244.0.8:55384 - 21756 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000060175s
[INFO] 10.244.0.8:34319 - 13435 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000208529s
[INFO] 10.244.0.8:34319 - 20861 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.0001326s
[INFO] 10.244.0.8:46872 - 19571 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.003147453s
[INFO] 10.244.0.8:46872 - 19313 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.003738972s
[INFO] 10.244.0.8:49428 - 28280 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000077192s
[INFO] 10.244.0.8:49428 - 5239 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000057829s
[INFO] 10.244.0.24:35022 - 3053 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.00296893s
[INFO] 10.244.0.24:60348 - 58928 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.002719433s
[INFO] 10.244.0.24:48706 - 60817 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000121417s
[INFO] 10.244.0.24:38613 - 60266 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000110947s
[INFO] 10.244.0.24:42971 - 29272 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000127751s
[INFO] 10.244.0.24:60275 - 6748 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000096892s
[INFO] 10.244.0.24:39646 - 5287 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002093526s
[INFO] 10.244.0.24:55583 - 54946 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.001778637s
[INFO] 10.244.0.24:42458 - 65492 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.001757812s
[INFO] 10.244.0.24:36002 - 42481 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.001814623s
==> describe nodes <==
Name: addons-726754
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-726754
kubernetes.io/os=linux
minikube.k8s.io/commit=d0790207a2867fe8d040a9642b972c86ef680cdf
minikube.k8s.io/name=addons-726754
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_08_27T23_02_45_0700
minikube.k8s.io/version=v1.33.1
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-726754
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-726754"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Tue, 27 Aug 2024 23:02:41 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-726754
AcquireTime: <unset>
RenewTime: Tue, 27 Aug 2024 23:08:41 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Tue, 27 Aug 2024 23:05:49 +0000 Tue, 27 Aug 2024 23:02:38 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Tue, 27 Aug 2024 23:05:49 +0000 Tue, 27 Aug 2024 23:02:38 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Tue, 27 Aug 2024 23:05:49 +0000 Tue, 27 Aug 2024 23:02:38 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Tue, 27 Aug 2024 23:05:49 +0000 Tue, 27 Aug 2024 23:02:41 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-726754
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022308Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022308Ki
pods: 110
System Info:
Machine ID: 1cbeafe1fae64eda88c33188e162ec94
System UUID: 444e8bd8-5628-4699-9868-c660fde97167
Boot ID: e72ce5f2-4965-4285-9cc6-e362a4469d8a
Kernel Version: 5.15.0-1068-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.20
Kubelet Version: v1.31.0
Kube-Proxy Version:
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-769b77f747-vspvs 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
gadget gadget-b9kcp 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
gcp-auth gcp-auth-89d5ffd79-wpbz7 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m27s
ingress-nginx ingress-nginx-controller-bc57996ff-dp2pz 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 5m54s
kube-system coredns-6f6b679f8f-fd2n8 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 6m2s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m51s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m51s
kube-system csi-hostpathplugin-c28vf 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m51s
kube-system etcd-addons-726754 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 6m7s
kube-system kindnet-skmvw 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 6m3s
kube-system kube-apiserver-addons-726754 250m (12%) 0 (0%) 0 (0%) 0 (0%) 6m7s
kube-system kube-controller-manager-addons-726754 200m (10%) 0 (0%) 0 (0%) 0 (0%) 6m7s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system kube-proxy-bb76v 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m3s
kube-system kube-scheduler-addons-726754 100m (5%) 0 (0%) 0 (0%) 0 (0%) 6m7s
kube-system metrics-server-8988944d9-9zq2h 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 5m56s
kube-system nvidia-device-plugin-daemonset-j96qf 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
kube-system registry-6fb4cdfc84-97j86 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
kube-system registry-proxy-dk9mv 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
kube-system snapshot-controller-56fcc65765-bth5s 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m55s
kube-system snapshot-controller-56fcc65765-c6mmv 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m55s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
local-path-storage local-path-provisioner-86d989889c-q9mbm 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
volcano-system volcano-admission-77d7d48b68-wjb2c 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
volcano-system volcano-controllers-56675bb4d5-qq9rb 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
volcano-system volcano-scheduler-576bc46687-dnf49 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
yakd-dashboard yakd-dashboard-67d98fc6b-x8759 0 (0%) 0 (0%) 128Mi (1%) 256Mi (3%) 5m56s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%) 100m (5%)
memory 638Mi (8%) 476Mi (6%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m1s kube-proxy
Normal Starting 6m7s kubelet Starting kubelet.
Warning CgroupV1 6m7s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 6m7s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m7s kubelet Node addons-726754 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m7s kubelet Node addons-726754 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m7s kubelet Node addons-726754 status is now: NodeHasSufficientPID
Normal RegisteredNode 6m3s node-controller Node addons-726754 event: Registered Node addons-726754 in Controller
==> dmesg <==
==> etcd [754d83488f9d8eea906dd6d6db28d52b7a72366086cf5bc1512c25056623e83b] <==
{"level":"info","ts":"2024-08-27T23:02:37.701053Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-08-27T23:02:37.701210Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-08-27T23:02:37.701222Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-08-27T23:02:37.702485Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc switched to configuration voters=(12593026477526642892)"}
{"level":"info","ts":"2024-08-27T23:02:37.702584Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}
{"level":"info","ts":"2024-08-27T23:02:38.072419Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-08-27T23:02:38.072581Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-08-27T23:02:38.072625Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-08-27T23:02:38.072678Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-08-27T23:02:38.072715Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-08-27T23:02:38.072760Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-08-27T23:02:38.072799Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-08-27T23:02:38.076514Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-27T23:02:38.083179Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-726754 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-08-27T23:02:38.083461Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-08-27T23:02:38.083867Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-08-27T23:02:38.084054Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-08-27T23:02:38.084110Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-08-27T23:02:38.084911Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-08-27T23:02:38.086095Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-08-27T23:02:38.093039Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-08-27T23:02:38.083422Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-27T23:02:38.094432Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-27T23:02:38.094497Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-08-27T23:02:38.094185Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
==> gcp-auth [7090acf9a6e581a116b8be006d6a33d743be69d2e9118084e44b222754178ad1] <==
2024/08/27 23:05:31 GCP Auth Webhook started!
2024/08/27 23:05:49 Ready to marshal response ...
2024/08/27 23:05:49 Ready to write response ...
2024/08/27 23:05:50 Ready to marshal response ...
2024/08/27 23:05:50 Ready to write response ...
==> kernel <==
23:08:51 up 6:51, 0 users, load average: 0.21, 1.19, 2.10
Linux addons-726754 5.15.0-1068-aws #74~20.04.1-Ubuntu SMP Tue Aug 6 19:45:17 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [3699aee6cec94099b7291a755721d7302609da740d9295062f291959b757b448] <==
I0827 23:06:42.232535 1 main.go:299] handling current node
I0827 23:06:52.229547 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0827 23:06:52.229587 1 main.go:299] handling current node
I0827 23:07:02.236456 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0827 23:07:02.236493 1 main.go:299] handling current node
I0827 23:07:12.237514 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0827 23:07:12.237553 1 main.go:299] handling current node
I0827 23:07:22.229911 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0827 23:07:22.229948 1 main.go:299] handling current node
I0827 23:07:32.236942 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0827 23:07:32.236980 1 main.go:299] handling current node
I0827 23:07:42.229197 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0827 23:07:42.229326 1 main.go:299] handling current node
I0827 23:07:52.229580 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0827 23:07:52.229615 1 main.go:299] handling current node
I0827 23:08:02.231101 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0827 23:08:02.231217 1 main.go:299] handling current node
I0827 23:08:12.236957 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0827 23:08:12.237059 1 main.go:299] handling current node
I0827 23:08:22.235256 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0827 23:08:22.235295 1 main.go:299] handling current node
I0827 23:08:32.232535 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0827 23:08:32.232575 1 main.go:299] handling current node
I0827 23:08:42.238350 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0827 23:08:42.238612 1 main.go:299] handling current node
==> kube-apiserver [b928a40e5a95190ab4a0948363e67efb4961eff123db36de44b5ef95e76d880e] <==
W0827 23:03:58.988130 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.3.221:443: connect: connection refused
W0827 23:04:00.030516 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.3.221:443: connect: connection refused
W0827 23:04:01.062422 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.3.221:443: connect: connection refused
W0827 23:04:02.163325 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.3.221:443: connect: connection refused
W0827 23:04:03.247308 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.3.221:443: connect: connection refused
W0827 23:04:04.289160 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.3.221:443: connect: connection refused
W0827 23:04:04.847025 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.221.70:443: connect: connection refused
E0827 23:04:04.847071 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.101.221.70:443: connect: connection refused" logger="UnhandledError"
W0827 23:04:04.848770 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.110.3.221:443: connect: connection refused
W0827 23:04:04.890787 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.221.70:443: connect: connection refused
E0827 23:04:04.890825 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.101.221.70:443: connect: connection refused" logger="UnhandledError"
W0827 23:04:04.892586 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.110.3.221:443: connect: connection refused
W0827 23:04:05.373592 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.3.221:443: connect: connection refused
W0827 23:04:06.388483 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.3.221:443: connect: connection refused
W0827 23:04:07.490971 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.3.221:443: connect: connection refused
W0827 23:04:08.497890 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.3.221:443: connect: connection refused
W0827 23:04:09.577851 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.110.3.221:443: connect: connection refused
W0827 23:04:24.847468 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.221.70:443: connect: connection refused
E0827 23:04:24.847506 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.101.221.70:443: connect: connection refused" logger="UnhandledError"
W0827 23:05:04.857816 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.221.70:443: connect: connection refused
E0827 23:05:04.857862 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.101.221.70:443: connect: connection refused" logger="UnhandledError"
W0827 23:05:04.898356 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.221.70:443: connect: connection refused
E0827 23:05:04.898401 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.101.221.70:443: connect: connection refused" logger="UnhandledError"
I0827 23:05:49.286682 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I0827 23:05:49.321386 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
==> kube-controller-manager [46a124943f4b68360eccc4177e58478bd96c240b4209286dfaabda69572d7e3d] <==
I0827 23:05:04.885427 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0827 23:05:04.885845 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0827 23:05:04.900611 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0827 23:05:04.911636 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0827 23:05:04.924763 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0827 23:05:04.925110 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0827 23:05:04.937149 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0827 23:05:05.947709 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0827 23:05:05.960854 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0827 23:05:07.074786 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0827 23:05:07.101043 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0827 23:05:08.081128 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0827 23:05:08.088234 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0827 23:05:08.095730 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0827 23:05:08.106180 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0827 23:05:08.114518 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0827 23:05:08.121100 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0827 23:05:32.058992 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="11.924946ms"
I0827 23:05:32.059687 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="55.334µs"
I0827 23:05:38.039233 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0827 23:05:38.044333 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0827 23:05:38.108264 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0827 23:05:38.111752 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0827 23:05:48.972098 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="0s"
I0827 23:05:49.026601 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-726754"
==> kube-proxy [ea7a6397986cb2310506cf278ff43d5b790abdbd0ecf1ce7957a147c98e4af3a] <==
I0827 23:02:50.107877 1 server_linux.go:66] "Using iptables proxy"
I0827 23:02:50.190135 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0827 23:02:50.190220 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0827 23:02:50.300613 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0827 23:02:50.310662 1 server_linux.go:169] "Using iptables Proxier"
I0827 23:02:50.354286 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0827 23:02:50.354790 1 server.go:483] "Version info" version="v1.31.0"
I0827 23:02:50.354816 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0827 23:02:50.397604 1 config.go:197] "Starting service config controller"
I0827 23:02:50.397642 1 shared_informer.go:313] Waiting for caches to sync for service config
I0827 23:02:50.397664 1 config.go:104] "Starting endpoint slice config controller"
I0827 23:02:50.397669 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0827 23:02:50.398259 1 config.go:326] "Starting node config controller"
I0827 23:02:50.398267 1 shared_informer.go:313] Waiting for caches to sync for node config
I0827 23:02:50.497792 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0827 23:02:50.497835 1 shared_informer.go:320] Caches are synced for service config
I0827 23:02:50.498362 1 shared_informer.go:320] Caches are synced for node config
==> kube-scheduler [cbbae936eec1c949ad78c48f9f897ea86e11992d4511b1701c6abd70506230a7] <==
W0827 23:02:42.246138 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0827 23:02:42.246179 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0827 23:02:42.246464 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0827 23:02:42.246616 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0827 23:02:42.246807 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0827 23:02:42.246909 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0827 23:02:42.247610 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0827 23:02:42.248203 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0827 23:02:42.248232 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0827 23:02:42.248581 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
W0827 23:02:42.247809 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0827 23:02:42.248773 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0827 23:02:42.247969 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0827 23:02:42.248938 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0827 23:02:42.248053 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0827 23:02:42.249040 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0827 23:02:42.248090 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0827 23:02:42.249134 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0827 23:02:42.248144 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0827 23:02:42.249229 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0827 23:02:42.248153 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0827 23:02:42.249323 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0827 23:02:42.248164 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0827 23:02:42.249415 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
I0827 23:02:43.331701 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Aug 27 23:06:51 addons-726754 kubelet[1508]: E0827 23:06:51.063329 1508 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9kcp_gadget(7f17c02a-303b-4b68-bc92-c8cd0ea2c17d)\"" pod="gadget/gadget-b9kcp" podUID="7f17c02a-303b-4b68-bc92-c8cd0ea2c17d"
Aug 27 23:06:56 addons-726754 kubelet[1508]: I0827 23:06:56.063585 1508 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-j96qf" secret="" err="secret \"gcp-auth\" not found"
Aug 27 23:07:05 addons-726754 kubelet[1508]: I0827 23:07:05.062575 1508 scope.go:117] "RemoveContainer" containerID="5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b"
Aug 27 23:07:05 addons-726754 kubelet[1508]: E0827 23:07:05.062820 1508 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9kcp_gadget(7f17c02a-303b-4b68-bc92-c8cd0ea2c17d)\"" pod="gadget/gadget-b9kcp" podUID="7f17c02a-303b-4b68-bc92-c8cd0ea2c17d"
Aug 27 23:07:18 addons-726754 kubelet[1508]: I0827 23:07:18.062369 1508 scope.go:117] "RemoveContainer" containerID="5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b"
Aug 27 23:07:18 addons-726754 kubelet[1508]: E0827 23:07:18.062657 1508 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9kcp_gadget(7f17c02a-303b-4b68-bc92-c8cd0ea2c17d)\"" pod="gadget/gadget-b9kcp" podUID="7f17c02a-303b-4b68-bc92-c8cd0ea2c17d"
Aug 27 23:07:21 addons-726754 kubelet[1508]: I0827 23:07:21.062856 1508 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-dk9mv" secret="" err="secret \"gcp-auth\" not found"
Aug 27 23:07:23 addons-726754 kubelet[1508]: I0827 23:07:23.062695 1508 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-6fb4cdfc84-97j86" secret="" err="secret \"gcp-auth\" not found"
Aug 27 23:07:31 addons-726754 kubelet[1508]: I0827 23:07:31.062759 1508 scope.go:117] "RemoveContainer" containerID="5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b"
Aug 27 23:07:31 addons-726754 kubelet[1508]: E0827 23:07:31.062991 1508 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9kcp_gadget(7f17c02a-303b-4b68-bc92-c8cd0ea2c17d)\"" pod="gadget/gadget-b9kcp" podUID="7f17c02a-303b-4b68-bc92-c8cd0ea2c17d"
Aug 27 23:07:44 addons-726754 kubelet[1508]: I0827 23:07:44.063404 1508 scope.go:117] "RemoveContainer" containerID="5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b"
Aug 27 23:07:44 addons-726754 kubelet[1508]: E0827 23:07:44.063695 1508 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9kcp_gadget(7f17c02a-303b-4b68-bc92-c8cd0ea2c17d)\"" pod="gadget/gadget-b9kcp" podUID="7f17c02a-303b-4b68-bc92-c8cd0ea2c17d"
Aug 27 23:07:55 addons-726754 kubelet[1508]: I0827 23:07:55.062919 1508 scope.go:117] "RemoveContainer" containerID="5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b"
Aug 27 23:07:55 addons-726754 kubelet[1508]: E0827 23:07:55.063350 1508 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9kcp_gadget(7f17c02a-303b-4b68-bc92-c8cd0ea2c17d)\"" pod="gadget/gadget-b9kcp" podUID="7f17c02a-303b-4b68-bc92-c8cd0ea2c17d"
Aug 27 23:08:10 addons-726754 kubelet[1508]: I0827 23:08:10.063483 1508 scope.go:117] "RemoveContainer" containerID="5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b"
Aug 27 23:08:10 addons-726754 kubelet[1508]: E0827 23:08:10.063674 1508 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9kcp_gadget(7f17c02a-303b-4b68-bc92-c8cd0ea2c17d)\"" pod="gadget/gadget-b9kcp" podUID="7f17c02a-303b-4b68-bc92-c8cd0ea2c17d"
Aug 27 23:08:21 addons-726754 kubelet[1508]: I0827 23:08:21.062777 1508 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-j96qf" secret="" err="secret \"gcp-auth\" not found"
Aug 27 23:08:25 addons-726754 kubelet[1508]: I0827 23:08:25.062667 1508 scope.go:117] "RemoveContainer" containerID="5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b"
Aug 27 23:08:25 addons-726754 kubelet[1508]: E0827 23:08:25.062916 1508 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9kcp_gadget(7f17c02a-303b-4b68-bc92-c8cd0ea2c17d)\"" pod="gadget/gadget-b9kcp" podUID="7f17c02a-303b-4b68-bc92-c8cd0ea2c17d"
Aug 27 23:08:38 addons-726754 kubelet[1508]: I0827 23:08:38.062605 1508 scope.go:117] "RemoveContainer" containerID="5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b"
Aug 27 23:08:38 addons-726754 kubelet[1508]: E0827 23:08:38.064254 1508 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9kcp_gadget(7f17c02a-303b-4b68-bc92-c8cd0ea2c17d)\"" pod="gadget/gadget-b9kcp" podUID="7f17c02a-303b-4b68-bc92-c8cd0ea2c17d"
Aug 27 23:08:39 addons-726754 kubelet[1508]: I0827 23:08:39.063094 1508 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-6fb4cdfc84-97j86" secret="" err="secret \"gcp-auth\" not found"
Aug 27 23:08:49 addons-726754 kubelet[1508]: I0827 23:08:49.062391 1508 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-dk9mv" secret="" err="secret \"gcp-auth\" not found"
Aug 27 23:08:50 addons-726754 kubelet[1508]: I0827 23:08:50.068665 1508 scope.go:117] "RemoveContainer" containerID="5ee82f965620c61c98c7d0540da34c12e654ca9c2fc4d679140eea2f91c3332b"
Aug 27 23:08:50 addons-726754 kubelet[1508]: E0827 23:08:50.070781 1508 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-b9kcp_gadget(7f17c02a-303b-4b68-bc92-c8cd0ea2c17d)\"" pod="gadget/gadget-b9kcp" podUID="7f17c02a-303b-4b68-bc92-c8cd0ea2c17d"
==> storage-provisioner [2567772b4d1b2196e16828165eb846cbb51e49dce794114ff65157d08b7778a6] <==
I0827 23:02:55.058965 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0827 23:02:55.085252 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0827 23:02:55.085383 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0827 23:02:55.108495 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0827 23:02:55.108708 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-726754_e1b3fc11-bc7d-42db-a5c5-f633d8ce05ae!
I0827 23:02:55.109850 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"68bbf3a4-e11c-4df6-887c-9fe2170d53da", APIVersion:"v1", ResourceVersion:"536", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-726754_e1b3fc11-bc7d-42db-a5c5-f633d8ce05ae became leader
I0827 23:02:55.210993 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-726754_e1b3fc11-bc7d-42db-a5c5-f633d8ce05ae!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-726754 -n addons-726754
helpers_test.go:261: (dbg) Run: kubectl --context addons-726754 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-xwvsx ingress-nginx-admission-patch-jj44v test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-726754 describe pod ingress-nginx-admission-create-xwvsx ingress-nginx-admission-patch-jj44v test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-726754 describe pod ingress-nginx-admission-create-xwvsx ingress-nginx-admission-patch-jj44v test-job-nginx-0: exit status 1 (85.761554ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-xwvsx" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-jj44v" not found
Error from server (NotFound): pods "test-job-nginx-0" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-726754 describe pod ingress-nginx-admission-create-xwvsx ingress-nginx-admission-patch-jj44v test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (200.13s)