=== RUN TestAddons/serial/Volcano
addons_test.go:913: volcano-controller stabilized in 62.729939ms
addons_test.go:905: volcano-admission stabilized in 62.818397ms
addons_test.go:897: volcano-scheduler stabilized in 62.869801ms
addons_test.go:919: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-576bc46687-knjtl" [ec47b71a-f178-4369-9d3d-0477736c6c43] Running
addons_test.go:919: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 5.013270644s
addons_test.go:923: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-77d7d48b68-44hlz" [2d3134cb-2fa1-4461-9fdf-0780930f0c06] Running
addons_test.go:923: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 6.003586155s
addons_test.go:927: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-56675bb4d5-jx4lp" [f9c0ec21-5c53-48c2-a1e7-a8ff761837bf] Running
addons_test.go:927: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.003633388s
addons_test.go:932: (dbg) Run: kubectl --context addons-686490 delete -n volcano-system job volcano-admission-init
addons_test.go:938: (dbg) Run: kubectl --context addons-686490 create -f testdata/vcjob.yaml
addons_test.go:946: (dbg) Run: kubectl --context addons-686490 get vcjob -n my-volcano
addons_test.go:964: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [4fe03932-d62f-4a75-a1d2-fdf4333cfbab] Pending
helpers_test.go:344: "test-job-nginx-0" [4fe03932-d62f-4a75-a1d2-fdf4333cfbab] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:964: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:964: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-686490 -n addons-686490
addons_test.go:964: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-09-15 06:42:49.952051234 +0000 UTC m=+434.273733453
addons_test.go:964: (dbg) Run: kubectl --context addons-686490 describe po test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-686490 describe po test-job-nginx-0 -n my-volcano:
Name: test-job-nginx-0
Namespace: my-volcano
Priority: 0
Service Account: default
Node: <none>
Labels: volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations: scheduling.k8s.io/group-name: test-job-c28da52d-5e88-4555-8398-cc4e2072c672
volcano.sh/job-name: test-job
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status: Pending
IP:
IPs: <none>
Controlled By: Job/test-job
Containers:
nginx:
Image: nginx:latest
Port: <none>
Host Port: <none>
Command:
sleep
10m
Limits:
cpu: 1
Requests:
cpu: 1
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-c4m9l (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-c4m9l:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 2m59s volcano 0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:964: (dbg) Run: kubectl --context addons-686490 logs test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-686490 logs test-job-nginx-0 -n my-volcano:
addons_test.go:965: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-686490
helpers_test.go:235: (dbg) docker inspect addons-686490:
-- stdout --
[
{
"Id": "1f9a5ff454a0a2e7b9aff6d320e640af5427dab59c396a5396036077828d08cb",
"Created": "2024-09-15T06:36:19.109593731Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 3199906,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-15T06:36:19.276322376Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:a1b71fa87733590eb4674b16f6945626ae533f3af37066893e3fd70eb9476268",
"ResolvConfPath": "/var/lib/docker/containers/1f9a5ff454a0a2e7b9aff6d320e640af5427dab59c396a5396036077828d08cb/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/1f9a5ff454a0a2e7b9aff6d320e640af5427dab59c396a5396036077828d08cb/hostname",
"HostsPath": "/var/lib/docker/containers/1f9a5ff454a0a2e7b9aff6d320e640af5427dab59c396a5396036077828d08cb/hosts",
"LogPath": "/var/lib/docker/containers/1f9a5ff454a0a2e7b9aff6d320e640af5427dab59c396a5396036077828d08cb/1f9a5ff454a0a2e7b9aff6d320e640af5427dab59c396a5396036077828d08cb-json.log",
"Name": "/addons-686490",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-686490:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-686490",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/239b2e9109a9b7aff528d2eb808cfdbe58534dcecceb763bff9aa1805b2c0e9a-init/diff:/var/lib/docker/overlay2/31eb295c1996517842adc8af440314d53294837c66bc19c5926f12a15defbe5c/diff",
"MergedDir": "/var/lib/docker/overlay2/239b2e9109a9b7aff528d2eb808cfdbe58534dcecceb763bff9aa1805b2c0e9a/merged",
"UpperDir": "/var/lib/docker/overlay2/239b2e9109a9b7aff528d2eb808cfdbe58534dcecceb763bff9aa1805b2c0e9a/diff",
"WorkDir": "/var/lib/docker/overlay2/239b2e9109a9b7aff528d2eb808cfdbe58534dcecceb763bff9aa1805b2c0e9a/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-686490",
"Source": "/var/lib/docker/volumes/addons-686490/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-686490",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726358845-19644@sha256:4c67a32a16c2d4f824f00267c172fd225757ca75441e363d925dc9583137f0b0",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-686490",
"name.minikube.sigs.k8s.io": "addons-686490",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "69d7677abbff9eda5c41ad738f95ffe1cd25772931f29309088b19dc6bfb525b",
"SandboxKey": "/var/run/docker/netns/69d7677abbff",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "35877"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "35878"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "35881"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "35879"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "35880"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-686490": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "44dcf73096248b90f025ee503af4f9fa367d8a59cef3aede0620f58fed5d1b32",
"EndpointID": "a74c9b68cce2d49e63924ece89a93d60a37e5607ac57ccbae699595dbb305f5a",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-686490",
"1f9a5ff454a0"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-686490 -n addons-686490
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-686490 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-686490 logs -n 25: (1.62523734s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-808336 | jenkins | v1.34.0 | 15 Sep 24 06:35 UTC | |
| | -p download-only-808336 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 15 Sep 24 06:35 UTC | 15 Sep 24 06:35 UTC |
| delete | -p download-only-808336 | download-only-808336 | jenkins | v1.34.0 | 15 Sep 24 06:35 UTC | 15 Sep 24 06:35 UTC |
| start | -o=json --download-only | download-only-841381 | jenkins | v1.34.0 | 15 Sep 24 06:35 UTC | |
| | -p download-only-841381 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 15 Sep 24 06:35 UTC | 15 Sep 24 06:35 UTC |
| delete | -p download-only-841381 | download-only-841381 | jenkins | v1.34.0 | 15 Sep 24 06:35 UTC | 15 Sep 24 06:35 UTC |
| delete | -p download-only-808336 | download-only-808336 | jenkins | v1.34.0 | 15 Sep 24 06:35 UTC | 15 Sep 24 06:35 UTC |
| delete | -p download-only-841381 | download-only-841381 | jenkins | v1.34.0 | 15 Sep 24 06:35 UTC | 15 Sep 24 06:35 UTC |
| start | --download-only -p | download-docker-343356 | jenkins | v1.34.0 | 15 Sep 24 06:35 UTC | |
| | download-docker-343356 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-343356 | download-docker-343356 | jenkins | v1.34.0 | 15 Sep 24 06:35 UTC | 15 Sep 24 06:35 UTC |
| start | --download-only -p | binary-mirror-625101 | jenkins | v1.34.0 | 15 Sep 24 06:35 UTC | |
| | binary-mirror-625101 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:36845 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-625101 | binary-mirror-625101 | jenkins | v1.34.0 | 15 Sep 24 06:35 UTC | 15 Sep 24 06:35 UTC |
| addons | disable dashboard -p | addons-686490 | jenkins | v1.34.0 | 15 Sep 24 06:35 UTC | |
| | addons-686490 | | | | | |
| addons | enable dashboard -p | addons-686490 | jenkins | v1.34.0 | 15 Sep 24 06:35 UTC | |
| | addons-686490 | | | | | |
| start | -p addons-686490 --wait=true | addons-686490 | jenkins | v1.34.0 | 15 Sep 24 06:35 UTC | 15 Sep 24 06:39 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/15 06:35:55
Running on machine: ip-172-31-29-130
Binary: Built with gc go1.23.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0915 06:35:55.162943 3199412 out.go:345] Setting OutFile to fd 1 ...
I0915 06:35:55.163090 3199412 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0915 06:35:55.163101 3199412 out.go:358] Setting ErrFile to fd 2...
I0915 06:35:55.163106 3199412 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0915 06:35:55.163394 3199412 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19644-3193270/.minikube/bin
I0915 06:35:55.163917 3199412 out.go:352] Setting JSON to false
I0915 06:35:55.164838 3199412 start.go:129] hostinfo: {"hostname":"ip-172-31-29-130","uptime":51507,"bootTime":1726330649,"procs":194,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1069-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"36adf542-ef4f-4e2d-a0c8-6868d1383ff9"}
I0915 06:35:55.164923 3199412 start.go:139] virtualization:
I0915 06:35:55.168268 3199412 out.go:177] * [addons-686490] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0915 06:35:55.171860 3199412 out.go:177] - MINIKUBE_LOCATION=19644
I0915 06:35:55.171970 3199412 notify.go:220] Checking for updates...
I0915 06:35:55.177538 3199412 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0915 06:35:55.180256 3199412 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19644-3193270/kubeconfig
I0915 06:35:55.182813 3199412 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19644-3193270/.minikube
I0915 06:35:55.185375 3199412 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0915 06:35:55.188067 3199412 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0915 06:35:55.190934 3199412 driver.go:394] Setting default libvirt URI to qemu:///system
I0915 06:35:55.210946 3199412 docker.go:123] docker version: linux-27.2.1:Docker Engine - Community
I0915 06:35:55.211123 3199412 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0915 06:35:55.276210 3199412 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-15 06:35:55.266646843 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1069-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214839296 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.2.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0915 06:35:55.276319 3199412 docker.go:318] overlay module found
I0915 06:35:55.279275 3199412 out.go:177] * Using the docker driver based on user configuration
I0915 06:35:55.281904 3199412 start.go:297] selected driver: docker
I0915 06:35:55.281929 3199412 start.go:901] validating driver "docker" against <nil>
I0915 06:35:55.281942 3199412 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0915 06:35:55.282599 3199412 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0915 06:35:55.336016 3199412 info.go:266] docker info: {ID:U5VK:ZNT5:35M3:FHLW:Q7TL:ELFX:BNAG:AV4T:UD2H:SK5L:SEJV:SJJL Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-15 06:35:55.324254119 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1069-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214839296 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-29-130 Labels:[] ExperimentalBuild:false ServerVersion:27.2.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0915 06:35:55.336241 3199412 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0915 06:35:55.336474 3199412 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0915 06:35:55.339131 3199412 out.go:177] * Using Docker driver with root privileges
I0915 06:35:55.341749 3199412 cni.go:84] Creating CNI manager for ""
I0915 06:35:55.341822 3199412 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0915 06:35:55.341835 3199412 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0915 06:35:55.341918 3199412 start.go:340] cluster config:
{Name:addons-686490 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726358845-19644@sha256:4c67a32a16c2d4f824f00267c172fd225757ca75441e363d925dc9583137f0b0 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-686490 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0915 06:35:55.344898 3199412 out.go:177] * Starting "addons-686490" primary control-plane node in "addons-686490" cluster
I0915 06:35:55.347476 3199412 cache.go:121] Beginning downloading kic base image for docker with containerd
I0915 06:35:55.350132 3199412 out.go:177] * Pulling base image v0.0.45-1726358845-19644 ...
I0915 06:35:55.352791 3199412 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0915 06:35:55.352853 3199412 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19644-3193270/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4
I0915 06:35:55.352867 3199412 cache.go:56] Caching tarball of preloaded images
I0915 06:35:55.352870 3199412 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726358845-19644@sha256:4c67a32a16c2d4f824f00267c172fd225757ca75441e363d925dc9583137f0b0 in local docker daemon
I0915 06:35:55.352948 3199412 preload.go:172] Found /home/jenkins/minikube-integration/19644-3193270/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0915 06:35:55.352959 3199412 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on containerd
I0915 06:35:55.353323 3199412 profile.go:143] Saving config to /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/config.json ...
I0915 06:35:55.353354 3199412 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/config.json: {Name:mk462ad3fc7677a63e6504c2fa2566fa05d70167 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0915 06:35:55.367746 3199412 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726358845-19644@sha256:4c67a32a16c2d4f824f00267c172fd225757ca75441e363d925dc9583137f0b0 to local cache
I0915 06:35:55.367874 3199412 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726358845-19644@sha256:4c67a32a16c2d4f824f00267c172fd225757ca75441e363d925dc9583137f0b0 in local cache directory
I0915 06:35:55.367895 3199412 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726358845-19644@sha256:4c67a32a16c2d4f824f00267c172fd225757ca75441e363d925dc9583137f0b0 in local cache directory, skipping pull
I0915 06:35:55.367900 3199412 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726358845-19644@sha256:4c67a32a16c2d4f824f00267c172fd225757ca75441e363d925dc9583137f0b0 exists in cache, skipping pull
I0915 06:35:55.367908 3199412 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726358845-19644@sha256:4c67a32a16c2d4f824f00267c172fd225757ca75441e363d925dc9583137f0b0 as a tarball
I0915 06:35:55.367913 3199412 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726358845-19644@sha256:4c67a32a16c2d4f824f00267c172fd225757ca75441e363d925dc9583137f0b0 from local cache
I0915 06:36:12.641988 3199412 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726358845-19644@sha256:4c67a32a16c2d4f824f00267c172fd225757ca75441e363d925dc9583137f0b0 from cached tarball
I0915 06:36:12.642025 3199412 cache.go:194] Successfully downloaded all kic artifacts
I0915 06:36:12.642055 3199412 start.go:360] acquireMachinesLock for addons-686490: {Name:mk95927a99e0bbbb21f63ca024d75271d0b9453c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0915 06:36:12.642190 3199412 start.go:364] duration metric: took 107.953µs to acquireMachinesLock for "addons-686490"
I0915 06:36:12.642220 3199412 start.go:93] Provisioning new machine with config: &{Name:addons-686490 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726358845-19644@sha256:4c67a32a16c2d4f824f00267c172fd225757ca75441e363d925dc9583137f0b0 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-686490 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0915 06:36:12.642312 3199412 start.go:125] createHost starting for "" (driver="docker")
I0915 06:36:12.645457 3199412 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0915 06:36:12.645694 3199412 start.go:159] libmachine.API.Create for "addons-686490" (driver="docker")
I0915 06:36:12.645729 3199412 client.go:168] LocalClient.Create starting
I0915 06:36:12.645848 3199412 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19644-3193270/.minikube/certs/ca.pem
I0915 06:36:12.993891 3199412 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19644-3193270/.minikube/certs/cert.pem
I0915 06:36:13.363259 3199412 cli_runner.go:164] Run: docker network inspect addons-686490 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0915 06:36:13.379971 3199412 cli_runner.go:211] docker network inspect addons-686490 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0915 06:36:13.380082 3199412 network_create.go:284] running [docker network inspect addons-686490] to gather additional debugging logs...
I0915 06:36:13.380107 3199412 cli_runner.go:164] Run: docker network inspect addons-686490
W0915 06:36:13.395357 3199412 cli_runner.go:211] docker network inspect addons-686490 returned with exit code 1
I0915 06:36:13.395391 3199412 network_create.go:287] error running [docker network inspect addons-686490]: docker network inspect addons-686490: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-686490 not found
I0915 06:36:13.395405 3199412 network_create.go:289] output of [docker network inspect addons-686490]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-686490 not found
** /stderr **
I0915 06:36:13.395507 3199412 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0915 06:36:13.411093 3199412 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001c05be0}
I0915 06:36:13.411134 3199412 network_create.go:124] attempt to create docker network addons-686490 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0915 06:36:13.411189 3199412 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-686490 addons-686490
I0915 06:36:13.483066 3199412 network_create.go:108] docker network addons-686490 192.168.49.0/24 created
I0915 06:36:13.483102 3199412 kic.go:121] calculated static IP "192.168.49.2" for the "addons-686490" container
I0915 06:36:13.483189 3199412 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0915 06:36:13.499412 3199412 cli_runner.go:164] Run: docker volume create addons-686490 --label name.minikube.sigs.k8s.io=addons-686490 --label created_by.minikube.sigs.k8s.io=true
I0915 06:36:13.515791 3199412 oci.go:103] Successfully created a docker volume addons-686490
I0915 06:36:13.515897 3199412 cli_runner.go:164] Run: docker run --rm --name addons-686490-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-686490 --entrypoint /usr/bin/test -v addons-686490:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726358845-19644@sha256:4c67a32a16c2d4f824f00267c172fd225757ca75441e363d925dc9583137f0b0 -d /var/lib
I0915 06:36:15.018875 3199412 cli_runner.go:217] Completed: docker run --rm --name addons-686490-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-686490 --entrypoint /usr/bin/test -v addons-686490:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726358845-19644@sha256:4c67a32a16c2d4f824f00267c172fd225757ca75441e363d925dc9583137f0b0 -d /var/lib: (1.50293235s)
I0915 06:36:15.018917 3199412 oci.go:107] Successfully prepared a docker volume addons-686490
I0915 06:36:15.018958 3199412 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0915 06:36:15.018986 3199412 kic.go:194] Starting extracting preloaded images to volume ...
I0915 06:36:15.019123 3199412 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19644-3193270/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-686490:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726358845-19644@sha256:4c67a32a16c2d4f824f00267c172fd225757ca75441e363d925dc9583137f0b0 -I lz4 -xf /preloaded.tar -C /extractDir
I0915 06:36:19.037611 3199412 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19644-3193270/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-686490:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726358845-19644@sha256:4c67a32a16c2d4f824f00267c172fd225757ca75441e363d925dc9583137f0b0 -I lz4 -xf /preloaded.tar -C /extractDir: (4.018436823s)
I0915 06:36:19.037644 3199412 kic.go:203] duration metric: took 4.018655313s to extract preloaded images to volume ...
W0915 06:36:19.037791 3199412 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0915 06:36:19.037907 3199412 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0915 06:36:19.093311 3199412 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-686490 --name addons-686490 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-686490 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-686490 --network addons-686490 --ip 192.168.49.2 --volume addons-686490:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726358845-19644@sha256:4c67a32a16c2d4f824f00267c172fd225757ca75441e363d925dc9583137f0b0
I0915 06:36:19.454017 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Running}}
I0915 06:36:19.482503 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:19.505659 3199412 cli_runner.go:164] Run: docker exec addons-686490 stat /var/lib/dpkg/alternatives/iptables
I0915 06:36:19.574722 3199412 oci.go:144] the created container "addons-686490" has a running status.
I0915 06:36:19.574755 3199412 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa...
I0915 06:36:19.889289 3199412 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0915 06:36:19.924850 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:19.947275 3199412 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0915 06:36:19.947295 3199412 kic_runner.go:114] Args: [docker exec --privileged addons-686490 chown docker:docker /home/docker/.ssh/authorized_keys]
I0915 06:36:20.046003 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:20.077172 3199412 machine.go:93] provisionDockerMachine start ...
I0915 06:36:20.077269 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:20.112397 3199412 main.go:141] libmachine: Using SSH client type: native
I0915 06:36:20.114699 3199412 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x41abe0] 0x41d420 <nil> [] 0s} 127.0.0.1 35877 <nil> <nil>}
I0915 06:36:20.114722 3199412 main.go:141] libmachine: About to run SSH command:
hostname
I0915 06:36:20.294457 3199412 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-686490
I0915 06:36:20.294533 3199412 ubuntu.go:169] provisioning hostname "addons-686490"
I0915 06:36:20.294633 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:20.319211 3199412 main.go:141] libmachine: Using SSH client type: native
I0915 06:36:20.319456 3199412 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x41abe0] 0x41d420 <nil> [] 0s} 127.0.0.1 35877 <nil> <nil>}
I0915 06:36:20.319475 3199412 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-686490 && echo "addons-686490" | sudo tee /etc/hostname
I0915 06:36:20.477357 3199412 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-686490
I0915 06:36:20.477480 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:20.497750 3199412 main.go:141] libmachine: Using SSH client type: native
I0915 06:36:20.498096 3199412 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x41abe0] 0x41d420 <nil> [] 0s} 127.0.0.1 35877 <nil> <nil>}
I0915 06:36:20.498141 3199412 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-686490' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-686490/g' /etc/hosts;
else
echo '127.0.1.1 addons-686490' | sudo tee -a /etc/hosts;
fi
fi
I0915 06:36:20.635060 3199412 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0915 06:36:20.635099 3199412 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19644-3193270/.minikube CaCertPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19644-3193270/.minikube}
I0915 06:36:20.635141 3199412 ubuntu.go:177] setting up certificates
I0915 06:36:20.635153 3199412 provision.go:84] configureAuth start
I0915 06:36:20.635218 3199412 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-686490
I0915 06:36:20.652033 3199412 provision.go:143] copyHostCerts
I0915 06:36:20.652120 3199412 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19644-3193270/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19644-3193270/.minikube/ca.pem (1078 bytes)
I0915 06:36:20.652245 3199412 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19644-3193270/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19644-3193270/.minikube/cert.pem (1123 bytes)
I0915 06:36:20.652335 3199412 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19644-3193270/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19644-3193270/.minikube/key.pem (1675 bytes)
I0915 06:36:20.652384 3199412 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19644-3193270/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19644-3193270/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19644-3193270/.minikube/certs/ca-key.pem org=jenkins.addons-686490 san=[127.0.0.1 192.168.49.2 addons-686490 localhost minikube]
I0915 06:36:21.250219 3199412 provision.go:177] copyRemoteCerts
I0915 06:36:21.250295 3199412 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0915 06:36:21.250337 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:21.266602 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:21.367995 3199412 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19644-3193270/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0915 06:36:21.392431 3199412 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19644-3193270/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0915 06:36:21.416774 3199412 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19644-3193270/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0915 06:36:21.440868 3199412 provision.go:87] duration metric: took 805.700034ms to configureAuth
I0915 06:36:21.440909 3199412 ubuntu.go:193] setting minikube options for container-runtime
I0915 06:36:21.441100 3199412 config.go:182] Loaded profile config "addons-686490": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0915 06:36:21.441108 3199412 machine.go:96] duration metric: took 1.363917653s to provisionDockerMachine
I0915 06:36:21.441115 3199412 client.go:171] duration metric: took 8.795375568s to LocalClient.Create
I0915 06:36:21.441129 3199412 start.go:167] duration metric: took 8.795435496s to libmachine.API.Create "addons-686490"
I0915 06:36:21.441137 3199412 start.go:293] postStartSetup for "addons-686490" (driver="docker")
I0915 06:36:21.441146 3199412 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0915 06:36:21.441195 3199412 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0915 06:36:21.441237 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:21.457953 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:21.556211 3199412 ssh_runner.go:195] Run: cat /etc/os-release
I0915 06:36:21.559313 3199412 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0915 06:36:21.559350 3199412 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0915 06:36:21.559363 3199412 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0915 06:36:21.559370 3199412 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0915 06:36:21.559381 3199412 filesync.go:126] Scanning /home/jenkins/minikube-integration/19644-3193270/.minikube/addons for local assets ...
I0915 06:36:21.559446 3199412 filesync.go:126] Scanning /home/jenkins/minikube-integration/19644-3193270/.minikube/files for local assets ...
I0915 06:36:21.559471 3199412 start.go:296] duration metric: took 118.327766ms for postStartSetup
I0915 06:36:21.559802 3199412 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-686490
I0915 06:36:21.575998 3199412 profile.go:143] Saving config to /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/config.json ...
I0915 06:36:21.576286 3199412 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0915 06:36:21.576354 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:21.592946 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:21.688272 3199412 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0915 06:36:21.693516 3199412 start.go:128] duration metric: took 9.051179059s to createHost
I0915 06:36:21.693550 3199412 start.go:83] releasing machines lock for "addons-686490", held for 9.051346753s
I0915 06:36:21.693637 3199412 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-686490
I0915 06:36:21.709974 3199412 ssh_runner.go:195] Run: cat /version.json
I0915 06:36:21.709994 3199412 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0915 06:36:21.710031 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:21.710069 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:21.727838 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:21.744589 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:21.954064 3199412 ssh_runner.go:195] Run: systemctl --version
I0915 06:36:21.958940 3199412 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0915 06:36:21.963797 3199412 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0915 06:36:21.989471 3199412 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0915 06:36:21.989564 3199412 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0915 06:36:22.023080 3199412 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0915 06:36:22.023106 3199412 start.go:495] detecting cgroup driver to use...
I0915 06:36:22.023140 3199412 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0915 06:36:22.023195 3199412 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0915 06:36:22.036681 3199412 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0915 06:36:22.048993 3199412 docker.go:217] disabling cri-docker service (if available) ...
I0915 06:36:22.049083 3199412 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0915 06:36:22.063922 3199412 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0915 06:36:22.079727 3199412 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0915 06:36:22.174958 3199412 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0915 06:36:22.269859 3199412 docker.go:233] disabling docker service ...
I0915 06:36:22.270009 3199412 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0915 06:36:22.291114 3199412 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0915 06:36:22.303757 3199412 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0915 06:36:22.396635 3199412 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0915 06:36:22.479542 3199412 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0915 06:36:22.490982 3199412 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0915 06:36:22.507503 3199412 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0915 06:36:22.517746 3199412 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0915 06:36:22.528525 3199412 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0915 06:36:22.528640 3199412 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0915 06:36:22.538737 3199412 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0915 06:36:22.548786 3199412 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0915 06:36:22.558578 3199412 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0915 06:36:22.568989 3199412 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0915 06:36:22.578565 3199412 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0915 06:36:22.588729 3199412 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0915 06:36:22.598969 3199412 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0915 06:36:22.609351 3199412 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0915 06:36:22.618468 3199412 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0915 06:36:22.627237 3199412 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0915 06:36:22.716291 3199412 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0915 06:36:22.850209 3199412 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0915 06:36:22.850322 3199412 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0915 06:36:22.853872 3199412 start.go:563] Will wait 60s for crictl version
I0915 06:36:22.853961 3199412 ssh_runner.go:195] Run: which crictl
I0915 06:36:22.857160 3199412 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0915 06:36:22.895250 3199412 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.22
RuntimeApiVersion: v1
I0915 06:36:22.895385 3199412 ssh_runner.go:195] Run: containerd --version
I0915 06:36:22.919008 3199412 ssh_runner.go:195] Run: containerd --version
I0915 06:36:22.944873 3199412 out.go:177] * Preparing Kubernetes v1.31.1 on containerd 1.7.22 ...
I0915 06:36:22.947646 3199412 cli_runner.go:164] Run: docker network inspect addons-686490 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0915 06:36:22.963496 3199412 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0915 06:36:22.967771 3199412 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0915 06:36:22.979038 3199412 kubeadm.go:883] updating cluster {Name:addons-686490 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726358845-19644@sha256:4c67a32a16c2d4f824f00267c172fd225757ca75441e363d925dc9583137f0b0 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-686490 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0915 06:36:22.979165 3199412 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0915 06:36:22.979232 3199412 ssh_runner.go:195] Run: sudo crictl images --output json
I0915 06:36:23.018819 3199412 containerd.go:627] all images are preloaded for containerd runtime.
I0915 06:36:23.018845 3199412 containerd.go:534] Images already preloaded, skipping extraction
I0915 06:36:23.018909 3199412 ssh_runner.go:195] Run: sudo crictl images --output json
I0915 06:36:23.055049 3199412 containerd.go:627] all images are preloaded for containerd runtime.
I0915 06:36:23.055084 3199412 cache_images.go:84] Images are preloaded, skipping loading
I0915 06:36:23.055093 3199412 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.1 containerd true true} ...
I0915 06:36:23.055204 3199412 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-686490 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:addons-686490 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0915 06:36:23.055282 3199412 ssh_runner.go:195] Run: sudo crictl info
I0915 06:36:23.094973 3199412 cni.go:84] Creating CNI manager for ""
I0915 06:36:23.095020 3199412 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0915 06:36:23.095030 3199412 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0915 06:36:23.095052 3199412 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-686490 NodeName:addons-686490 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0915 06:36:23.095222 3199412 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-686490"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0915 06:36:23.095299 3199412 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I0915 06:36:23.104320 3199412 binaries.go:44] Found k8s binaries, skipping transfer
I0915 06:36:23.104414 3199412 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0915 06:36:23.113622 3199412 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I0915 06:36:23.132559 3199412 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0915 06:36:23.151947 3199412 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
I0915 06:36:23.170803 3199412 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0915 06:36:23.174433 3199412 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0915 06:36:23.185683 3199412 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0915 06:36:23.263882 3199412 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0915 06:36:23.280263 3199412 certs.go:68] Setting up /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490 for IP: 192.168.49.2
I0915 06:36:23.280286 3199412 certs.go:194] generating shared ca certs ...
I0915 06:36:23.280303 3199412 certs.go:226] acquiring lock for ca certs: {Name:mkc5aa334004e490b788a5943d3511d48a9686f5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0915 06:36:23.280506 3199412 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19644-3193270/.minikube/ca.key
I0915 06:36:23.533448 3199412 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19644-3193270/.minikube/ca.crt ...
I0915 06:36:23.533484 3199412 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19644-3193270/.minikube/ca.crt: {Name:mk8c5bcc6d387c0995e66c465194ec38cc2fc78b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0915 06:36:23.533724 3199412 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19644-3193270/.minikube/ca.key ...
I0915 06:36:23.533742 3199412 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19644-3193270/.minikube/ca.key: {Name:mk617a533adc7a69653ceac554fef5dc5eb56612 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0915 06:36:23.533835 3199412 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19644-3193270/.minikube/proxy-client-ca.key
I0915 06:36:24.450602 3199412 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19644-3193270/.minikube/proxy-client-ca.crt ...
I0915 06:36:24.450639 3199412 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19644-3193270/.minikube/proxy-client-ca.crt: {Name:mk2d16284eb79286c5f48203ba6efd982120c687 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0915 06:36:24.450876 3199412 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19644-3193270/.minikube/proxy-client-ca.key ...
I0915 06:36:24.450892 3199412 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19644-3193270/.minikube/proxy-client-ca.key: {Name:mk9b91f8fa16c02ff52b7efb51b73f2191560022 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0915 06:36:24.450983 3199412 certs.go:256] generating profile certs ...
I0915 06:36:24.451060 3199412 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/client.key
I0915 06:36:24.451078 3199412 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/client.crt with IP's: []
I0915 06:36:24.878216 3199412 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/client.crt ...
I0915 06:36:24.878249 3199412 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/client.crt: {Name:mk71b5c4b888e333ab908b6953d9c7918d7a52de Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0915 06:36:24.878440 3199412 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/client.key ...
I0915 06:36:24.878453 3199412 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/client.key: {Name:mkb2ce20edb428a6c8bb4609eb5d91b648eec10f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0915 06:36:24.878544 3199412 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/apiserver.key.b8fa7149
I0915 06:36:24.878565 3199412 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/apiserver.crt.b8fa7149 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0915 06:36:25.124173 3199412 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/apiserver.crt.b8fa7149 ...
I0915 06:36:25.124204 3199412 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/apiserver.crt.b8fa7149: {Name:mked7f648f4b66bea6079a372c63718ac814df1b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0915 06:36:25.124392 3199412 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/apiserver.key.b8fa7149 ...
I0915 06:36:25.124406 3199412 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/apiserver.key.b8fa7149: {Name:mk565124f2e972667616f8192df071c2806a4366 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0915 06:36:25.124953 3199412 certs.go:381] copying /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/apiserver.crt.b8fa7149 -> /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/apiserver.crt
I0915 06:36:25.125059 3199412 certs.go:385] copying /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/apiserver.key.b8fa7149 -> /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/apiserver.key
I0915 06:36:25.125116 3199412 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/proxy-client.key
I0915 06:36:25.125136 3199412 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/proxy-client.crt with IP's: []
I0915 06:36:25.550898 3199412 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/proxy-client.crt ...
I0915 06:36:25.550931 3199412 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/proxy-client.crt: {Name:mkebea17640fe08d37ae06c791d282a8837e0135 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0915 06:36:25.551628 3199412 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/proxy-client.key ...
I0915 06:36:25.551651 3199412 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/proxy-client.key: {Name:mkfff90ab830b98413919696ccacda6e2c5ae6f5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0915 06:36:25.551859 3199412 certs.go:484] found cert: /home/jenkins/minikube-integration/19644-3193270/.minikube/certs/ca-key.pem (1675 bytes)
I0915 06:36:25.551906 3199412 certs.go:484] found cert: /home/jenkins/minikube-integration/19644-3193270/.minikube/certs/ca.pem (1078 bytes)
I0915 06:36:25.551935 3199412 certs.go:484] found cert: /home/jenkins/minikube-integration/19644-3193270/.minikube/certs/cert.pem (1123 bytes)
I0915 06:36:25.551961 3199412 certs.go:484] found cert: /home/jenkins/minikube-integration/19644-3193270/.minikube/certs/key.pem (1675 bytes)
I0915 06:36:25.552553 3199412 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19644-3193270/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0915 06:36:25.580790 3199412 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19644-3193270/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0915 06:36:25.607955 3199412 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19644-3193270/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0915 06:36:25.632000 3199412 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19644-3193270/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0915 06:36:25.656525 3199412 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0915 06:36:25.681173 3199412 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0915 06:36:25.706163 3199412 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0915 06:36:25.730450 3199412 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19644-3193270/.minikube/profiles/addons-686490/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0915 06:36:25.754931 3199412 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19644-3193270/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0915 06:36:25.779803 3199412 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0915 06:36:25.798501 3199412 ssh_runner.go:195] Run: openssl version
I0915 06:36:25.804394 3199412 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0915 06:36:25.814105 3199412 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0915 06:36:25.817903 3199412 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 15 06:36 /usr/share/ca-certificates/minikubeCA.pem
I0915 06:36:25.818009 3199412 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0915 06:36:25.825099 3199412 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0915 06:36:25.834381 3199412 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0915 06:36:25.837764 3199412 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0915 06:36:25.837813 3199412 kubeadm.go:392] StartCluster: {Name:addons-686490 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726358845-19644@sha256:4c67a32a16c2d4f824f00267c172fd225757ca75441e363d925dc9583137f0b0 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-686490 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0915 06:36:25.837894 3199412 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0915 06:36:25.837951 3199412 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0915 06:36:25.885007 3199412 cri.go:89] found id: ""
I0915 06:36:25.885124 3199412 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0915 06:36:25.894127 3199412 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0915 06:36:25.902986 3199412 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0915 06:36:25.903130 3199412 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0915 06:36:25.912456 3199412 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0915 06:36:25.912518 3199412 kubeadm.go:157] found existing configuration files:
I0915 06:36:25.912597 3199412 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0915 06:36:25.921423 3199412 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0915 06:36:25.921493 3199412 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0915 06:36:25.930165 3199412 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0915 06:36:25.939023 3199412 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0915 06:36:25.939122 3199412 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0915 06:36:25.947842 3199412 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0915 06:36:25.956579 3199412 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0915 06:36:25.956647 3199412 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0915 06:36:25.965182 3199412 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0915 06:36:25.973961 3199412 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0915 06:36:25.974041 3199412 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0915 06:36:25.982660 3199412 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0915 06:36:26.031307 3199412 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1
I0915 06:36:26.031488 3199412 kubeadm.go:310] [preflight] Running pre-flight checks
I0915 06:36:26.051122 3199412 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0915 06:36:26.051201 3199412 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1069-aws[0m
I0915 06:36:26.051243 3199412 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0915 06:36:26.051293 3199412 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0915 06:36:26.051347 3199412 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0915 06:36:26.051398 3199412 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0915 06:36:26.051449 3199412 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0915 06:36:26.051500 3199412 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0915 06:36:26.051553 3199412 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0915 06:36:26.051608 3199412 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0915 06:36:26.051663 3199412 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0915 06:36:26.051713 3199412 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0915 06:36:26.114661 3199412 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0915 06:36:26.114809 3199412 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0915 06:36:26.114964 3199412 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0915 06:36:26.123504 3199412 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0915 06:36:26.127232 3199412 out.go:235] - Generating certificates and keys ...
I0915 06:36:26.127428 3199412 kubeadm.go:310] [certs] Using existing ca certificate authority
I0915 06:36:26.127544 3199412 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0915 06:36:26.605064 3199412 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0915 06:36:27.252102 3199412 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0915 06:36:27.669423 3199412 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0915 06:36:28.092976 3199412 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0915 06:36:29.202487 3199412 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0915 06:36:29.202857 3199412 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-686490 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0915 06:36:29.925882 3199412 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0915 06:36:29.926025 3199412 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-686490 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0915 06:36:30.170486 3199412 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0915 06:36:30.504791 3199412 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0915 06:36:30.993883 3199412 kubeadm.go:310] [certs] Generating "sa" key and public key
I0915 06:36:30.994103 3199412 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0915 06:36:31.592272 3199412 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0915 06:36:31.856982 3199412 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0915 06:36:32.850572 3199412 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0915 06:36:33.218965 3199412 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0915 06:36:34.541551 3199412 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0915 06:36:34.542278 3199412 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0915 06:36:34.548354 3199412 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0915 06:36:34.551743 3199412 out.go:235] - Booting up control plane ...
I0915 06:36:34.551850 3199412 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0915 06:36:34.551926 3199412 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0915 06:36:34.553248 3199412 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0915 06:36:34.568311 3199412 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0915 06:36:34.575437 3199412 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0915 06:36:34.575515 3199412 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0915 06:36:34.670748 3199412 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0915 06:36:34.670876 3199412 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0915 06:36:36.172139 3199412 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.501724228s
I0915 06:36:36.172243 3199412 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0915 06:36:42.674417 3199412 kubeadm.go:310] [api-check] The API server is healthy after 6.502233047s
I0915 06:36:42.693697 3199412 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0915 06:36:42.708926 3199412 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0915 06:36:42.735251 3199412 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0915 06:36:42.735461 3199412 kubeadm.go:310] [mark-control-plane] Marking the node addons-686490 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0915 06:36:42.754046 3199412 kubeadm.go:310] [bootstrap-token] Using token: awdtln.0vp8q231ymmsqg1u
I0915 06:36:42.756834 3199412 out.go:235] - Configuring RBAC rules ...
I0915 06:36:42.756967 3199412 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0915 06:36:42.761513 3199412 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0915 06:36:42.769627 3199412 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0915 06:36:42.773283 3199412 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0915 06:36:42.779208 3199412 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0915 06:36:42.783628 3199412 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0915 06:36:43.081967 3199412 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0915 06:36:43.507536 3199412 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0915 06:36:44.081819 3199412 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0915 06:36:44.082981 3199412 kubeadm.go:310]
I0915 06:36:44.083123 3199412 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0915 06:36:44.083138 3199412 kubeadm.go:310]
I0915 06:36:44.083216 3199412 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0915 06:36:44.083225 3199412 kubeadm.go:310]
I0915 06:36:44.083251 3199412 kubeadm.go:310] mkdir -p $HOME/.kube
I0915 06:36:44.083316 3199412 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0915 06:36:44.083370 3199412 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0915 06:36:44.083378 3199412 kubeadm.go:310]
I0915 06:36:44.083432 3199412 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0915 06:36:44.083440 3199412 kubeadm.go:310]
I0915 06:36:44.083487 3199412 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0915 06:36:44.083503 3199412 kubeadm.go:310]
I0915 06:36:44.083555 3199412 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0915 06:36:44.083639 3199412 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0915 06:36:44.083749 3199412 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0915 06:36:44.083758 3199412 kubeadm.go:310]
I0915 06:36:44.083842 3199412 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0915 06:36:44.083923 3199412 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0915 06:36:44.083932 3199412 kubeadm.go:310]
I0915 06:36:44.084017 3199412 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token awdtln.0vp8q231ymmsqg1u \
I0915 06:36:44.084123 3199412 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:40c7cf320af28954d47c6aad20f8c848672babdad0b1d523c7f9098bf692068a \
I0915 06:36:44.084148 3199412 kubeadm.go:310] --control-plane
I0915 06:36:44.084156 3199412 kubeadm.go:310]
I0915 06:36:44.084239 3199412 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0915 06:36:44.084248 3199412 kubeadm.go:310]
I0915 06:36:44.084329 3199412 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token awdtln.0vp8q231ymmsqg1u \
I0915 06:36:44.084435 3199412 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:40c7cf320af28954d47c6aad20f8c848672babdad0b1d523c7f9098bf692068a
I0915 06:36:44.088624 3199412 kubeadm.go:310] W0915 06:36:26.026897 1022 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0915 06:36:44.088925 3199412 kubeadm.go:310] W0915 06:36:26.028819 1022 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0915 06:36:44.089148 3199412 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1069-aws\n", err: exit status 1
I0915 06:36:44.089259 3199412 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0915 06:36:44.089280 3199412 cni.go:84] Creating CNI manager for ""
I0915 06:36:44.089288 3199412 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0915 06:36:44.092388 3199412 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0915 06:36:44.095089 3199412 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0915 06:36:44.099345 3199412 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.1/kubectl ...
I0915 06:36:44.099375 3199412 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0915 06:36:44.119122 3199412 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0915 06:36:44.396065 3199412 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0915 06:36:44.396189 3199412 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 06:36:44.396262 3199412 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-686490 minikube.k8s.io/updated_at=2024_09_15T06_36_44_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=7a3ca67a20528f5dabbb456e8e4ce542b58ef23a minikube.k8s.io/name=addons-686490 minikube.k8s.io/primary=true
I0915 06:36:44.601073 3199412 ops.go:34] apiserver oom_adj: -16
I0915 06:36:44.601200 3199412 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 06:36:45.102155 3199412 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 06:36:45.601988 3199412 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 06:36:46.102256 3199412 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 06:36:46.601837 3199412 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 06:36:47.102151 3199412 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 06:36:47.601876 3199412 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 06:36:48.102040 3199412 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 06:36:48.601426 3199412 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0915 06:36:48.849229 3199412 kubeadm.go:1113] duration metric: took 4.453081573s to wait for elevateKubeSystemPrivileges
I0915 06:36:48.849258 3199412 kubeadm.go:394] duration metric: took 23.011448226s to StartCluster
I0915 06:36:48.849277 3199412 settings.go:142] acquiring lock: {Name:mkca7a8986bccd67741f09577b65c1a9eb63fddc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0915 06:36:48.849389 3199412 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19644-3193270/kubeconfig
I0915 06:36:48.849769 3199412 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19644-3193270/kubeconfig: {Name:mkb6e748827e252b3291ddf224082d480f12d063 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0915 06:36:48.849972 3199412 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0915 06:36:48.850114 3199412 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0915 06:36:48.850396 3199412 config.go:182] Loaded profile config "addons-686490": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0915 06:36:48.850338 3199412 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0915 06:36:48.850433 3199412 addons.go:69] Setting cloud-spanner=true in profile "addons-686490"
I0915 06:36:48.850448 3199412 addons.go:234] Setting addon cloud-spanner=true in "addons-686490"
I0915 06:36:48.850459 3199412 addons.go:69] Setting yakd=true in profile "addons-686490"
I0915 06:36:48.850470 3199412 host.go:66] Checking if "addons-686490" exists ...
I0915 06:36:48.850476 3199412 addons.go:234] Setting addon yakd=true in "addons-686490"
I0915 06:36:48.850508 3199412 host.go:66] Checking if "addons-686490" exists ...
I0915 06:36:48.850924 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:48.851175 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:48.851691 3199412 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-686490"
I0915 06:36:48.851738 3199412 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-686490"
I0915 06:36:48.851765 3199412 host.go:66] Checking if "addons-686490" exists ...
I0915 06:36:48.852194 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:48.857674 3199412 addons.go:69] Setting default-storageclass=true in profile "addons-686490"
I0915 06:36:48.857713 3199412 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-686490"
I0915 06:36:48.858075 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:48.858292 3199412 out.go:177] * Verifying Kubernetes components...
I0915 06:36:48.859918 3199412 addons.go:69] Setting registry=true in profile "addons-686490"
I0915 06:36:48.859945 3199412 addons.go:234] Setting addon registry=true in "addons-686490"
I0915 06:36:48.859977 3199412 host.go:66] Checking if "addons-686490" exists ...
I0915 06:36:48.861112 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:48.871123 3199412 addons.go:69] Setting gcp-auth=true in profile "addons-686490"
I0915 06:36:48.871164 3199412 mustload.go:65] Loading cluster: addons-686490
I0915 06:36:48.871349 3199412 config.go:182] Loaded profile config "addons-686490": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0915 06:36:48.871624 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:48.875127 3199412 addons.go:69] Setting storage-provisioner=true in profile "addons-686490"
I0915 06:36:48.877817 3199412 addons.go:234] Setting addon storage-provisioner=true in "addons-686490"
I0915 06:36:48.878000 3199412 host.go:66] Checking if "addons-686490" exists ...
I0915 06:36:48.878787 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:48.889155 3199412 addons.go:69] Setting ingress=true in profile "addons-686490"
I0915 06:36:48.889283 3199412 addons.go:234] Setting addon ingress=true in "addons-686490"
I0915 06:36:48.889400 3199412 host.go:66] Checking if "addons-686490" exists ...
I0915 06:36:48.890208 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:48.877420 3199412 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-686490"
I0915 06:36:48.916858 3199412 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-686490"
I0915 06:36:48.917265 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:48.919339 3199412 addons.go:69] Setting ingress-dns=true in profile "addons-686490"
I0915 06:36:48.919426 3199412 addons.go:234] Setting addon ingress-dns=true in "addons-686490"
I0915 06:36:48.919502 3199412 host.go:66] Checking if "addons-686490" exists ...
I0915 06:36:48.920148 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:48.877440 3199412 addons.go:69] Setting volcano=true in profile "addons-686490"
I0915 06:36:48.959334 3199412 addons.go:234] Setting addon volcano=true in "addons-686490"
I0915 06:36:48.959380 3199412 host.go:66] Checking if "addons-686490" exists ...
I0915 06:36:48.959896 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:48.967117 3199412 addons.go:69] Setting inspektor-gadget=true in profile "addons-686490"
I0915 06:36:48.967206 3199412 addons.go:234] Setting addon inspektor-gadget=true in "addons-686490"
I0915 06:36:48.967268 3199412 host.go:66] Checking if "addons-686490" exists ...
I0915 06:36:48.967813 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:48.877467 3199412 addons.go:69] Setting volumesnapshots=true in profile "addons-686490"
I0915 06:36:48.982924 3199412 addons.go:234] Setting addon volumesnapshots=true in "addons-686490"
I0915 06:36:48.982983 3199412 host.go:66] Checking if "addons-686490" exists ...
I0915 06:36:48.983540 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:48.877620 3199412 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0915 06:36:49.003891 3199412 addons.go:69] Setting metrics-server=true in profile "addons-686490"
I0915 06:36:49.003992 3199412 addons.go:234] Setting addon metrics-server=true in "addons-686490"
I0915 06:36:49.004362 3199412 host.go:66] Checking if "addons-686490" exists ...
I0915 06:36:49.004965 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:49.026410 3199412 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-686490"
I0915 06:36:49.026449 3199412 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-686490"
I0915 06:36:49.026485 3199412 host.go:66] Checking if "addons-686490" exists ...
I0915 06:36:49.026986 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:49.041888 3199412 addons.go:234] Setting addon default-storageclass=true in "addons-686490"
I0915 06:36:49.042008 3199412 host.go:66] Checking if "addons-686490" exists ...
I0915 06:36:49.042597 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:49.063558 3199412 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0915 06:36:49.068948 3199412 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0915 06:36:49.069728 3199412 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0915 06:36:49.078454 3199412 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23
I0915 06:36:49.081191 3199412 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0915 06:36:49.081229 3199412 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0915 06:36:49.081357 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:49.090690 3199412 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0915 06:36:49.098395 3199412 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0915 06:36:49.098426 3199412 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0915 06:36:49.098576 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:49.133337 3199412 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0915 06:36:49.139064 3199412 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0915 06:36:49.140106 3199412 host.go:66] Checking if "addons-686490" exists ...
I0915 06:36:49.148083 3199412 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0915 06:36:49.181991 3199412 out.go:177] - Using image docker.io/registry:2.8.3
I0915 06:36:49.188458 3199412 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-686490"
I0915 06:36:49.188512 3199412 host.go:66] Checking if "addons-686490" exists ...
I0915 06:36:49.188977 3199412 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0915 06:36:49.190318 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:49.194034 3199412 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0915 06:36:49.194104 3199412 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0915 06:36:49.194216 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:49.213278 3199412 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0915 06:36:49.216160 3199412 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
I0915 06:36:49.216424 3199412 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0915 06:36:49.216466 3199412 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0915 06:36:49.216577 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:49.220067 3199412 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0915 06:36:49.220104 3199412 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0915 06:36:49.220215 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:49.247250 3199412 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0915 06:36:49.261634 3199412 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0915 06:36:49.264441 3199412 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0915 06:36:49.264554 3199412 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0915 06:36:49.266609 3199412 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0915 06:36:49.286420 3199412 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0915 06:36:49.286515 3199412 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0915 06:36:49.286621 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:49.268345 3199412 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0915 06:36:49.289984 3199412 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0915 06:36:49.294556 3199412 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0915 06:36:49.305295 3199412 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0915 06:36:49.305325 3199412 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0915 06:36:49.305423 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:49.317757 3199412 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0915 06:36:49.317837 3199412 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0915 06:36:49.317947 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:49.328714 3199412 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0915 06:36:49.328740 3199412 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0915 06:36:49.328825 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:49.345054 3199412 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0915 06:36:49.348541 3199412 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0915 06:36:49.348642 3199412 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0915 06:36:49.348771 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:49.367745 3199412 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0915 06:36:49.376226 3199412 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0915 06:36:49.376260 3199412 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0915 06:36:49.376352 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:49.379404 3199412 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0915 06:36:49.382265 3199412 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0915 06:36:49.390875 3199412 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0915 06:36:49.400662 3199412 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0915 06:36:49.400805 3199412 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0915 06:36:49.400945 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:49.449804 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:49.463331 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:49.464084 3199412 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0915 06:36:49.464099 3199412 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0915 06:36:49.464159 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:49.464726 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:49.474705 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:49.481956 3199412 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0915 06:36:49.485009 3199412 out.go:177] - Using image docker.io/busybox:stable
I0915 06:36:49.487751 3199412 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0915 06:36:49.487781 3199412 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0915 06:36:49.487907 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:49.514272 3199412 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0915 06:36:49.597810 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:49.613637 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:49.622456 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:49.655420 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:49.663748 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:49.664609 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:49.686042 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:49.690080 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:49.700020 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:49.719301 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:50.203077 3199412 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0915 06:36:50.214510 3199412 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0915 06:36:50.214537 3199412 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0915 06:36:50.270805 3199412 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0915 06:36:50.282118 3199412 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0915 06:36:50.282144 3199412 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0915 06:36:50.306089 3199412 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0915 06:36:50.351822 3199412 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0915 06:36:50.351899 3199412 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0915 06:36:50.373382 3199412 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0915 06:36:50.373463 3199412 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0915 06:36:50.381054 3199412 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0915 06:36:50.384169 3199412 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0915 06:36:50.384239 3199412 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0915 06:36:50.413345 3199412 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0915 06:36:50.418320 3199412 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0915 06:36:50.420668 3199412 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0915 06:36:50.422594 3199412 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0915 06:36:50.424242 3199412 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0915 06:36:50.424295 3199412 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0915 06:36:50.432536 3199412 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0915 06:36:50.432608 3199412 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0915 06:36:50.519747 3199412 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0915 06:36:50.519829 3199412 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0915 06:36:50.545181 3199412 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0915 06:36:50.545264 3199412 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0915 06:36:50.555806 3199412 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0915 06:36:50.555895 3199412 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0915 06:36:50.556212 3199412 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0915 06:36:50.556268 3199412 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0915 06:36:50.623080 3199412 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0915 06:36:50.623108 3199412 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0915 06:36:50.641735 3199412 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0915 06:36:50.757773 3199412 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0915 06:36:50.757803 3199412 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0915 06:36:50.780099 3199412 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0915 06:36:50.780127 3199412 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0915 06:36:50.786319 3199412 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0915 06:36:50.786346 3199412 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0915 06:36:50.790887 3199412 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0915 06:36:50.790915 3199412 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0915 06:36:50.826303 3199412 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0915 06:36:50.826330 3199412 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0915 06:36:50.906209 3199412 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0915 06:36:51.022535 3199412 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0915 06:36:51.022564 3199412 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0915 06:36:51.037219 3199412 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0915 06:36:51.037247 3199412 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0915 06:36:51.038072 3199412 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0915 06:36:51.038092 3199412 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0915 06:36:51.058347 3199412 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0915 06:36:51.058375 3199412 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0915 06:36:51.227541 3199412 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0915 06:36:51.227570 3199412 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0915 06:36:51.237736 3199412 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0915 06:36:51.237764 3199412 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0915 06:36:51.311288 3199412 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0915 06:36:51.342684 3199412 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0915 06:36:51.342711 3199412 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0915 06:36:51.408829 3199412 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (1.894508715s)
I0915 06:36:51.409054 3199412 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.122133923s)
I0915 06:36:51.409100 3199412 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0915 06:36:51.409665 3199412 node_ready.go:35] waiting up to 6m0s for node "addons-686490" to be "Ready" ...
I0915 06:36:51.414223 3199412 node_ready.go:49] node "addons-686490" has status "Ready":"True"
I0915 06:36:51.414292 3199412 node_ready.go:38] duration metric: took 4.594936ms for node "addons-686490" to be "Ready" ...
I0915 06:36:51.414317 3199412 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0915 06:36:51.436073 3199412 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace to be "Ready" ...
I0915 06:36:51.568480 3199412 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0915 06:36:51.568554 3199412 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0915 06:36:51.689622 3199412 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0915 06:36:51.689648 3199412 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0915 06:36:51.770881 3199412 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0915 06:36:51.770905 3199412 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0915 06:36:51.797191 3199412 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0915 06:36:51.859943 3199412 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0915 06:36:51.860019 3199412 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0915 06:36:51.912638 3199412 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-686490" context rescaled to 1 replicas
I0915 06:36:52.039284 3199412 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0915 06:36:52.039357 3199412 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0915 06:36:52.080158 3199412 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0915 06:36:52.401557 3199412 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0915 06:36:52.401633 3199412 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0915 06:36:52.812701 3199412 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0915 06:36:52.812729 3199412 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0915 06:36:53.379151 3199412 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0915 06:36:53.446806 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:36:53.853877 3199412 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (3.650760484s)
I0915 06:36:53.854140 3199412 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (3.583308713s)
I0915 06:36:53.854204 3199412 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (3.548042926s)
W0915 06:36:53.869882 3199412 out.go:270] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class local-path as non-default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
I0915 06:36:54.301801 3199412 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (3.920660868s)
I0915 06:36:54.301943 3199412 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (3.88853272s)
I0915 06:36:54.301991 3199412 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (3.88360641s)
I0915 06:36:55.495360 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:36:56.410503 3199412 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0915 06:36:56.410639 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:56.435249 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:56.896983 3199412 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0915 06:36:57.122865 3199412 addons.go:234] Setting addon gcp-auth=true in "addons-686490"
I0915 06:36:57.122934 3199412 host.go:66] Checking if "addons-686490" exists ...
I0915 06:36:57.123487 3199412 cli_runner.go:164] Run: docker container inspect addons-686490 --format={{.State.Status}}
I0915 06:36:57.149957 3199412 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0915 06:36:57.150012 3199412 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-686490
I0915 06:36:57.189922 3199412 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:35877 SSHKeyPath:/home/jenkins/minikube-integration/19644-3193270/.minikube/machines/addons-686490/id_rsa Username:docker}
I0915 06:36:57.964789 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:36:59.135483 3199412 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (8.714743435s)
I0915 06:36:59.135673 3199412 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (8.713014291s)
I0915 06:36:59.136076 3199412 addons.go:475] Verifying addon ingress=true in "addons-686490"
I0915 06:36:59.135766 3199412 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.229533531s)
I0915 06:36:59.136308 3199412 addons.go:475] Verifying addon metrics-server=true in "addons-686490"
I0915 06:36:59.135796 3199412 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (7.824478797s)
I0915 06:36:59.135870 3199412 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.338597895s)
W0915 06:36:59.136574 3199412 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0915 06:36:59.136602 3199412 retry.go:31] will retry after 242.45228ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0915 06:36:59.135924 3199412 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (7.055683477s)
I0915 06:36:59.135988 3199412 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (8.493939996s)
I0915 06:36:59.136668 3199412 addons.go:475] Verifying addon registry=true in "addons-686490"
I0915 06:36:59.140883 3199412 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-686490 service yakd-dashboard -n yakd-dashboard
I0915 06:36:59.140977 3199412 out.go:177] * Verifying ingress addon...
I0915 06:36:59.146095 3199412 out.go:177] * Verifying registry addon...
I0915 06:36:59.163983 3199412 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0915 06:36:59.165871 3199412 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0915 06:36:59.202355 3199412 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0915 06:36:59.202388 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:36:59.203537 3199412 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0915 06:36:59.203564 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:36:59.379266 3199412 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0915 06:36:59.696387 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:36:59.697409 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:00.063088 3199412 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.683832701s)
I0915 06:37:00.063179 3199412 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-686490"
I0915 06:37:00.063459 3199412 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (2.913476141s)
I0915 06:37:00.066525 3199412 out.go:177] * Verifying csi-hostpath-driver addon...
I0915 06:37:00.066694 3199412 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0915 06:37:00.070554 3199412 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0915 06:37:00.078819 3199412 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0915 06:37:00.087500 3199412 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0915 06:37:00.087589 3199412 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0915 06:37:00.116215 3199412 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0915 06:37:00.116316 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:00.200981 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:00.205066 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:00.239146 3199412 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0915 06:37:00.239238 3199412 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0915 06:37:00.307535 3199412 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0915 06:37:00.307684 3199412 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0915 06:37:00.368895 3199412 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0915 06:37:00.444068 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:00.581995 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:00.668861 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:00.671756 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:01.077786 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:01.171395 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:01.173155 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:01.285841 3199412 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.906511308s)
I0915 06:37:01.521579 3199412 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.152640274s)
I0915 06:37:01.524712 3199412 addons.go:475] Verifying addon gcp-auth=true in "addons-686490"
I0915 06:37:01.529598 3199412 out.go:177] * Verifying gcp-auth addon...
I0915 06:37:01.543882 3199412 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0915 06:37:01.548951 3199412 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0915 06:37:01.575924 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:01.670693 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:01.671784 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:02.076217 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:02.169195 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:02.172466 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:02.575558 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:02.668304 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:02.671426 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:02.943511 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:03.076015 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:03.169701 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:03.170695 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:03.576688 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:03.669134 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:03.672449 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:04.076405 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:04.171061 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:04.172635 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:04.575498 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:04.669704 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:04.670750 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:04.944079 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:05.151383 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:05.168449 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:05.171534 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:05.577907 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:05.669766 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:05.670667 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:06.076464 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:06.169879 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:06.172239 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:06.577734 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:06.669331 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:06.671284 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:07.075922 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:07.169344 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:07.171239 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:07.443102 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:07.576081 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:07.669260 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:07.671453 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:08.076124 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:08.168370 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:08.170632 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:08.575906 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:08.668519 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:08.675754 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:09.076039 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:09.169730 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:09.171346 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:09.578649 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:09.671064 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:09.672237 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:09.942666 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:10.075503 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:10.168927 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:10.171550 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:10.575499 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:10.669116 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:10.670175 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:11.075760 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:11.169331 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:11.170364 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:11.575621 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:11.668547 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:11.670480 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:11.942880 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:12.076271 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:12.169315 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:12.170836 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:12.575946 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:12.669160 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:12.669936 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:13.076192 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:13.169727 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:13.171074 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:13.575234 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:13.670668 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:13.671327 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:13.943150 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:14.076065 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:14.168920 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:14.171203 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:14.576201 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:14.669585 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:14.671383 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:15.075473 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:15.169157 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:15.170656 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:15.575825 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:15.668759 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:15.671124 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:16.075862 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:16.168348 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:16.171105 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:16.442864 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:16.575861 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:16.668961 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:16.671122 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:17.076421 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:17.168659 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:17.183979 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:17.577476 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:17.669239 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:17.671415 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:18.076244 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:18.168661 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:18.171337 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:18.574932 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:18.668371 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:18.670460 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:18.942922 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:19.076237 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:19.168460 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:19.171349 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:19.576323 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:19.668694 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:19.671226 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:20.075688 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:20.169151 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:20.171163 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:20.576154 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:20.668424 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:20.670216 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:21.075603 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:21.168282 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:21.170312 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:21.443531 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:21.576042 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:21.669153 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:21.670411 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:22.075199 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:22.168401 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:22.170507 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:22.575772 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:22.669280 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:22.671436 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:23.075661 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:23.168226 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:23.169611 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:23.445896 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:23.576451 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:23.669435 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:23.671512 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:24.075971 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:24.169326 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:24.170251 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:24.575589 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:24.669299 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:24.669827 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:25.076382 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:25.168240 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:25.170437 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:25.576148 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:25.669131 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:25.672024 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:25.941837 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:26.075397 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:26.168188 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:26.169809 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:26.575664 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:26.669767 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:26.671299 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:27.075772 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:27.168460 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:27.170453 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:27.651939 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:27.730430 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:27.731177 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:27.943829 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:28.077508 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:28.172992 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:28.174760 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:28.576025 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:28.669557 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:28.672814 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:29.075692 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:29.168862 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:29.169945 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:29.574975 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:29.672932 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:29.674045 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:30.076423 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:30.168907 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:30.171309 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:30.445159 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:30.651637 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:30.668378 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:30.670449 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:31.075791 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:31.169024 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:31.170622 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:31.576334 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:31.671076 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:31.671815 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:32.075811 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:32.168420 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:32.170144 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:32.651536 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:32.669567 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:32.672969 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:32.943572 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:33.076522 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:33.170025 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:33.171037 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:33.576202 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:33.672932 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:33.674578 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:34.075618 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:34.169287 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:34.170366 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:34.575438 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:34.669533 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:34.670876 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:35.076390 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:35.169244 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:35.171590 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:35.443749 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:35.578038 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:35.670913 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:35.672908 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:36.076683 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:36.168853 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:36.171746 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:36.575588 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:36.670510 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:36.671967 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:37.075555 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:37.169679 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:37.173630 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:37.580918 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:37.668440 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:37.671993 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:37.942596 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:38.076409 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:38.170251 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:38.172825 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:38.650200 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:38.669340 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:38.670878 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:39.076536 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:39.168814 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:39.171537 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:39.576182 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:39.669471 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:39.669647 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:39.943871 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:40.075509 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:40.170399 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:40.171059 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:40.575338 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:40.670686 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:40.672157 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:41.075319 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:41.168824 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:41.170854 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:41.576508 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:41.671330 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:41.673145 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:42.077755 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:42.169014 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:42.171641 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:42.443351 3199412 pod_ready.go:103] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"False"
I0915 06:37:42.576259 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:42.670898 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:42.672824 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:43.075528 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:43.170825 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:43.172389 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:43.576687 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:43.671629 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:43.673504 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:43.944675 3199412 pod_ready.go:93] pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace has status "Ready":"True"
I0915 06:37:43.944775 3199412 pod_ready.go:82] duration metric: took 52.508626138s for pod "coredns-7c65d6cfc9-9mpdr" in "kube-system" namespace to be "Ready" ...
I0915 06:37:43.944814 3199412 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-dwj9z" in "kube-system" namespace to be "Ready" ...
I0915 06:37:43.948066 3199412 pod_ready.go:98] error getting pod "coredns-7c65d6cfc9-dwj9z" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-dwj9z" not found
I0915 06:37:43.948159 3199412 pod_ready.go:82] duration metric: took 3.302467ms for pod "coredns-7c65d6cfc9-dwj9z" in "kube-system" namespace to be "Ready" ...
E0915 06:37:43.948219 3199412 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-7c65d6cfc9-dwj9z" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-dwj9z" not found
I0915 06:37:43.948256 3199412 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-686490" in "kube-system" namespace to be "Ready" ...
I0915 06:37:43.957585 3199412 pod_ready.go:93] pod "etcd-addons-686490" in "kube-system" namespace has status "Ready":"True"
I0915 06:37:43.957664 3199412 pod_ready.go:82] duration metric: took 9.377927ms for pod "etcd-addons-686490" in "kube-system" namespace to be "Ready" ...
I0915 06:37:43.957712 3199412 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-686490" in "kube-system" namespace to be "Ready" ...
I0915 06:37:43.967197 3199412 pod_ready.go:93] pod "kube-apiserver-addons-686490" in "kube-system" namespace has status "Ready":"True"
I0915 06:37:43.967277 3199412 pod_ready.go:82] duration metric: took 9.512981ms for pod "kube-apiserver-addons-686490" in "kube-system" namespace to be "Ready" ...
I0915 06:37:43.967307 3199412 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-686490" in "kube-system" namespace to be "Ready" ...
I0915 06:37:43.973332 3199412 pod_ready.go:93] pod "kube-controller-manager-addons-686490" in "kube-system" namespace has status "Ready":"True"
I0915 06:37:43.973426 3199412 pod_ready.go:82] duration metric: took 6.078685ms for pod "kube-controller-manager-addons-686490" in "kube-system" namespace to be "Ready" ...
I0915 06:37:43.973484 3199412 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-2297r" in "kube-system" namespace to be "Ready" ...
I0915 06:37:44.075419 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:44.140092 3199412 pod_ready.go:93] pod "kube-proxy-2297r" in "kube-system" namespace has status "Ready":"True"
I0915 06:37:44.140159 3199412 pod_ready.go:82] duration metric: took 166.652338ms for pod "kube-proxy-2297r" in "kube-system" namespace to be "Ready" ...
I0915 06:37:44.140186 3199412 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-686490" in "kube-system" namespace to be "Ready" ...
I0915 06:37:44.169649 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:44.172697 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:44.540456 3199412 pod_ready.go:93] pod "kube-scheduler-addons-686490" in "kube-system" namespace has status "Ready":"True"
I0915 06:37:44.540482 3199412 pod_ready.go:82] duration metric: took 400.273313ms for pod "kube-scheduler-addons-686490" in "kube-system" namespace to be "Ready" ...
I0915 06:37:44.540495 3199412 pod_ready.go:79] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-w56rc" in "kube-system" namespace to be "Ready" ...
I0915 06:37:44.576386 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:44.672114 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:44.674070 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:45.076678 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:45.170042 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:45.171177 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:45.575819 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:45.669925 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:45.671277 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:46.075916 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:46.140678 3199412 pod_ready.go:93] pod "nvidia-device-plugin-daemonset-w56rc" in "kube-system" namespace has status "Ready":"True"
I0915 06:37:46.140703 3199412 pod_ready.go:82] duration metric: took 1.600199795s for pod "nvidia-device-plugin-daemonset-w56rc" in "kube-system" namespace to be "Ready" ...
I0915 06:37:46.140719 3199412 pod_ready.go:39] duration metric: took 54.726355387s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0915 06:37:46.140738 3199412 api_server.go:52] waiting for apiserver process to appear ...
I0915 06:37:46.140807 3199412 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0915 06:37:46.156585 3199412 api_server.go:72] duration metric: took 57.306574172s to wait for apiserver process to appear ...
I0915 06:37:46.156611 3199412 api_server.go:88] waiting for apiserver healthz status ...
I0915 06:37:46.156631 3199412 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0915 06:37:46.165632 3199412 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0915 06:37:46.166641 3199412 api_server.go:141] control plane version: v1.31.1
I0915 06:37:46.166667 3199412 api_server.go:131] duration metric: took 10.049207ms to wait for apiserver health ...
I0915 06:37:46.166716 3199412 system_pods.go:43] waiting for kube-system pods to appear ...
I0915 06:37:46.168641 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:46.170523 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:46.346402 3199412 system_pods.go:59] 18 kube-system pods found
I0915 06:37:46.346441 3199412 system_pods.go:61] "coredns-7c65d6cfc9-9mpdr" [b6e47f91-3cfe-4cab-b19b-5451fcc5ee46] Running
I0915 06:37:46.346452 3199412 system_pods.go:61] "csi-hostpath-attacher-0" [5fd5b1cd-8e15-4078-bf48-38e0fb38a753] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0915 06:37:46.346460 3199412 system_pods.go:61] "csi-hostpath-resizer-0" [76fee9f7-3f5b-48e4-aaa6-6b337e68e83a] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0915 06:37:46.346469 3199412 system_pods.go:61] "csi-hostpathplugin-p6nhc" [42fbed30-eb12-4687-afb0-04e4d19d39c1] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0915 06:37:46.346474 3199412 system_pods.go:61] "etcd-addons-686490" [21a16d89-bfc7-4c3c-bf64-d5f0e33eb791] Running
I0915 06:37:46.346479 3199412 system_pods.go:61] "kindnet-cj6zz" [c3de5731-7b59-4a38-92e3-4a3a4bddf9e4] Running
I0915 06:37:46.346490 3199412 system_pods.go:61] "kube-apiserver-addons-686490" [11380aca-4df4-4c5f-be96-b634fa30c099] Running
I0915 06:37:46.346494 3199412 system_pods.go:61] "kube-controller-manager-addons-686490" [6e753175-8219-4f8d-975f-d60ed07eb723] Running
I0915 06:37:46.346503 3199412 system_pods.go:61] "kube-ingress-dns-minikube" [2832099d-e581-4789-9a0e-37be38999603] Running
I0915 06:37:46.346507 3199412 system_pods.go:61] "kube-proxy-2297r" [aaa302ff-2fc6-4aa0-8a6c-896b5bae8397] Running
I0915 06:37:46.346511 3199412 system_pods.go:61] "kube-scheduler-addons-686490" [818bee60-a44f-44af-91b8-b7f8b70f9c9e] Running
I0915 06:37:46.346517 3199412 system_pods.go:61] "metrics-server-84c5f94fbc-fpnkx" [0ac54330-326c-4b01-a7a3-f324be97b1bd] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0915 06:37:46.346524 3199412 system_pods.go:61] "nvidia-device-plugin-daemonset-w56rc" [ba99ac53-6596-49f5-a42f-38380f636f28] Running
I0915 06:37:46.346530 3199412 system_pods.go:61] "registry-66c9cd494c-shzcc" [25bbd5d5-6b38-48ac-b11e-55a962241296] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0915 06:37:46.346535 3199412 system_pods.go:61] "registry-proxy-r5v2g" [58cfd80d-2cf0-4456-841f-2268a328e3a0] Running
I0915 06:37:46.346542 3199412 system_pods.go:61] "snapshot-controller-56fcc65765-fw8tc" [b3b9a951-2de3-4a7c-8b22-f945a3bd3255] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0915 06:37:46.346550 3199412 system_pods.go:61] "snapshot-controller-56fcc65765-jjw79" [ff541fa3-d0bf-464f-bb8a-808696d8a598] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0915 06:37:46.346555 3199412 system_pods.go:61] "storage-provisioner" [4aae9560-2f19-40e3-9a4c-6ef3d41a4931] Running
I0915 06:37:46.346564 3199412 system_pods.go:74] duration metric: took 179.840281ms to wait for pod list to return data ...
I0915 06:37:46.346573 3199412 default_sa.go:34] waiting for default service account to be created ...
I0915 06:37:46.539566 3199412 default_sa.go:45] found service account: "default"
I0915 06:37:46.539596 3199412 default_sa.go:55] duration metric: took 193.012569ms for default service account to be created ...
I0915 06:37:46.539617 3199412 system_pods.go:116] waiting for k8s-apps to be running ...
I0915 06:37:46.575515 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:46.669798 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0915 06:37:46.670048 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:46.746635 3199412 system_pods.go:86] 18 kube-system pods found
I0915 06:37:46.746678 3199412 system_pods.go:89] "coredns-7c65d6cfc9-9mpdr" [b6e47f91-3cfe-4cab-b19b-5451fcc5ee46] Running
I0915 06:37:46.746691 3199412 system_pods.go:89] "csi-hostpath-attacher-0" [5fd5b1cd-8e15-4078-bf48-38e0fb38a753] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0915 06:37:46.746699 3199412 system_pods.go:89] "csi-hostpath-resizer-0" [76fee9f7-3f5b-48e4-aaa6-6b337e68e83a] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0915 06:37:46.746718 3199412 system_pods.go:89] "csi-hostpathplugin-p6nhc" [42fbed30-eb12-4687-afb0-04e4d19d39c1] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0915 06:37:46.746724 3199412 system_pods.go:89] "etcd-addons-686490" [21a16d89-bfc7-4c3c-bf64-d5f0e33eb791] Running
I0915 06:37:46.746729 3199412 system_pods.go:89] "kindnet-cj6zz" [c3de5731-7b59-4a38-92e3-4a3a4bddf9e4] Running
I0915 06:37:46.746741 3199412 system_pods.go:89] "kube-apiserver-addons-686490" [11380aca-4df4-4c5f-be96-b634fa30c099] Running
I0915 06:37:46.746746 3199412 system_pods.go:89] "kube-controller-manager-addons-686490" [6e753175-8219-4f8d-975f-d60ed07eb723] Running
I0915 06:37:46.746758 3199412 system_pods.go:89] "kube-ingress-dns-minikube" [2832099d-e581-4789-9a0e-37be38999603] Running
I0915 06:37:46.746764 3199412 system_pods.go:89] "kube-proxy-2297r" [aaa302ff-2fc6-4aa0-8a6c-896b5bae8397] Running
I0915 06:37:46.746769 3199412 system_pods.go:89] "kube-scheduler-addons-686490" [818bee60-a44f-44af-91b8-b7f8b70f9c9e] Running
I0915 06:37:46.746781 3199412 system_pods.go:89] "metrics-server-84c5f94fbc-fpnkx" [0ac54330-326c-4b01-a7a3-f324be97b1bd] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0915 06:37:46.746785 3199412 system_pods.go:89] "nvidia-device-plugin-daemonset-w56rc" [ba99ac53-6596-49f5-a42f-38380f636f28] Running
I0915 06:37:46.746800 3199412 system_pods.go:89] "registry-66c9cd494c-shzcc" [25bbd5d5-6b38-48ac-b11e-55a962241296] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0915 06:37:46.746804 3199412 system_pods.go:89] "registry-proxy-r5v2g" [58cfd80d-2cf0-4456-841f-2268a328e3a0] Running
I0915 06:37:46.746811 3199412 system_pods.go:89] "snapshot-controller-56fcc65765-fw8tc" [b3b9a951-2de3-4a7c-8b22-f945a3bd3255] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0915 06:37:46.746818 3199412 system_pods.go:89] "snapshot-controller-56fcc65765-jjw79" [ff541fa3-d0bf-464f-bb8a-808696d8a598] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0915 06:37:46.746824 3199412 system_pods.go:89] "storage-provisioner" [4aae9560-2f19-40e3-9a4c-6ef3d41a4931] Running
I0915 06:37:46.746834 3199412 system_pods.go:126] duration metric: took 207.208704ms to wait for k8s-apps to be running ...
I0915 06:37:46.746849 3199412 system_svc.go:44] waiting for kubelet service to be running ....
I0915 06:37:46.746913 3199412 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0915 06:37:46.759447 3199412 system_svc.go:56] duration metric: took 12.588154ms WaitForService to wait for kubelet
I0915 06:37:46.759476 3199412 kubeadm.go:582] duration metric: took 57.909470014s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0915 06:37:46.759496 3199412 node_conditions.go:102] verifying NodePressure condition ...
I0915 06:37:46.940161 3199412 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0915 06:37:46.940195 3199412 node_conditions.go:123] node cpu capacity is 2
I0915 06:37:46.940208 3199412 node_conditions.go:105] duration metric: took 180.706723ms to run NodePressure ...
I0915 06:37:46.940239 3199412 start.go:241] waiting for startup goroutines ...
I0915 06:37:47.076163 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:47.170185 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:47.172081 3199412 kapi.go:107] duration metric: took 48.006211941s to wait for kubernetes.io/minikube-addons=registry ...
I0915 06:37:47.650058 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:47.669350 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:48.076264 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:48.169248 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:48.576216 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:48.668660 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:49.076783 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:49.169896 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:49.649488 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:49.668157 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:50.082102 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:50.170074 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:50.575481 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:50.668295 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:51.084553 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:51.169882 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:51.577160 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:51.678944 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:52.150512 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:52.168377 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:52.576003 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:52.669092 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:53.075814 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:53.169193 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:53.576022 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:53.668612 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:54.075077 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:54.170894 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:54.651344 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:54.668854 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:55.078939 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:55.169335 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:55.576122 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:55.668969 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:56.077167 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:56.168559 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:56.576981 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:56.668234 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:57.153910 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:57.168808 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:57.575491 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:57.669067 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:58.077263 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:58.168597 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:58.575769 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:58.669301 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:59.076798 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:59.173214 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:37:59.576352 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:37:59.670504 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:00.125970 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:00.186325 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:00.575219 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:00.668843 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:01.076038 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:01.169743 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:01.575925 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:01.669120 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:02.076595 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:02.169737 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:02.576094 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:02.669068 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:03.075493 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:03.169117 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:03.575749 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:03.669430 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:04.076818 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:04.169064 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:04.650727 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:04.671403 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:05.076941 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:05.168884 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:05.576471 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:05.668761 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:06.081373 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:06.168487 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:06.583720 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:06.670753 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:07.079503 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:07.168929 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:07.576388 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:07.669730 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:08.076777 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:08.168881 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:08.575586 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:08.668414 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:09.076812 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:09.172132 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:09.575920 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:09.669108 3199412 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0915 06:38:10.079432 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:10.171436 3199412 kapi.go:107] duration metric: took 1m11.00744972s to wait for app.kubernetes.io/name=ingress-nginx ...
I0915 06:38:10.575999 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:11.089591 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:11.577210 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:12.075593 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:12.577758 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:13.076363 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:13.650801 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:14.076100 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:14.576409 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:15.076364 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:15.575104 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:16.075118 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:16.576855 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:17.075899 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0915 06:38:17.575495 3199412 kapi.go:107] duration metric: took 1m17.504943727s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0915 06:38:24.547544 3199412 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0915 06:38:24.547572 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:25.048233 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:25.549328 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:26.048480 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:26.547557 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:27.047068 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:27.547945 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:28.048123 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:28.547967 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:29.048031 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:29.547992 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:30.048682 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:30.549481 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:31.047918 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:31.546805 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:32.048024 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:32.547839 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:33.047790 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:33.547316 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:34.048226 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:34.548024 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:35.047610 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:35.547310 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:36.047641 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:36.547077 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:37.047832 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:37.547469 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:38.048705 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:38.547532 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:39.047646 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:39.547450 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:40.048068 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:40.548100 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:41.047679 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:41.547509 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:42.047522 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:42.547554 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:43.048654 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:43.547238 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:44.049123 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:44.548481 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:45.047616 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:45.547943 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:46.048248 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:46.548304 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:47.047904 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:47.547471 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:48.047799 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:48.551027 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:49.048332 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:49.547580 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:50.047718 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:50.547430 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:51.047960 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:51.547907 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:52.048115 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:52.548008 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:53.047975 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:53.547883 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:54.047668 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:54.547333 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:55.047983 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:55.547417 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:56.048117 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:56.548196 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:57.048043 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:57.548090 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:58.048440 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:58.546895 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:59.047856 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:38:59.547363 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:00.065656 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:00.548966 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:01.047095 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:01.547414 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:02.047479 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:02.547108 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:03.047822 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:03.547192 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:04.047800 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:04.548259 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:05.048567 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:05.548377 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:06.048133 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:06.547721 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:07.047972 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:07.547706 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:08.047595 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:08.548042 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:09.047824 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:09.550068 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:10.048187 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:10.547548 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:11.047385 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:11.548103 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:12.048217 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:12.547743 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:13.047417 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:13.547325 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:14.047847 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:14.548203 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:15.048149 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:15.547177 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:16.048433 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:16.547791 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:17.047344 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:17.547980 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:18.048559 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:18.547828 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:19.047927 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:19.548152 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:20.047742 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:20.548639 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:21.047936 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:21.547466 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:22.047509 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:22.547504 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:23.047644 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:23.547361 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:24.047991 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:24.547922 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:25.048154 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:25.547842 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:26.048578 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:26.547894 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:27.047711 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:27.547252 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:28.049107 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:28.547681 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:29.047688 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:29.548164 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:30.066449 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:30.547591 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:31.048603 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:31.555848 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:32.047570 3199412 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0915 06:39:32.548006 3199412 kapi.go:107] duration metric: took 2m31.004124137s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0915 06:39:32.550770 3199412 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-686490 cluster.
I0915 06:39:32.553267 3199412 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0915 06:39:32.555805 3199412 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0915 06:39:32.558462 3199412 out.go:177] * Enabled addons: cloud-spanner, storage-provisioner-rancher, storage-provisioner, ingress-dns, nvidia-device-plugin, volcano, metrics-server, inspektor-gadget, yakd, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth
I0915 06:39:32.561201 3199412 addons.go:510] duration metric: took 2m43.710856295s for enable addons: enabled=[cloud-spanner storage-provisioner-rancher storage-provisioner ingress-dns nvidia-device-plugin volcano metrics-server inspektor-gadget yakd volumesnapshots registry ingress csi-hostpath-driver gcp-auth]
I0915 06:39:32.561260 3199412 start.go:246] waiting for cluster config update ...
I0915 06:39:32.561283 3199412 start.go:255] writing updated cluster config ...
I0915 06:39:32.562045 3199412 ssh_runner.go:195] Run: rm -f paused
I0915 06:39:32.912490 3199412 start.go:600] kubectl: 1.31.0, cluster: 1.31.1 (minor skew: 0)
I0915 06:39:32.915237 3199412 out.go:177] * Done! kubectl is now configured to use "addons-686490" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
c9d9d48efc885 4f725bf50aaa5 2 minutes ago Exited gadget 5 36c61f5c6a503 gadget-jhcdf
653bd458ed033 6ef582f3ec844 3 minutes ago Running gcp-auth 0 d0eb6e32e5cb7 gcp-auth-89d5ffd79-58ldw
7974c1bd19796 ee6d597e62dc8 4 minutes ago Running csi-snapshotter 0 2421c361ad9d0 csi-hostpathplugin-p6nhc
4faab1ef09df7 642ded511e141 4 minutes ago Running csi-provisioner 0 2421c361ad9d0 csi-hostpathplugin-p6nhc
f9989622a02ad 922312104da8a 4 minutes ago Running liveness-probe 0 2421c361ad9d0 csi-hostpathplugin-p6nhc
1104e178bde78 08f6b2990811a 4 minutes ago Running hostpath 0 2421c361ad9d0 csi-hostpathplugin-p6nhc
8917711a03d9a 0107d56dbc0be 4 minutes ago Running node-driver-registrar 0 2421c361ad9d0 csi-hostpathplugin-p6nhc
9f6c8cb2e123f 8b46b1cd48760 4 minutes ago Running admission 0 d56afdcdb2b4e volcano-admission-77d7d48b68-44hlz
6b47f6197e53f 289a818c8d9c5 4 minutes ago Running controller 0 c5d4c77ea9516 ingress-nginx-controller-bc57996ff-4lvvm
bf580ae358fc8 d9c7ad4c226bf 4 minutes ago Running volcano-scheduler 0 26ae849e349fe volcano-scheduler-576bc46687-knjtl
fcd50b579591c 1461903ec4fe9 4 minutes ago Running csi-external-health-monitor-controller 0 2421c361ad9d0 csi-hostpathplugin-p6nhc
dac1698fbdd49 1505f556b3a7b 4 minutes ago Running volcano-controllers 0 720cfb8fd77fa volcano-controllers-56675bb4d5-jx4lp
a7937ffa79bed 487fa743e1e22 4 minutes ago Running csi-resizer 0 06ff23b4ab0b5 csi-hostpath-resizer-0
cdae09ed6e51e 9a80d518f102c 4 minutes ago Running csi-attacher 0 a1755b434c2f3 csi-hostpath-attacher-0
2ad1926faf58d 420193b27261a 4 minutes ago Exited patch 0 4b607360c2072 ingress-nginx-admission-patch-65s9f
a0b39790682b0 7ce2150c8929b 4 minutes ago Running local-path-provisioner 0 01b597175c76b local-path-provisioner-86d989889c-88rv7
979d4c5cc44ed 4d1e5c3e97420 4 minutes ago Running volume-snapshot-controller 0 f5b958989ae7d snapshot-controller-56fcc65765-fw8tc
af94272704f1d 420193b27261a 4 minutes ago Exited create 0 b6524fa430b14 ingress-nginx-admission-create-jphzg
d51b03da586d0 77bdba588b953 4 minutes ago Running yakd 0 7942fd5183f32 yakd-dashboard-67d98fc6b-dms56
97deb3e731e14 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 6959c70919bfe snapshot-controller-56fcc65765-jjw79
2ee6dfb51c298 5548a49bb60ba 5 minutes ago Running metrics-server 0 e04ea30fe333e metrics-server-84c5f94fbc-fpnkx
ccd9a06e377a0 c9cf76bb104e1 5 minutes ago Running registry 0 ce1f9db96919f registry-66c9cd494c-shzcc
861eb816faaf6 a9bac31a5be8d 5 minutes ago Running nvidia-device-plugin-ctr 0 4b86963747396 nvidia-device-plugin-daemonset-w56rc
23a4d02b3eb8c 2f6c962e7b831 5 minutes ago Running coredns 0 5afcc110fe232 coredns-7c65d6cfc9-9mpdr
18b2b4efd729a 3410e1561990a 5 minutes ago Running registry-proxy 0 5915be886ead6 registry-proxy-r5v2g
9ae822402feb9 8be4bcf8ec607 5 minutes ago Running cloud-spanner-emulator 0 bdf73c523051f cloud-spanner-emulator-769b77f747-tgszx
86523a04e0e3f 35508c2f890c4 5 minutes ago Running minikube-ingress-dns 0 e26d4df21cfc9 kube-ingress-dns-minikube
b13f66ecc2185 ba04bb24b9575 5 minutes ago Running storage-provisioner 0 dcc0bfefdc617 storage-provisioner
990aad65ad167 6a23fa8fd2b78 6 minutes ago Running kindnet-cni 0 e22ce6ea535ed kindnet-cj6zz
27fcca6e3bf1a 24a140c548c07 6 minutes ago Running kube-proxy 0 d5041773d116a kube-proxy-2297r
a9606056e5592 279f381cb3736 6 minutes ago Running kube-controller-manager 0 aafb30e1e6544 kube-controller-manager-addons-686490
dc7e13e7f6de4 d3f53a98c0a9d 6 minutes ago Running kube-apiserver 0 429025b5d304b kube-apiserver-addons-686490
46962b840eb53 27e3830e14027 6 minutes ago Running etcd 0 8f63117ab582c etcd-addons-686490
fe25bda02288f 7f8aa378bb47d 6 minutes ago Running kube-scheduler 0 0f1fee5434dbe kube-scheduler-addons-686490
==> containerd <==
Sep 15 06:39:43 addons-686490 containerd[810]: time="2024-09-15T06:39:43.513080912Z" level=info msg="RemovePodSandbox \"7d133cd2471f829886059309419da00ce8a1883549da6f2612b032d6e5e1fe5f\" returns successfully"
Sep 15 06:40:10 addons-686490 containerd[810]: time="2024-09-15T06:40:10.410577078Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\""
Sep 15 06:40:10 addons-686490 containerd[810]: time="2024-09-15T06:40:10.538318923Z" level=info msg="ImageUpdate event name:\"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
Sep 15 06:40:10 addons-686490 containerd[810]: time="2024-09-15T06:40:10.540091806Z" level=info msg="stop pulling image ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec: active requests=0, bytes read=89"
Sep 15 06:40:10 addons-686490 containerd[810]: time="2024-09-15T06:40:10.543874892Z" level=info msg="Pulled image \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" with image id \"sha256:4f725bf50aaa5c697fbb84c107e9c7a3766f0f85f514ffce712d03ee5f62e8dd\", repo tag \"\", repo digest \"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\", size \"72524105\" in 133.247ms"
Sep 15 06:40:10 addons-686490 containerd[810]: time="2024-09-15T06:40:10.543927494Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" returns image reference \"sha256:4f725bf50aaa5c697fbb84c107e9c7a3766f0f85f514ffce712d03ee5f62e8dd\""
Sep 15 06:40:10 addons-686490 containerd[810]: time="2024-09-15T06:40:10.546013649Z" level=info msg="CreateContainer within sandbox \"36c61f5c6a503c155b239d8f871495fb735f1075e0e48a160ecccc35abf4c5fd\" for container &ContainerMetadata{Name:gadget,Attempt:5,}"
Sep 15 06:40:10 addons-686490 containerd[810]: time="2024-09-15T06:40:10.568125421Z" level=info msg="CreateContainer within sandbox \"36c61f5c6a503c155b239d8f871495fb735f1075e0e48a160ecccc35abf4c5fd\" for &ContainerMetadata{Name:gadget,Attempt:5,} returns container id \"c9d9d48efc885fa19d26d128b432ab78d0cfeca46e58313d2fae9827f55bee87\""
Sep 15 06:40:10 addons-686490 containerd[810]: time="2024-09-15T06:40:10.569736929Z" level=info msg="StartContainer for \"c9d9d48efc885fa19d26d128b432ab78d0cfeca46e58313d2fae9827f55bee87\""
Sep 15 06:40:10 addons-686490 containerd[810]: time="2024-09-15T06:40:10.634414459Z" level=info msg="StartContainer for \"c9d9d48efc885fa19d26d128b432ab78d0cfeca46e58313d2fae9827f55bee87\" returns successfully"
Sep 15 06:40:12 addons-686490 containerd[810]: time="2024-09-15T06:40:12.319524834Z" level=info msg="shim disconnected" id=c9d9d48efc885fa19d26d128b432ab78d0cfeca46e58313d2fae9827f55bee87 namespace=k8s.io
Sep 15 06:40:12 addons-686490 containerd[810]: time="2024-09-15T06:40:12.319592328Z" level=warning msg="cleaning up after shim disconnected" id=c9d9d48efc885fa19d26d128b432ab78d0cfeca46e58313d2fae9827f55bee87 namespace=k8s.io
Sep 15 06:40:12 addons-686490 containerd[810]: time="2024-09-15T06:40:12.319604053Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Sep 15 06:40:12 addons-686490 containerd[810]: time="2024-09-15T06:40:12.493607293Z" level=info msg="RemoveContainer for \"133cc8b3e3497c081bdc1a06347826c8a5407511f87992faca91f48e9be7a83b\""
Sep 15 06:40:12 addons-686490 containerd[810]: time="2024-09-15T06:40:12.502483391Z" level=info msg="RemoveContainer for \"133cc8b3e3497c081bdc1a06347826c8a5407511f87992faca91f48e9be7a83b\" returns successfully"
Sep 15 06:40:43 addons-686490 containerd[810]: time="2024-09-15T06:40:43.517163539Z" level=info msg="RemoveContainer for \"d5a9443847918ce0bb0a2807cf1721bbb631a7bd76885aa347aee60d6d9a1207\""
Sep 15 06:40:43 addons-686490 containerd[810]: time="2024-09-15T06:40:43.524430369Z" level=info msg="RemoveContainer for \"d5a9443847918ce0bb0a2807cf1721bbb631a7bd76885aa347aee60d6d9a1207\" returns successfully"
Sep 15 06:40:43 addons-686490 containerd[810]: time="2024-09-15T06:40:43.526671286Z" level=info msg="StopPodSandbox for \"a4ab4d97e21e8e2ebeaceb85b485dbb63084c06f334ac3d4b73bb7d5bf9d9af3\""
Sep 15 06:40:43 addons-686490 containerd[810]: time="2024-09-15T06:40:43.534536371Z" level=info msg="TearDown network for sandbox \"a4ab4d97e21e8e2ebeaceb85b485dbb63084c06f334ac3d4b73bb7d5bf9d9af3\" successfully"
Sep 15 06:40:43 addons-686490 containerd[810]: time="2024-09-15T06:40:43.534578914Z" level=info msg="StopPodSandbox for \"a4ab4d97e21e8e2ebeaceb85b485dbb63084c06f334ac3d4b73bb7d5bf9d9af3\" returns successfully"
Sep 15 06:40:43 addons-686490 containerd[810]: time="2024-09-15T06:40:43.535107394Z" level=info msg="RemovePodSandbox for \"a4ab4d97e21e8e2ebeaceb85b485dbb63084c06f334ac3d4b73bb7d5bf9d9af3\""
Sep 15 06:40:43 addons-686490 containerd[810]: time="2024-09-15T06:40:43.535148255Z" level=info msg="Forcibly stopping sandbox \"a4ab4d97e21e8e2ebeaceb85b485dbb63084c06f334ac3d4b73bb7d5bf9d9af3\""
Sep 15 06:40:43 addons-686490 containerd[810]: time="2024-09-15T06:40:43.542707624Z" level=info msg="TearDown network for sandbox \"a4ab4d97e21e8e2ebeaceb85b485dbb63084c06f334ac3d4b73bb7d5bf9d9af3\" successfully"
Sep 15 06:40:43 addons-686490 containerd[810]: time="2024-09-15T06:40:43.549393380Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"a4ab4d97e21e8e2ebeaceb85b485dbb63084c06f334ac3d4b73bb7d5bf9d9af3\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Sep 15 06:40:43 addons-686490 containerd[810]: time="2024-09-15T06:40:43.549513049Z" level=info msg="RemovePodSandbox \"a4ab4d97e21e8e2ebeaceb85b485dbb63084c06f334ac3d4b73bb7d5bf9d9af3\" returns successfully"
==> coredns [23a4d02b3eb8cb83c646afb73ef04a60b387546d8486bda03b96cf91b0f86470] <==
[INFO] 10.244.0.2:44893 - 54938 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000053192s
[INFO] 10.244.0.2:60144 - 45849 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.00175919s
[INFO] 10.244.0.2:60144 - 32278 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001563535s
[INFO] 10.244.0.2:57817 - 8991 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000062456s
[INFO] 10.244.0.2:57817 - 53021 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000041139s
[INFO] 10.244.0.2:45062 - 39598 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000099133s
[INFO] 10.244.0.2:45062 - 417 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000060052s
[INFO] 10.244.0.2:42719 - 53996 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.00008063s
[INFO] 10.244.0.2:42719 - 5864 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000285302s
[INFO] 10.244.0.2:43080 - 15970 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000111973s
[INFO] 10.244.0.2:43080 - 2656 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000095957s
[INFO] 10.244.0.2:43551 - 4466 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.003056122s
[INFO] 10.244.0.2:43551 - 16752 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.003061635s
[INFO] 10.244.0.2:50554 - 1527 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000080228s
[INFO] 10.244.0.2:50554 - 59188 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000047917s
[INFO] 10.244.0.24:53225 - 44378 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000219417s
[INFO] 10.244.0.24:32988 - 10458 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000152899s
[INFO] 10.244.0.24:54209 - 36125 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000191356s
[INFO] 10.244.0.24:39981 - 29498 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000091682s
[INFO] 10.244.0.24:40410 - 51144 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000131894s
[INFO] 10.244.0.24:56476 - 9086 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000158979s
[INFO] 10.244.0.24:54250 - 19224 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.003049819s
[INFO] 10.244.0.24:50684 - 459 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.003207025s
[INFO] 10.244.0.24:44202 - 4019 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 610 0.002667969s
[INFO] 10.244.0.24:53907 - 12818 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.00375162s
==> describe nodes <==
Name: addons-686490
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-686490
kubernetes.io/os=linux
minikube.k8s.io/commit=7a3ca67a20528f5dabbb456e8e4ce542b58ef23a
minikube.k8s.io/name=addons-686490
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_15T06_36_44_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-686490
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-686490"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sun, 15 Sep 2024 06:36:40 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-686490
AcquireTime: <unset>
RenewTime: Sun, 15 Sep 2024 06:42:50 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sun, 15 Sep 2024 06:39:48 +0000 Sun, 15 Sep 2024 06:36:37 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sun, 15 Sep 2024 06:39:48 +0000 Sun, 15 Sep 2024 06:36:37 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sun, 15 Sep 2024 06:39:48 +0000 Sun, 15 Sep 2024 06:36:37 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sun, 15 Sep 2024 06:39:48 +0000 Sun, 15 Sep 2024 06:36:41 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-686490
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022304Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022304Ki
pods: 110
System Info:
Machine ID: 5b53861fce9a47bf87d0b484003e7181
System UUID: fd1cc281-9a31-4545-832a-b62369577add
Boot ID: 641d344d-3095-4acf-ad25-2210e6e532b0
Kernel Version: 5.15.0-1069-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.22
Kubelet Version: v1.31.1
Kube-Proxy Version: v1.31.1
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-769b77f747-tgszx 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
gadget gadget-jhcdf 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
gcp-auth gcp-auth-89d5ffd79-58ldw 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m27s
ingress-nginx ingress-nginx-controller-bc57996ff-4lvvm 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 5m55s
kube-system coredns-7c65d6cfc9-9mpdr 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 6m3s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m51s
kube-system csi-hostpathplugin-p6nhc 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system etcd-addons-686490 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 6m8s
kube-system kindnet-cj6zz 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 6m3s
kube-system kube-apiserver-addons-686490 250m (12%) 0 (0%) 0 (0%) 0 (0%) 6m8s
kube-system kube-controller-manager-addons-686490 200m (10%) 0 (0%) 0 (0%) 0 (0%) 6m8s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system kube-proxy-2297r 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m3s
kube-system kube-scheduler-addons-686490 100m (5%) 0 (0%) 0 (0%) 0 (0%) 6m8s
kube-system metrics-server-84c5f94fbc-fpnkx 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 5m57s
kube-system nvidia-device-plugin-daemonset-w56rc 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m
kube-system registry-66c9cd494c-shzcc 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system registry-proxy-r5v2g 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system snapshot-controller-56fcc65765-fw8tc 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
kube-system snapshot-controller-56fcc65765-jjw79 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
local-path-storage local-path-provisioner-86d989889c-88rv7 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
volcano-system volcano-admission-77d7d48b68-44hlz 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
volcano-system volcano-controllers-56675bb4d5-jx4lp 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
volcano-system volcano-scheduler-576bc46687-knjtl 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
yakd-dashboard yakd-dashboard-67d98fc6b-dms56 0 (0%) 0 (0%) 128Mi (1%) 256Mi (3%) 5m56s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%) 100m (5%)
memory 638Mi (8%) 476Mi (6%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m1s kube-proxy
Normal NodeAllocatableEnforced 6m15s kubelet Updated Node Allocatable limit across pods
Warning CgroupV1 6m15s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeHasSufficientMemory 6m15s (x8 over 6m15s) kubelet Node addons-686490 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m15s (x7 over 6m15s) kubelet Node addons-686490 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m15s (x7 over 6m15s) kubelet Node addons-686490 status is now: NodeHasSufficientPID
Normal Starting 6m15s kubelet Starting kubelet.
Normal Starting 6m8s kubelet Starting kubelet.
Warning CgroupV1 6m8s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 6m8s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m8s kubelet Node addons-686490 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m8s kubelet Node addons-686490 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m8s kubelet Node addons-686490 status is now: NodeHasSufficientPID
Normal RegisteredNode 6m4s node-controller Node addons-686490 event: Registered Node addons-686490 in Controller
==> dmesg <==
==> etcd [46962b840eb533ce5bc92b772e8ebe9cfc999364bbb6e9090a71bf9c15c2286e] <==
{"level":"info","ts":"2024-09-15T06:36:37.008531Z","caller":"embed/etcd.go:728","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
{"level":"info","ts":"2024-09-15T06:36:37.008773Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-09-15T06:36:37.008796Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-09-15T06:36:37.008900Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-09-15T06:36:37.008911Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-09-15T06:36:37.679053Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-09-15T06:36:37.679104Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-09-15T06:36:37.679132Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-09-15T06:36:37.679151Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-09-15T06:36:37.679168Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-15T06:36:37.679180Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-09-15T06:36:37.679194Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-15T06:36:37.682328Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-15T06:36:37.683378Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-686490 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-09-15T06:36:37.690865Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-15T06:36:37.691204Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-15T06:36:37.691613Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-15T06:36:37.691903Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-15T06:36:37.692056Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-15T06:36:37.694776Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-15T06:36:37.696084Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-09-15T06:36:37.715921Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-15T06:36:37.717242Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-09-15T06:36:37.723090Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-09-15T06:36:37.723262Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
==> gcp-auth [653bd458ed0330055a6fd515d000358a38068ff11aa00531a0727c03a55f65d5] <==
2024/09/15 06:39:31 GCP Auth Webhook started!
2024/09/15 06:39:49 Ready to marshal response ...
2024/09/15 06:39:49 Ready to write response ...
2024/09/15 06:39:50 Ready to marshal response ...
2024/09/15 06:39:50 Ready to write response ...
==> kernel <==
06:42:51 up 14:25, 0 users, load average: 0.62, 1.72, 2.91
Linux addons-686490 5.15.0-1069-aws #75~20.04.1-Ubuntu SMP Mon Aug 19 16:22:47 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [990aad65ad1672fb0e2565b2f4424df17836e7dbc2aabeaeaf556d800b1c5c98] <==
I0915 06:40:49.920891 1 main.go:299] handling current node
I0915 06:40:59.922171 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0915 06:40:59.922208 1 main.go:299] handling current node
I0915 06:41:09.928044 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0915 06:41:09.928079 1 main.go:299] handling current node
I0915 06:41:19.929637 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0915 06:41:19.929678 1 main.go:299] handling current node
I0915 06:41:29.927116 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0915 06:41:29.927303 1 main.go:299] handling current node
I0915 06:41:39.928938 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0915 06:41:39.928970 1 main.go:299] handling current node
I0915 06:41:49.920708 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0915 06:41:49.920942 1 main.go:299] handling current node
I0915 06:41:59.923832 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0915 06:41:59.923949 1 main.go:299] handling current node
I0915 06:42:09.929081 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0915 06:42:09.929115 1 main.go:299] handling current node
I0915 06:42:19.920890 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0915 06:42:19.921128 1 main.go:299] handling current node
I0915 06:42:29.922954 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0915 06:42:29.922988 1 main.go:299] handling current node
I0915 06:42:39.928765 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0915 06:42:39.928822 1 main.go:299] handling current node
I0915 06:42:49.920574 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0915 06:42:49.920623 1 main.go:299] handling current node
==> kube-apiserver [dc7e13e7f6de4a913fead165eacdb6774ddd2714fd5632f91fce740ebd630e36] <==
E0915 06:38:04.473230 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.101.255.231:443: connect: connection refused" logger="UnhandledError"
W0915 06:38:04.475045 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.103.72.145:443: connect: connection refused
W0915 06:38:04.555528 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.255.231:443: connect: connection refused
E0915 06:38:04.555577 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.101.255.231:443: connect: connection refused" logger="UnhandledError"
W0915 06:38:04.557218 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.103.72.145:443: connect: connection refused
W0915 06:38:05.440452 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.72.145:443: connect: connection refused
W0915 06:38:06.460752 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.72.145:443: connect: connection refused
W0915 06:38:07.537230 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.72.145:443: connect: connection refused
W0915 06:38:08.547835 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.72.145:443: connect: connection refused
W0915 06:38:09.554221 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.72.145:443: connect: connection refused
W0915 06:38:10.619396 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.72.145:443: connect: connection refused
W0915 06:38:11.662850 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.72.145:443: connect: connection refused
W0915 06:38:12.676630 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.72.145:443: connect: connection refused
W0915 06:38:13.685356 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.72.145:443: connect: connection refused
W0915 06:38:14.769820 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.72.145:443: connect: connection refused
W0915 06:38:15.854184 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.72.145:443: connect: connection refused
W0915 06:38:16.868208 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.103.72.145:443: connect: connection refused
W0915 06:38:24.448713 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.255.231:443: connect: connection refused
E0915 06:38:24.448760 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.101.255.231:443: connect: connection refused" logger="UnhandledError"
W0915 06:39:04.483870 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.255.231:443: connect: connection refused
E0915 06:39:04.483921 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.101.255.231:443: connect: connection refused" logger="UnhandledError"
W0915 06:39:04.562494 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.101.255.231:443: connect: connection refused
E0915 06:39:04.562539 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.101.255.231:443: connect: connection refused" logger="UnhandledError"
I0915 06:39:49.462029 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I0915 06:39:49.517849 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
==> kube-controller-manager [a9606056e559245445645aa8736da2bc84aaa350a0f8d8e66223017eae0f7852] <==
I0915 06:39:04.527583 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0915 06:39:04.571245 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0915 06:39:04.580274 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0915 06:39:04.589081 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0915 06:39:04.600836 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0915 06:39:05.290987 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0915 06:39:06.299069 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0915 06:39:06.313125 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0915 06:39:07.307799 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0915 06:39:07.421876 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0915 06:39:07.436652 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0915 06:39:08.313335 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0915 06:39:08.322409 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0915 06:39:08.330317 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0915 06:39:08.444405 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0915 06:39:08.455674 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0915 06:39:08.460649 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0915 06:39:32.414931 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="14.891883ms"
I0915 06:39:32.415638 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="663.124µs"
I0915 06:39:38.027487 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0915 06:39:38.035268 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0915 06:39:38.078668 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0915 06:39:38.087608 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0915 06:39:48.095699 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-686490"
I0915 06:39:49.192774 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="0s"
==> kube-proxy [27fcca6e3bf1ac37b3a6bc5aa262af1fff59dad46bca1f311d9073ca29376cc5] <==
I0915 06:36:49.774611 1 server_linux.go:66] "Using iptables proxy"
I0915 06:36:49.923174 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0915 06:36:49.923252 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0915 06:36:49.982965 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0915 06:36:49.983070 1 server_linux.go:169] "Using iptables Proxier"
I0915 06:36:49.986670 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0915 06:36:49.987096 1 server.go:483] "Version info" version="v1.31.1"
I0915 06:36:49.987111 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0915 06:36:49.992465 1 config.go:199] "Starting service config controller"
I0915 06:36:49.992508 1 shared_informer.go:313] Waiting for caches to sync for service config
I0915 06:36:49.992551 1 config.go:105] "Starting endpoint slice config controller"
I0915 06:36:49.992556 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0915 06:36:49.993373 1 config.go:328] "Starting node config controller"
I0915 06:36:49.993443 1 shared_informer.go:313] Waiting for caches to sync for node config
I0915 06:36:50.095206 1 shared_informer.go:320] Caches are synced for node config
I0915 06:36:50.095252 1 shared_informer.go:320] Caches are synced for service config
I0915 06:36:50.095294 1 shared_informer.go:320] Caches are synced for endpoint slice config
==> kube-scheduler [fe25bda02288fd2b88ac6623c00de8323ddfe28c513e76bd18694e2d9834e228] <==
W0915 06:36:41.053606 1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0915 06:36:41.054643 1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
W0915 06:36:41.053677 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0915 06:36:41.054833 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0915 06:36:41.053737 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0915 06:36:41.055174 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0915 06:36:41.053802 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0915 06:36:41.055328 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
W0915 06:36:41.053864 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0915 06:36:41.055477 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0915 06:36:41.053933 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0915 06:36:41.055708 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0915 06:36:41.053993 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0915 06:36:41.055870 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0915 06:36:41.054039 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0915 06:36:41.056261 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0915 06:36:41.948979 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0915 06:36:41.949027 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0915 06:36:41.952334 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0915 06:36:41.952576 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
W0915 06:36:41.999567 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0915 06:36:41.999625 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0915 06:36:42.356567 1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0915 06:36:42.356616 1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
I0915 06:36:44.034620 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 15 06:40:53 addons-686490 kubelet[1499]: E0915 06:40:53.410896 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-jhcdf_gadget(f2d35f18-8bc4-4f2d-95fe-ec00bf377399)\"" pod="gadget/gadget-jhcdf" podUID="f2d35f18-8bc4-4f2d-95fe-ec00bf377399"
Sep 15 06:41:07 addons-686490 kubelet[1499]: I0915 06:41:07.409081 1499 scope.go:117] "RemoveContainer" containerID="c9d9d48efc885fa19d26d128b432ab78d0cfeca46e58313d2fae9827f55bee87"
Sep 15 06:41:07 addons-686490 kubelet[1499]: E0915 06:41:07.409737 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-jhcdf_gadget(f2d35f18-8bc4-4f2d-95fe-ec00bf377399)\"" pod="gadget/gadget-jhcdf" podUID="f2d35f18-8bc4-4f2d-95fe-ec00bf377399"
Sep 15 06:41:20 addons-686490 kubelet[1499]: I0915 06:41:20.408969 1499 scope.go:117] "RemoveContainer" containerID="c9d9d48efc885fa19d26d128b432ab78d0cfeca46e58313d2fae9827f55bee87"
Sep 15 06:41:20 addons-686490 kubelet[1499]: E0915 06:41:20.409199 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-jhcdf_gadget(f2d35f18-8bc4-4f2d-95fe-ec00bf377399)\"" pod="gadget/gadget-jhcdf" podUID="f2d35f18-8bc4-4f2d-95fe-ec00bf377399"
Sep 15 06:41:21 addons-686490 kubelet[1499]: I0915 06:41:21.409862 1499 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-w56rc" secret="" err="secret \"gcp-auth\" not found"
Sep 15 06:41:29 addons-686490 kubelet[1499]: I0915 06:41:29.409463 1499 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-r5v2g" secret="" err="secret \"gcp-auth\" not found"
Sep 15 06:41:30 addons-686490 kubelet[1499]: I0915 06:41:30.409920 1499 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-shzcc" secret="" err="secret \"gcp-auth\" not found"
Sep 15 06:41:35 addons-686490 kubelet[1499]: I0915 06:41:35.410624 1499 scope.go:117] "RemoveContainer" containerID="c9d9d48efc885fa19d26d128b432ab78d0cfeca46e58313d2fae9827f55bee87"
Sep 15 06:41:35 addons-686490 kubelet[1499]: E0915 06:41:35.410816 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-jhcdf_gadget(f2d35f18-8bc4-4f2d-95fe-ec00bf377399)\"" pod="gadget/gadget-jhcdf" podUID="f2d35f18-8bc4-4f2d-95fe-ec00bf377399"
Sep 15 06:41:48 addons-686490 kubelet[1499]: I0915 06:41:48.409700 1499 scope.go:117] "RemoveContainer" containerID="c9d9d48efc885fa19d26d128b432ab78d0cfeca46e58313d2fae9827f55bee87"
Sep 15 06:41:48 addons-686490 kubelet[1499]: E0915 06:41:48.409926 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-jhcdf_gadget(f2d35f18-8bc4-4f2d-95fe-ec00bf377399)\"" pod="gadget/gadget-jhcdf" podUID="f2d35f18-8bc4-4f2d-95fe-ec00bf377399"
Sep 15 06:42:03 addons-686490 kubelet[1499]: I0915 06:42:03.410352 1499 scope.go:117] "RemoveContainer" containerID="c9d9d48efc885fa19d26d128b432ab78d0cfeca46e58313d2fae9827f55bee87"
Sep 15 06:42:03 addons-686490 kubelet[1499]: E0915 06:42:03.411126 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-jhcdf_gadget(f2d35f18-8bc4-4f2d-95fe-ec00bf377399)\"" pod="gadget/gadget-jhcdf" podUID="f2d35f18-8bc4-4f2d-95fe-ec00bf377399"
Sep 15 06:42:14 addons-686490 kubelet[1499]: I0915 06:42:14.409545 1499 scope.go:117] "RemoveContainer" containerID="c9d9d48efc885fa19d26d128b432ab78d0cfeca46e58313d2fae9827f55bee87"
Sep 15 06:42:14 addons-686490 kubelet[1499]: E0915 06:42:14.409764 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-jhcdf_gadget(f2d35f18-8bc4-4f2d-95fe-ec00bf377399)\"" pod="gadget/gadget-jhcdf" podUID="f2d35f18-8bc4-4f2d-95fe-ec00bf377399"
Sep 15 06:42:23 addons-686490 kubelet[1499]: I0915 06:42:23.410347 1499 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-w56rc" secret="" err="secret \"gcp-auth\" not found"
Sep 15 06:42:26 addons-686490 kubelet[1499]: I0915 06:42:26.409134 1499 scope.go:117] "RemoveContainer" containerID="c9d9d48efc885fa19d26d128b432ab78d0cfeca46e58313d2fae9827f55bee87"
Sep 15 06:42:26 addons-686490 kubelet[1499]: E0915 06:42:26.409356 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-jhcdf_gadget(f2d35f18-8bc4-4f2d-95fe-ec00bf377399)\"" pod="gadget/gadget-jhcdf" podUID="f2d35f18-8bc4-4f2d-95fe-ec00bf377399"
Sep 15 06:42:39 addons-686490 kubelet[1499]: I0915 06:42:39.409784 1499 scope.go:117] "RemoveContainer" containerID="c9d9d48efc885fa19d26d128b432ab78d0cfeca46e58313d2fae9827f55bee87"
Sep 15 06:42:39 addons-686490 kubelet[1499]: E0915 06:42:39.409982 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-jhcdf_gadget(f2d35f18-8bc4-4f2d-95fe-ec00bf377399)\"" pod="gadget/gadget-jhcdf" podUID="f2d35f18-8bc4-4f2d-95fe-ec00bf377399"
Sep 15 06:42:42 addons-686490 kubelet[1499]: I0915 06:42:42.409250 1499 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-shzcc" secret="" err="secret \"gcp-auth\" not found"
Sep 15 06:42:43 addons-686490 kubelet[1499]: I0915 06:42:43.410526 1499 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-r5v2g" secret="" err="secret \"gcp-auth\" not found"
Sep 15 06:42:51 addons-686490 kubelet[1499]: I0915 06:42:51.409317 1499 scope.go:117] "RemoveContainer" containerID="c9d9d48efc885fa19d26d128b432ab78d0cfeca46e58313d2fae9827f55bee87"
Sep 15 06:42:51 addons-686490 kubelet[1499]: E0915 06:42:51.409529 1499 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-jhcdf_gadget(f2d35f18-8bc4-4f2d-95fe-ec00bf377399)\"" pod="gadget/gadget-jhcdf" podUID="f2d35f18-8bc4-4f2d-95fe-ec00bf377399"
==> storage-provisioner [b13f66ecc21856df3bb7e5b37f832d2c23a1a4db68cd1e3cbced0bc335b2bdea] <==
I0915 06:36:55.136706 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0915 06:36:55.151728 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0915 06:36:55.151909 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0915 06:36:55.166618 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0915 06:36:55.167169 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"46b310fa-fb06-4f5a-bbe9-8c3c627d8a94", APIVersion:"v1", ResourceVersion:"617", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-686490_4b93a317-ced5-421e-adf6-16b1f6382045 became leader
I0915 06:36:55.167282 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-686490_4b93a317-ced5-421e-adf6-16b1f6382045!
I0915 06:36:55.269943 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-686490_4b93a317-ced5-421e-adf6-16b1f6382045!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-686490 -n addons-686490
helpers_test.go:261: (dbg) Run: kubectl --context addons-686490 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-jphzg ingress-nginx-admission-patch-65s9f test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-686490 describe pod ingress-nginx-admission-create-jphzg ingress-nginx-admission-patch-65s9f test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-686490 describe pod ingress-nginx-admission-create-jphzg ingress-nginx-admission-patch-65s9f test-job-nginx-0: exit status 1 (84.880633ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-jphzg" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-65s9f" not found
Error from server (NotFound): pods "test-job-nginx-0" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-686490 describe pod ingress-nginx-admission-create-jphzg ingress-nginx-admission-patch-65s9f test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (199.93s)