=== RUN TestAddons/serial/Volcano
addons_test.go:897: volcano-scheduler stabilized in 43.422305ms
addons_test.go:913: volcano-controller stabilized in 43.475786ms
addons_test.go:905: volcano-admission stabilized in 43.50781ms
addons_test.go:919: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-576bc46687-4mvft" [6a1b8dd3-abcc-43eb-82ca-2584cf24a122] Running
addons_test.go:919: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.003915741s
addons_test.go:923: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-77d7d48b68-fcqnn" [d0ae9733-17df-47d1-b004-587a8173ed02] Running
addons_test.go:923: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 5.004077168s
addons_test.go:927: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-56675bb4d5-jkmfm" [0cb20d50-f60b-4390-8381-7ddf68ec086c] Running
addons_test.go:927: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.003448303s
addons_test.go:932: (dbg) Run: kubectl --context addons-478069 delete -n volcano-system job volcano-admission-init
addons_test.go:938: (dbg) Run: kubectl --context addons-478069 create -f testdata/vcjob.yaml
addons_test.go:946: (dbg) Run: kubectl --context addons-478069 get vcjob -n my-volcano
addons_test.go:964: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [3bce6481-db8c-4783-a51e-e4547470416c] Pending
helpers_test.go:344: "test-job-nginx-0" [3bce6481-db8c-4783-a51e-e4547470416c] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:964: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:964: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-478069 -n addons-478069
addons_test.go:964: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-09-14 17:43:34.782570467 +0000 UTC m=+431.355119627
addons_test.go:964: (dbg) Run: kubectl --context addons-478069 describe po test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-478069 describe po test-job-nginx-0 -n my-volcano:
Name: test-job-nginx-0
Namespace: my-volcano
Priority: 0
Service Account: default
Node: <none>
Labels: volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations: scheduling.k8s.io/group-name: test-job-2b315aca-09d1-44db-8312-8772c9499b67
volcano.sh/job-name: test-job
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status: Pending
IP:
IPs: <none>
Controlled By: Job/test-job
Containers:
nginx:
Image: nginx:latest
Port: <none>
Host Port: <none>
Command:
sleep
10m
Limits:
cpu: 1
Requests:
cpu: 1
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-mhxfw (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-mhxfw:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 2m58s volcano 0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:964: (dbg) Run: kubectl --context addons-478069 logs test-job-nginx-0 -n my-volcano
addons_test.go:964: (dbg) kubectl --context addons-478069 logs test-job-nginx-0 -n my-volcano:
addons_test.go:965: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-478069
helpers_test.go:235: (dbg) docker inspect addons-478069:
-- stdout --
[
{
"Id": "ed8e76cc3c7d183d06fecead10ac888b4c1e26c69cf90eb908c0ffce13ce0dd9",
"Created": "2024-09-14T17:37:06.163556862Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 299493,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-14T17:37:06.298185215Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:86ef0f8f97fae81f88ea7ff0848cf3d848f7964ac99ca9c948802eb432bfd351",
"ResolvConfPath": "/var/lib/docker/containers/ed8e76cc3c7d183d06fecead10ac888b4c1e26c69cf90eb908c0ffce13ce0dd9/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/ed8e76cc3c7d183d06fecead10ac888b4c1e26c69cf90eb908c0ffce13ce0dd9/hostname",
"HostsPath": "/var/lib/docker/containers/ed8e76cc3c7d183d06fecead10ac888b4c1e26c69cf90eb908c0ffce13ce0dd9/hosts",
"LogPath": "/var/lib/docker/containers/ed8e76cc3c7d183d06fecead10ac888b4c1e26c69cf90eb908c0ffce13ce0dd9/ed8e76cc3c7d183d06fecead10ac888b4c1e26c69cf90eb908c0ffce13ce0dd9-json.log",
"Name": "/addons-478069",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"addons-478069:/var",
"/lib/modules:/lib/modules:ro"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-478069",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/0570847368b3b5ad9aab6a93e9249d44893ae8210c87e6e1fc7f9521f677caba-init/diff:/var/lib/docker/overlay2/bf50794440da861115e50c5b2a7303272c8b338b643d76ff54196910083f51c0/diff",
"MergedDir": "/var/lib/docker/overlay2/0570847368b3b5ad9aab6a93e9249d44893ae8210c87e6e1fc7f9521f677caba/merged",
"UpperDir": "/var/lib/docker/overlay2/0570847368b3b5ad9aab6a93e9249d44893ae8210c87e6e1fc7f9521f677caba/diff",
"WorkDir": "/var/lib/docker/overlay2/0570847368b3b5ad9aab6a93e9249d44893ae8210c87e6e1fc7f9521f677caba/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "volume",
"Name": "addons-478069",
"Source": "/var/lib/docker/volumes/addons-478069/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
}
],
"Config": {
"Hostname": "addons-478069",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-478069",
"name.minikube.sigs.k8s.io": "addons-478069",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "2b696cd2f5489cf35380a05f55026909e5b85f82a135b1e797ae1a66abcf0e5f",
"SandboxKey": "/var/run/docker/netns/2b696cd2f548",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33138"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33139"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33142"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33140"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33141"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-478069": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "9b7424a4f5f768493aa32a50c577ceb2146b191f02559d532a39b6f35b593416",
"EndpointID": "b2716b5ee22b90a06cc8e5628f8200d8e225c0839af8a839360fcdcc6fe32dfe",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-478069",
"ed8e76cc3c7d"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-478069 -n addons-478069
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-478069 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-478069 logs -n 25: (1.638100493s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-078725 | jenkins | v1.34.0 | 14 Sep 24 17:36 UTC | |
| | -p download-only-078725 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 14 Sep 24 17:36 UTC | 14 Sep 24 17:36 UTC |
| delete | -p download-only-078725 | download-only-078725 | jenkins | v1.34.0 | 14 Sep 24 17:36 UTC | 14 Sep 24 17:36 UTC |
| start | -o=json --download-only | download-only-574797 | jenkins | v1.34.0 | 14 Sep 24 17:36 UTC | |
| | -p download-only-574797 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 14 Sep 24 17:36 UTC | 14 Sep 24 17:36 UTC |
| delete | -p download-only-574797 | download-only-574797 | jenkins | v1.34.0 | 14 Sep 24 17:36 UTC | 14 Sep 24 17:36 UTC |
| delete | -p download-only-078725 | download-only-078725 | jenkins | v1.34.0 | 14 Sep 24 17:36 UTC | 14 Sep 24 17:36 UTC |
| delete | -p download-only-574797 | download-only-574797 | jenkins | v1.34.0 | 14 Sep 24 17:36 UTC | 14 Sep 24 17:36 UTC |
| start | --download-only -p | download-docker-877234 | jenkins | v1.34.0 | 14 Sep 24 17:36 UTC | |
| | download-docker-877234 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-877234 | download-docker-877234 | jenkins | v1.34.0 | 14 Sep 24 17:36 UTC | 14 Sep 24 17:36 UTC |
| start | --download-only -p | binary-mirror-941961 | jenkins | v1.34.0 | 14 Sep 24 17:36 UTC | |
| | binary-mirror-941961 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:39039 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-941961 | binary-mirror-941961 | jenkins | v1.34.0 | 14 Sep 24 17:36 UTC | 14 Sep 24 17:36 UTC |
| addons | disable dashboard -p | addons-478069 | jenkins | v1.34.0 | 14 Sep 24 17:36 UTC | |
| | addons-478069 | | | | | |
| addons | enable dashboard -p | addons-478069 | jenkins | v1.34.0 | 14 Sep 24 17:36 UTC | |
| | addons-478069 | | | | | |
| start | -p addons-478069 --wait=true | addons-478069 | jenkins | v1.34.0 | 14 Sep 24 17:36 UTC | 14 Sep 24 17:40 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/14 17:36:40
Running on machine: ip-172-31-31-251
Binary: Built with gc go1.23.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0914 17:36:40.668365 299001 out.go:345] Setting OutFile to fd 1 ...
I0914 17:36:40.668522 299001 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0914 17:36:40.668553 299001 out.go:358] Setting ErrFile to fd 2...
I0914 17:36:40.668559 299001 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0914 17:36:40.668842 299001 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19643-292860/.minikube/bin
I0914 17:36:40.669339 299001 out.go:352] Setting JSON to false
I0914 17:36:40.670252 299001 start.go:129] hostinfo: {"hostname":"ip-172-31-31-251","uptime":4753,"bootTime":1726330648,"procs":171,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1069-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"982e3628-3742-4b3e-bb63-ac1b07660ec7"}
I0914 17:36:40.670329 299001 start.go:139] virtualization:
I0914 17:36:40.672731 299001 out.go:177] * [addons-478069] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0914 17:36:40.674767 299001 out.go:177] - MINIKUBE_LOCATION=19643
I0914 17:36:40.674907 299001 notify.go:220] Checking for updates...
I0914 17:36:40.678601 299001 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0914 17:36:40.680394 299001 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19643-292860/kubeconfig
I0914 17:36:40.682225 299001 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19643-292860/.minikube
I0914 17:36:40.683733 299001 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0914 17:36:40.685380 299001 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0914 17:36:40.687407 299001 driver.go:394] Setting default libvirt URI to qemu:///system
I0914 17:36:40.717264 299001 docker.go:123] docker version: linux-27.2.1:Docker Engine - Community
I0914 17:36:40.717417 299001 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0914 17:36:40.770279 299001 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-14 17:36:40.760663548 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1069-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.2.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0914 17:36:40.770406 299001 docker.go:318] overlay module found
I0914 17:36:40.772812 299001 out.go:177] * Using the docker driver based on user configuration
I0914 17:36:40.774769 299001 start.go:297] selected driver: docker
I0914 17:36:40.774795 299001 start.go:901] validating driver "docker" against <nil>
I0914 17:36:40.774809 299001 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0914 17:36:40.775472 299001 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0914 17:36:40.825216 299001 info.go:266] docker info: {ID:EOU5:DNGX:XN6V:L2FZ:UXRM:5TWK:EVUR:KC2F:GT7Z:Y4O4:GB77:5PD3 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-14 17:36:40.815930277 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1069-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214831104 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-31-251 Labels:[] ExperimentalBuild:false ServerVersion:27.2.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0914 17:36:40.825438 299001 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0914 17:36:40.825676 299001 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0914 17:36:40.827537 299001 out.go:177] * Using Docker driver with root privileges
I0914 17:36:40.829014 299001 cni.go:84] Creating CNI manager for ""
I0914 17:36:40.829086 299001 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0914 17:36:40.829102 299001 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0914 17:36:40.829187 299001 start.go:340] cluster config:
{Name:addons-478069 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-478069 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0914 17:36:40.832108 299001 out.go:177] * Starting "addons-478069" primary control-plane node in "addons-478069" cluster
I0914 17:36:40.834099 299001 cache.go:121] Beginning downloading kic base image for docker with containerd
I0914 17:36:40.835682 299001 out.go:177] * Pulling base image v0.0.45-1726281268-19643 ...
I0914 17:36:40.837247 299001 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0914 17:36:40.837307 299001 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19643-292860/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4
I0914 17:36:40.837319 299001 cache.go:56] Caching tarball of preloaded images
I0914 17:36:40.837344 299001 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e in local docker daemon
I0914 17:36:40.837412 299001 preload.go:172] Found /home/jenkins/minikube-integration/19643-292860/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0914 17:36:40.837423 299001 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on containerd
I0914 17:36:40.837783 299001 profile.go:143] Saving config to /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/config.json ...
I0914 17:36:40.837850 299001 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/config.json: {Name:mk840857e552a068b9fd1b76590de4bec2e8dd2d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:36:40.852405 299001 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e to local cache
I0914 17:36:40.852534 299001 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e in local cache directory
I0914 17:36:40.852560 299001 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e in local cache directory, skipping pull
I0914 17:36:40.852566 299001 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e exists in cache, skipping pull
I0914 17:36:40.852576 299001 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e as a tarball
I0914 17:36:40.852586 299001 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e from local cache
I0914 17:36:58.381571 299001 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e from cached tarball
I0914 17:36:58.381611 299001 cache.go:194] Successfully downloaded all kic artifacts
I0914 17:36:58.381641 299001 start.go:360] acquireMachinesLock for addons-478069: {Name:mk8e0b96f2c9b1092aeb5498cfa5b4404de7ccf5 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0914 17:36:58.381762 299001 start.go:364] duration metric: took 98.396µs to acquireMachinesLock for "addons-478069"
I0914 17:36:58.381794 299001 start.go:93] Provisioning new machine with config: &{Name:addons-478069 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-478069 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0914 17:36:58.381889 299001 start.go:125] createHost starting for "" (driver="docker")
I0914 17:36:58.384115 299001 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0914 17:36:58.384392 299001 start.go:159] libmachine.API.Create for "addons-478069" (driver="docker")
I0914 17:36:58.384429 299001 client.go:168] LocalClient.Create starting
I0914 17:36:58.384548 299001 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19643-292860/.minikube/certs/ca.pem
I0914 17:36:58.743038 299001 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19643-292860/.minikube/certs/cert.pem
I0914 17:36:59.800047 299001 cli_runner.go:164] Run: docker network inspect addons-478069 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0914 17:36:59.818164 299001 cli_runner.go:211] docker network inspect addons-478069 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0914 17:36:59.818258 299001 network_create.go:284] running [docker network inspect addons-478069] to gather additional debugging logs...
I0914 17:36:59.818290 299001 cli_runner.go:164] Run: docker network inspect addons-478069
W0914 17:36:59.834907 299001 cli_runner.go:211] docker network inspect addons-478069 returned with exit code 1
I0914 17:36:59.834940 299001 network_create.go:287] error running [docker network inspect addons-478069]: docker network inspect addons-478069: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-478069 not found
I0914 17:36:59.834954 299001 network_create.go:289] output of [docker network inspect addons-478069]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-478069 not found
** /stderr **
I0914 17:36:59.835056 299001 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0914 17:36:59.852352 299001 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40017fff80}
I0914 17:36:59.852418 299001 network_create.go:124] attempt to create docker network addons-478069 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0914 17:36:59.852491 299001 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-478069 addons-478069
I0914 17:36:59.921116 299001 network_create.go:108] docker network addons-478069 192.168.49.0/24 created
I0914 17:36:59.921153 299001 kic.go:121] calculated static IP "192.168.49.2" for the "addons-478069" container
I0914 17:36:59.921235 299001 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0914 17:36:59.935782 299001 cli_runner.go:164] Run: docker volume create addons-478069 --label name.minikube.sigs.k8s.io=addons-478069 --label created_by.minikube.sigs.k8s.io=true
I0914 17:36:59.951995 299001 oci.go:103] Successfully created a docker volume addons-478069
I0914 17:36:59.952095 299001 cli_runner.go:164] Run: docker run --rm --name addons-478069-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-478069 --entrypoint /usr/bin/test -v addons-478069:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e -d /var/lib
I0914 17:37:02.034791 299001 cli_runner.go:217] Completed: docker run --rm --name addons-478069-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-478069 --entrypoint /usr/bin/test -v addons-478069:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e -d /var/lib: (2.082650467s)
I0914 17:37:02.034832 299001 oci.go:107] Successfully prepared a docker volume addons-478069
I0914 17:37:02.034853 299001 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0914 17:37:02.034873 299001 kic.go:194] Starting extracting preloaded images to volume ...
I0914 17:37:02.034949 299001 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19643-292860/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-478069:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e -I lz4 -xf /preloaded.tar -C /extractDir
I0914 17:37:06.097704 299001 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19643-292860/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-478069:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e -I lz4 -xf /preloaded.tar -C /extractDir: (4.062714924s)
I0914 17:37:06.097737 299001 kic.go:203] duration metric: took 4.06285949s to extract preloaded images to volume ...
W0914 17:37:06.097886 299001 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0914 17:37:06.098009 299001 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0914 17:37:06.149113 299001 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-478069 --name addons-478069 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-478069 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-478069 --network addons-478069 --ip 192.168.49.2 --volume addons-478069:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e
I0914 17:37:06.467268 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Running}}
I0914 17:37:06.486718 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:06.507069 299001 cli_runner.go:164] Run: docker exec addons-478069 stat /var/lib/dpkg/alternatives/iptables
I0914 17:37:06.576507 299001 oci.go:144] the created container "addons-478069" has a running status.
I0914 17:37:06.576537 299001 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa...
I0914 17:37:07.202437 299001 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0914 17:37:07.233368 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:07.264564 299001 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0914 17:37:07.264584 299001 kic_runner.go:114] Args: [docker exec --privileged addons-478069 chown docker:docker /home/docker/.ssh/authorized_keys]
I0914 17:37:07.333026 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:07.359007 299001 machine.go:93] provisionDockerMachine start ...
I0914 17:37:07.359115 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:07.382909 299001 main.go:141] libmachine: Using SSH client type: native
I0914 17:37:07.383220 299001 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x41abe0] 0x41d420 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0914 17:37:07.383238 299001 main.go:141] libmachine: About to run SSH command:
hostname
I0914 17:37:07.539863 299001 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-478069
I0914 17:37:07.539886 299001 ubuntu.go:169] provisioning hostname "addons-478069"
I0914 17:37:07.539953 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:07.562172 299001 main.go:141] libmachine: Using SSH client type: native
I0914 17:37:07.562411 299001 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x41abe0] 0x41d420 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0914 17:37:07.562424 299001 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-478069 && echo "addons-478069" | sudo tee /etc/hostname
I0914 17:37:07.719774 299001 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-478069
I0914 17:37:07.719901 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:07.736314 299001 main.go:141] libmachine: Using SSH client type: native
I0914 17:37:07.736572 299001 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x41abe0] 0x41d420 <nil> [] 0s} 127.0.0.1 33138 <nil> <nil>}
I0914 17:37:07.736595 299001 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-478069' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-478069/g' /etc/hosts;
else
echo '127.0.1.1 addons-478069' | sudo tee -a /etc/hosts;
fi
fi
I0914 17:37:07.875917 299001 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0914 17:37:07.875943 299001 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19643-292860/.minikube CaCertPath:/home/jenkins/minikube-integration/19643-292860/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19643-292860/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19643-292860/.minikube}
I0914 17:37:07.875962 299001 ubuntu.go:177] setting up certificates
I0914 17:37:07.875972 299001 provision.go:84] configureAuth start
I0914 17:37:07.876034 299001 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-478069
I0914 17:37:07.895176 299001 provision.go:143] copyHostCerts
I0914 17:37:07.895319 299001 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19643-292860/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19643-292860/.minikube/ca.pem (1082 bytes)
I0914 17:37:07.895441 299001 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19643-292860/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19643-292860/.minikube/cert.pem (1123 bytes)
I0914 17:37:07.895498 299001 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19643-292860/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19643-292860/.minikube/key.pem (1675 bytes)
I0914 17:37:07.895544 299001 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19643-292860/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19643-292860/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19643-292860/.minikube/certs/ca-key.pem org=jenkins.addons-478069 san=[127.0.0.1 192.168.49.2 addons-478069 localhost minikube]
I0914 17:37:08.475473 299001 provision.go:177] copyRemoteCerts
I0914 17:37:08.475553 299001 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0914 17:37:08.475611 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:08.493517 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:08.592150 299001 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-292860/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0914 17:37:08.615534 299001 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-292860/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0914 17:37:08.638865 299001 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-292860/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0914 17:37:08.662894 299001 provision.go:87] duration metric: took 786.898052ms to configureAuth
I0914 17:37:08.662921 299001 ubuntu.go:193] setting minikube options for container-runtime
I0914 17:37:08.663104 299001 config.go:182] Loaded profile config "addons-478069": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0914 17:37:08.663118 299001 machine.go:96] duration metric: took 1.304090244s to provisionDockerMachine
I0914 17:37:08.663126 299001 client.go:171] duration metric: took 10.278687934s to LocalClient.Create
I0914 17:37:08.663150 299001 start.go:167] duration metric: took 10.278760435s to libmachine.API.Create "addons-478069"
I0914 17:37:08.663166 299001 start.go:293] postStartSetup for "addons-478069" (driver="docker")
I0914 17:37:08.663175 299001 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0914 17:37:08.663232 299001 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0914 17:37:08.663276 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:08.679673 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:08.778003 299001 ssh_runner.go:195] Run: cat /etc/os-release
I0914 17:37:08.781496 299001 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0914 17:37:08.781532 299001 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0914 17:37:08.781544 299001 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0914 17:37:08.781551 299001 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0914 17:37:08.781562 299001 filesync.go:126] Scanning /home/jenkins/minikube-integration/19643-292860/.minikube/addons for local assets ...
I0914 17:37:08.781630 299001 filesync.go:126] Scanning /home/jenkins/minikube-integration/19643-292860/.minikube/files for local assets ...
I0914 17:37:08.781651 299001 start.go:296] duration metric: took 118.479262ms for postStartSetup
I0914 17:37:08.781958 299001 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-478069
I0914 17:37:08.802113 299001 profile.go:143] Saving config to /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/config.json ...
I0914 17:37:08.802412 299001 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0914 17:37:08.802460 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:08.818995 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:08.913196 299001 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0914 17:37:08.918175 299001 start.go:128] duration metric: took 10.536268922s to createHost
I0914 17:37:08.918205 299001 start.go:83] releasing machines lock for "addons-478069", held for 10.536427756s
I0914 17:37:08.918283 299001 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-478069
I0914 17:37:08.934286 299001 ssh_runner.go:195] Run: cat /version.json
I0914 17:37:08.934351 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:08.934629 299001 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0914 17:37:08.934685 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:08.954870 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:08.963747 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:09.047482 299001 ssh_runner.go:195] Run: systemctl --version
I0914 17:37:09.174704 299001 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0914 17:37:09.178976 299001 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0914 17:37:09.204839 299001 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0914 17:37:09.204956 299001 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0914 17:37:09.232928 299001 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0914 17:37:09.232951 299001 start.go:495] detecting cgroup driver to use...
I0914 17:37:09.232984 299001 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0914 17:37:09.233033 299001 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0914 17:37:09.245632 299001 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0914 17:37:09.256700 299001 docker.go:217] disabling cri-docker service (if available) ...
I0914 17:37:09.256765 299001 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0914 17:37:09.270765 299001 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0914 17:37:09.285039 299001 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0914 17:37:09.379359 299001 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0914 17:37:09.470702 299001 docker.go:233] disabling docker service ...
I0914 17:37:09.470784 299001 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0914 17:37:09.490344 299001 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0914 17:37:09.502408 299001 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0914 17:37:09.583393 299001 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0914 17:37:09.662405 299001 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0914 17:37:09.674146 299001 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0914 17:37:09.691121 299001 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0914 17:37:09.701395 299001 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0914 17:37:09.711571 299001 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0914 17:37:09.711687 299001 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0914 17:37:09.721722 299001 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0914 17:37:09.731768 299001 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0914 17:37:09.741923 299001 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0914 17:37:09.752143 299001 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0914 17:37:09.762000 299001 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0914 17:37:09.772132 299001 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0914 17:37:09.782099 299001 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0914 17:37:09.792042 299001 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0914 17:37:09.800606 299001 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0914 17:37:09.808987 299001 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0914 17:37:09.892177 299001 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0914 17:37:10.033375 299001 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0914 17:37:10.033497 299001 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0914 17:37:10.038019 299001 start.go:563] Will wait 60s for crictl version
I0914 17:37:10.038143 299001 ssh_runner.go:195] Run: which crictl
I0914 17:37:10.042355 299001 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0914 17:37:10.083227 299001 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.22
RuntimeApiVersion: v1
I0914 17:37:10.083396 299001 ssh_runner.go:195] Run: containerd --version
I0914 17:37:10.107265 299001 ssh_runner.go:195] Run: containerd --version
I0914 17:37:10.133977 299001 out.go:177] * Preparing Kubernetes v1.31.1 on containerd 1.7.22 ...
I0914 17:37:10.135744 299001 cli_runner.go:164] Run: docker network inspect addons-478069 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0914 17:37:10.152186 299001 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0914 17:37:10.156245 299001 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0914 17:37:10.168428 299001 kubeadm.go:883] updating cluster {Name:addons-478069 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-478069 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0914 17:37:10.168562 299001 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0914 17:37:10.168630 299001 ssh_runner.go:195] Run: sudo crictl images --output json
I0914 17:37:10.206391 299001 containerd.go:627] all images are preloaded for containerd runtime.
I0914 17:37:10.206418 299001 containerd.go:534] Images already preloaded, skipping extraction
I0914 17:37:10.206480 299001 ssh_runner.go:195] Run: sudo crictl images --output json
I0914 17:37:10.243210 299001 containerd.go:627] all images are preloaded for containerd runtime.
I0914 17:37:10.243234 299001 cache_images.go:84] Images are preloaded, skipping loading
I0914 17:37:10.243242 299001 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.1 containerd true true} ...
I0914 17:37:10.243335 299001 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-478069 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:addons-478069 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0914 17:37:10.243422 299001 ssh_runner.go:195] Run: sudo crictl info
I0914 17:37:10.282583 299001 cni.go:84] Creating CNI manager for ""
I0914 17:37:10.282608 299001 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0914 17:37:10.282619 299001 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0914 17:37:10.282642 299001 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-478069 NodeName:addons-478069 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0914 17:37:10.282781 299001 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-478069"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0914 17:37:10.282851 299001 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I0914 17:37:10.291691 299001 binaries.go:44] Found k8s binaries, skipping transfer
I0914 17:37:10.291760 299001 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0914 17:37:10.300291 299001 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I0914 17:37:10.317384 299001 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0914 17:37:10.335889 299001 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
I0914 17:37:10.354455 299001 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0914 17:37:10.357866 299001 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0914 17:37:10.368556 299001 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0914 17:37:10.454002 299001 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0914 17:37:10.470789 299001 certs.go:68] Setting up /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069 for IP: 192.168.49.2
I0914 17:37:10.470812 299001 certs.go:194] generating shared ca certs ...
I0914 17:37:10.470828 299001 certs.go:226] acquiring lock for ca certs: {Name:mkf21090b38f44552475e7c85ae32e95553c36bf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:37:10.470963 299001 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19643-292860/.minikube/ca.key
I0914 17:37:10.973777 299001 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19643-292860/.minikube/ca.crt ...
I0914 17:37:10.973815 299001 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-292860/.minikube/ca.crt: {Name:mk1449f51b33879608b070e037884ff5e0ebe11e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:37:10.974865 299001 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19643-292860/.minikube/ca.key ...
I0914 17:37:10.974883 299001 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-292860/.minikube/ca.key: {Name:mk78bc7c6d76aef14497026104e20eea502af5bb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:37:10.974979 299001 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19643-292860/.minikube/proxy-client-ca.key
I0914 17:37:11.423218 299001 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19643-292860/.minikube/proxy-client-ca.crt ...
I0914 17:37:11.423251 299001 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-292860/.minikube/proxy-client-ca.crt: {Name:mk2b6fb15d6d6c4b404731320caaa17027c6c7d9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:37:11.423437 299001 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19643-292860/.minikube/proxy-client-ca.key ...
I0914 17:37:11.423450 299001 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-292860/.minikube/proxy-client-ca.key: {Name:mk8d81be1193a345a85b6f5690c21a2feb278202 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:37:11.423971 299001 certs.go:256] generating profile certs ...
I0914 17:37:11.424045 299001 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/client.key
I0914 17:37:11.424062 299001 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/client.crt with IP's: []
I0914 17:37:11.679603 299001 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/client.crt ...
I0914 17:37:11.679637 299001 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/client.crt: {Name:mke4aee28c1cf3ba20c56e19917261d4877f19e0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:37:11.679831 299001 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/client.key ...
I0914 17:37:11.679846 299001 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/client.key: {Name:mkb3d17fc6ce64b6376c6e1daba7e7e1f6145d02 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:37:11.680299 299001 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/apiserver.key.e390d6f9
I0914 17:37:11.680324 299001 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/apiserver.crt.e390d6f9 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0914 17:37:12.458085 299001 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/apiserver.crt.e390d6f9 ...
I0914 17:37:12.458118 299001 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/apiserver.crt.e390d6f9: {Name:mkce5d8baf225c5a4224c4644809d5999364983a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:37:12.458313 299001 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/apiserver.key.e390d6f9 ...
I0914 17:37:12.458328 299001 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/apiserver.key.e390d6f9: {Name:mkf4826b29c9624d60668601d4715a7a19a480c1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:37:12.458418 299001 certs.go:381] copying /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/apiserver.crt.e390d6f9 -> /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/apiserver.crt
I0914 17:37:12.458508 299001 certs.go:385] copying /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/apiserver.key.e390d6f9 -> /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/apiserver.key
I0914 17:37:12.458566 299001 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/proxy-client.key
I0914 17:37:12.458588 299001 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/proxy-client.crt with IP's: []
I0914 17:37:13.114473 299001 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/proxy-client.crt ...
I0914 17:37:13.114504 299001 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/proxy-client.crt: {Name:mkeba0a0a399c6fe54368f7079a0a321c896aac3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:37:13.114698 299001 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/proxy-client.key ...
I0914 17:37:13.114713 299001 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/proxy-client.key: {Name:mkcd421c4ffaf705a061af3fe01d942844368092 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:37:13.114922 299001 certs.go:484] found cert: /home/jenkins/minikube-integration/19643-292860/.minikube/certs/ca-key.pem (1679 bytes)
I0914 17:37:13.114964 299001 certs.go:484] found cert: /home/jenkins/minikube-integration/19643-292860/.minikube/certs/ca.pem (1082 bytes)
I0914 17:37:13.114995 299001 certs.go:484] found cert: /home/jenkins/minikube-integration/19643-292860/.minikube/certs/cert.pem (1123 bytes)
I0914 17:37:13.115023 299001 certs.go:484] found cert: /home/jenkins/minikube-integration/19643-292860/.minikube/certs/key.pem (1675 bytes)
I0914 17:37:13.116035 299001 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-292860/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0914 17:37:13.147286 299001 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-292860/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0914 17:37:13.175182 299001 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-292860/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0914 17:37:13.199190 299001 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-292860/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0914 17:37:13.224271 299001 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0914 17:37:13.248935 299001 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0914 17:37:13.273483 299001 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0914 17:37:13.298028 299001 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-292860/.minikube/profiles/addons-478069/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0914 17:37:13.322732 299001 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19643-292860/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0914 17:37:13.347811 299001 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0914 17:37:13.366554 299001 ssh_runner.go:195] Run: openssl version
I0914 17:37:13.372240 299001 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0914 17:37:13.383169 299001 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0914 17:37:13.387425 299001 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 14 17:37 /usr/share/ca-certificates/minikubeCA.pem
I0914 17:37:13.387519 299001 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0914 17:37:13.394932 299001 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0914 17:37:13.405663 299001 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0914 17:37:13.410377 299001 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0914 17:37:13.410458 299001 kubeadm.go:392] StartCluster: {Name:addons-478069 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726281268-19643@sha256:cce8be0c1ac4e3d852132008ef1cc1dcf5b79f708d025db83f146ae65db32e8e Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-478069 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0914 17:37:13.410563 299001 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0914 17:37:13.410656 299001 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0914 17:37:13.456641 299001 cri.go:89] found id: ""
I0914 17:37:13.456740 299001 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0914 17:37:13.465944 299001 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0914 17:37:13.475193 299001 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0914 17:37:13.475284 299001 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0914 17:37:13.484578 299001 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0914 17:37:13.484619 299001 kubeadm.go:157] found existing configuration files:
I0914 17:37:13.484678 299001 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0914 17:37:13.493814 299001 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0914 17:37:13.493878 299001 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0914 17:37:13.502755 299001 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0914 17:37:13.511942 299001 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0914 17:37:13.512086 299001 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0914 17:37:13.520990 299001 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0914 17:37:13.529979 299001 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0914 17:37:13.530048 299001 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0914 17:37:13.538802 299001 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0914 17:37:13.547493 299001 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0914 17:37:13.547581 299001 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0914 17:37:13.556229 299001 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0914 17:37:13.596908 299001 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1
I0914 17:37:13.597007 299001 kubeadm.go:310] [preflight] Running pre-flight checks
I0914 17:37:13.618059 299001 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0914 17:37:13.618138 299001 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1069-aws[0m
I0914 17:37:13.618180 299001 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0914 17:37:13.618230 299001 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0914 17:37:13.618283 299001 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0914 17:37:13.618334 299001 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0914 17:37:13.618385 299001 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0914 17:37:13.618436 299001 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0914 17:37:13.618494 299001 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0914 17:37:13.618544 299001 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0914 17:37:13.618598 299001 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0914 17:37:13.618648 299001 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0914 17:37:13.676646 299001 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0914 17:37:13.676759 299001 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0914 17:37:13.676853 299001 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0914 17:37:13.683994 299001 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0914 17:37:13.687170 299001 out.go:235] - Generating certificates and keys ...
I0914 17:37:13.687373 299001 kubeadm.go:310] [certs] Using existing ca certificate authority
I0914 17:37:13.687474 299001 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0914 17:37:13.950324 299001 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0914 17:37:14.342991 299001 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0914 17:37:14.648711 299001 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0914 17:37:15.611571 299001 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0914 17:37:16.192491 299001 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0914 17:37:16.192665 299001 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-478069 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0914 17:37:16.645774 299001 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0914 17:37:16.646062 299001 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-478069 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0914 17:37:16.826844 299001 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0914 17:37:17.160493 299001 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0914 17:37:17.383392 299001 kubeadm.go:310] [certs] Generating "sa" key and public key
I0914 17:37:17.383755 299001 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0914 17:37:17.651143 299001 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0914 17:37:18.533508 299001 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0914 17:37:18.719685 299001 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0914 17:37:19.358881 299001 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0914 17:37:20.049545 299001 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0914 17:37:20.050432 299001 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0914 17:37:20.055642 299001 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0914 17:37:20.058136 299001 out.go:235] - Booting up control plane ...
I0914 17:37:20.058246 299001 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0914 17:37:20.058322 299001 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0914 17:37:20.059049 299001 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0914 17:37:20.088660 299001 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0914 17:37:20.095742 299001 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0914 17:37:20.095801 299001 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0914 17:37:20.200154 299001 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0914 17:37:20.200284 299001 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0914 17:37:21.200461 299001 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.001955534s
I0914 17:37:21.200558 299001 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0914 17:37:27.202249 299001 kubeadm.go:310] [api-check] The API server is healthy after 6.002063619s
I0914 17:37:27.222002 299001 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0914 17:37:27.241880 299001 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0914 17:37:27.266258 299001 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0914 17:37:27.266454 299001 kubeadm.go:310] [mark-control-plane] Marking the node addons-478069 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0914 17:37:27.277130 299001 kubeadm.go:310] [bootstrap-token] Using token: f1w2qq.0tev7hhiy9xwpuyx
I0914 17:37:27.278977 299001 out.go:235] - Configuring RBAC rules ...
I0914 17:37:27.279095 299001 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0914 17:37:27.284080 299001 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0914 17:37:27.291508 299001 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0914 17:37:27.295300 299001 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0914 17:37:27.300477 299001 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0914 17:37:27.304932 299001 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0914 17:37:27.608930 299001 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0914 17:37:28.043907 299001 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0914 17:37:28.611125 299001 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0914 17:37:28.612293 299001 kubeadm.go:310]
I0914 17:37:28.612373 299001 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0914 17:37:28.612386 299001 kubeadm.go:310]
I0914 17:37:28.612511 299001 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0914 17:37:28.612520 299001 kubeadm.go:310]
I0914 17:37:28.612563 299001 kubeadm.go:310] mkdir -p $HOME/.kube
I0914 17:37:28.612635 299001 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0914 17:37:28.612704 299001 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0914 17:37:28.612712 299001 kubeadm.go:310]
I0914 17:37:28.612775 299001 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0914 17:37:28.612781 299001 kubeadm.go:310]
I0914 17:37:28.612829 299001 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0914 17:37:28.612833 299001 kubeadm.go:310]
I0914 17:37:28.612894 299001 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0914 17:37:28.612977 299001 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0914 17:37:28.613050 299001 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0914 17:37:28.613058 299001 kubeadm.go:310]
I0914 17:37:28.613141 299001 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0914 17:37:28.613222 299001 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0914 17:37:28.613231 299001 kubeadm.go:310]
I0914 17:37:28.613315 299001 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token f1w2qq.0tev7hhiy9xwpuyx \
I0914 17:37:28.613421 299001 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:15d64a7e7cc5fc4dd8f4ac847fe2a40979377325c46fe801f6e1942c93973f3f \
I0914 17:37:28.613446 299001 kubeadm.go:310] --control-plane
I0914 17:37:28.613456 299001 kubeadm.go:310]
I0914 17:37:28.613540 299001 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0914 17:37:28.613547 299001 kubeadm.go:310]
I0914 17:37:28.613628 299001 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token f1w2qq.0tev7hhiy9xwpuyx \
I0914 17:37:28.613734 299001 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:15d64a7e7cc5fc4dd8f4ac847fe2a40979377325c46fe801f6e1942c93973f3f
I0914 17:37:28.617212 299001 kubeadm.go:310] W0914 17:37:13.593101 1034 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0914 17:37:28.617559 299001 kubeadm.go:310] W0914 17:37:13.594168 1034 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0914 17:37:28.617781 299001 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1069-aws\n", err: exit status 1
I0914 17:37:28.617891 299001 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0914 17:37:28.617918 299001 cni.go:84] Creating CNI manager for ""
I0914 17:37:28.617929 299001 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0914 17:37:28.620847 299001 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0914 17:37:28.622739 299001 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0914 17:37:28.626603 299001 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.1/kubectl ...
I0914 17:37:28.626625 299001 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0914 17:37:28.651017 299001 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0914 17:37:28.972990 299001 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0914 17:37:28.973123 299001 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 17:37:28.973204 299001 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-478069 minikube.k8s.io/updated_at=2024_09_14T17_37_28_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=fbeeb744274463b05401c917e5ab21bbaf5ef95a minikube.k8s.io/name=addons-478069 minikube.k8s.io/primary=true
I0914 17:37:29.185957 299001 ops.go:34] apiserver oom_adj: -16
I0914 17:37:29.186119 299001 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 17:37:29.686983 299001 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 17:37:30.186156 299001 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 17:37:30.686687 299001 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 17:37:31.186286 299001 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 17:37:31.686193 299001 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 17:37:32.187110 299001 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 17:37:32.686937 299001 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 17:37:33.186324 299001 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0914 17:37:33.334727 299001 kubeadm.go:1113] duration metric: took 4.361649888s to wait for elevateKubeSystemPrivileges
I0914 17:37:33.334759 299001 kubeadm.go:394] duration metric: took 19.924306238s to StartCluster
I0914 17:37:33.334775 299001 settings.go:142] acquiring lock: {Name:mk211baf85a5d12c53e1bc3687f6aa07604e6004 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:37:33.335474 299001 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19643-292860/kubeconfig
I0914 17:37:33.335943 299001 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19643-292860/kubeconfig: {Name:mke326c789f0dca4467afe86488dc47fc7003eaa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0914 17:37:33.336162 299001 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0914 17:37:33.336181 299001 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0914 17:37:33.336448 299001 config.go:182] Loaded profile config "addons-478069": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0914 17:37:33.336498 299001 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0914 17:37:33.336576 299001 addons.go:69] Setting yakd=true in profile "addons-478069"
I0914 17:37:33.336590 299001 addons.go:234] Setting addon yakd=true in "addons-478069"
I0914 17:37:33.336612 299001 host.go:66] Checking if "addons-478069" exists ...
I0914 17:37:33.337078 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:33.337564 299001 addons.go:69] Setting cloud-spanner=true in profile "addons-478069"
I0914 17:37:33.337570 299001 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-478069"
I0914 17:37:33.337583 299001 addons.go:234] Setting addon cloud-spanner=true in "addons-478069"
I0914 17:37:33.337588 299001 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-478069"
I0914 17:37:33.337607 299001 host.go:66] Checking if "addons-478069" exists ...
I0914 17:37:33.337611 299001 host.go:66] Checking if "addons-478069" exists ...
I0914 17:37:33.338022 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:33.338079 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:33.341681 299001 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-478069"
I0914 17:37:33.341747 299001 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-478069"
I0914 17:37:33.341785 299001 host.go:66] Checking if "addons-478069" exists ...
I0914 17:37:33.342258 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:33.344644 299001 out.go:177] * Verifying Kubernetes components...
I0914 17:37:33.344813 299001 addons.go:69] Setting registry=true in profile "addons-478069"
I0914 17:37:33.350649 299001 addons.go:234] Setting addon registry=true in "addons-478069"
I0914 17:37:33.350694 299001 host.go:66] Checking if "addons-478069" exists ...
I0914 17:37:33.351176 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:33.352212 299001 addons.go:69] Setting default-storageclass=true in profile "addons-478069"
I0914 17:37:33.352288 299001 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-478069"
I0914 17:37:33.352681 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:33.344829 299001 addons.go:69] Setting storage-provisioner=true in profile "addons-478069"
I0914 17:37:33.364856 299001 addons.go:234] Setting addon storage-provisioner=true in "addons-478069"
I0914 17:37:33.364898 299001 host.go:66] Checking if "addons-478069" exists ...
I0914 17:37:33.365501 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:33.376365 299001 addons.go:69] Setting gcp-auth=true in profile "addons-478069"
I0914 17:37:33.376461 299001 mustload.go:65] Loading cluster: addons-478069
I0914 17:37:33.376699 299001 config.go:182] Loaded profile config "addons-478069": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0914 17:37:33.377010 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:33.344836 299001 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-478069"
I0914 17:37:33.377462 299001 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-478069"
I0914 17:37:33.377756 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:33.344843 299001 addons.go:69] Setting volcano=true in profile "addons-478069"
I0914 17:37:33.391058 299001 addons.go:234] Setting addon volcano=true in "addons-478069"
I0914 17:37:33.391106 299001 host.go:66] Checking if "addons-478069" exists ...
I0914 17:37:33.344848 299001 addons.go:69] Setting volumesnapshots=true in profile "addons-478069"
I0914 17:37:33.391854 299001 addons.go:234] Setting addon volumesnapshots=true in "addons-478069"
I0914 17:37:33.391889 299001 host.go:66] Checking if "addons-478069" exists ...
I0914 17:37:33.392304 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:33.392881 299001 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0914 17:37:33.416380 299001 addons.go:69] Setting ingress=true in profile "addons-478069"
I0914 17:37:33.416468 299001 addons.go:234] Setting addon ingress=true in "addons-478069"
I0914 17:37:33.416569 299001 host.go:66] Checking if "addons-478069" exists ...
I0914 17:37:33.417188 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:33.391831 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:33.435854 299001 addons.go:69] Setting ingress-dns=true in profile "addons-478069"
I0914 17:37:33.435914 299001 addons.go:234] Setting addon ingress-dns=true in "addons-478069"
I0914 17:37:33.435989 299001 host.go:66] Checking if "addons-478069" exists ...
I0914 17:37:33.436584 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:33.467699 299001 addons.go:69] Setting inspektor-gadget=true in profile "addons-478069"
I0914 17:37:33.467772 299001 addons.go:234] Setting addon inspektor-gadget=true in "addons-478069"
I0914 17:37:33.467845 299001 host.go:66] Checking if "addons-478069" exists ...
I0914 17:37:33.468373 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:33.487986 299001 addons.go:69] Setting metrics-server=true in profile "addons-478069"
I0914 17:37:33.488025 299001 addons.go:234] Setting addon metrics-server=true in "addons-478069"
I0914 17:37:33.488063 299001 host.go:66] Checking if "addons-478069" exists ...
I0914 17:37:33.488570 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:33.509673 299001 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0914 17:37:33.522162 299001 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0914 17:37:33.522233 299001 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0914 17:37:33.522335 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:33.536248 299001 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0914 17:37:33.537312 299001 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23
I0914 17:37:33.554834 299001 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0914 17:37:33.560804 299001 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0914 17:37:33.577240 299001 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0914 17:37:33.577388 299001 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0914 17:37:33.551375 299001 addons.go:234] Setting addon default-storageclass=true in "addons-478069"
I0914 17:37:33.580037 299001 host.go:66] Checking if "addons-478069" exists ...
I0914 17:37:33.580528 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:33.580791 299001 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0914 17:37:33.580803 299001 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0914 17:37:33.580844 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:33.612048 299001 out.go:177] - Using image docker.io/registry:2.8.3
I0914 17:37:33.613936 299001 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0914 17:37:33.613960 299001 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0914 17:37:33.614026 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:33.628207 299001 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-478069"
I0914 17:37:33.628307 299001 host.go:66] Checking if "addons-478069" exists ...
I0914 17:37:33.628828 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:33.641287 299001 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0914 17:37:33.641307 299001 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0914 17:37:33.641376 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:33.658022 299001 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0914 17:37:33.660391 299001 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0914 17:37:33.663684 299001 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0914 17:37:33.665461 299001 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0914 17:37:33.665573 299001 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0914 17:37:33.667123 299001 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0914 17:37:33.668481 299001 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0914 17:37:33.668541 299001 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0914 17:37:33.669535 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:33.690246 299001 host.go:66] Checking if "addons-478069" exists ...
I0914 17:37:33.669365 299001 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0914 17:37:33.692668 299001 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0914 17:37:33.692738 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:33.695544 299001 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0914 17:37:33.699714 299001 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
I0914 17:37:33.699832 299001 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0914 17:37:33.699890 299001 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0914 17:37:33.705013 299001 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0914 17:37:33.705036 299001 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0914 17:37:33.705099 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:33.705237 299001 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0914 17:37:33.705245 299001 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0914 17:37:33.705282 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:33.741674 299001 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0914 17:37:33.743472 299001 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0914 17:37:33.745944 299001 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0914 17:37:33.745971 299001 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0914 17:37:33.746039 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:33.768014 299001 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0914 17:37:33.768095 299001 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0914 17:37:33.768194 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:33.786033 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:33.786256 299001 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0914 17:37:33.788288 299001 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0914 17:37:33.788410 299001 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0914 17:37:33.790664 299001 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0914 17:37:33.790778 299001 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0914 17:37:33.790803 299001 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0914 17:37:33.790894 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:33.794157 299001 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0914 17:37:33.794180 299001 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0914 17:37:33.794242 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:33.836130 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:33.838998 299001 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0914 17:37:33.841679 299001 out.go:177] - Using image docker.io/busybox:stable
I0914 17:37:33.844582 299001 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0914 17:37:33.844605 299001 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0914 17:37:33.844667 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:33.851841 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:33.889113 299001 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0914 17:37:33.889142 299001 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0914 17:37:33.889206 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:33.902267 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:33.923705 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:33.955266 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:33.956448 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:33.967443 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:33.986344 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:34.008403 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:34.022491 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:34.044348 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:34.050083 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:34.050520 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
W0914 17:37:34.060843 299001 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0914 17:37:34.060875 299001 retry.go:31] will retry after 276.713473ms: ssh: handshake failed: EOF
W0914 17:37:34.341497 299001 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0914 17:37:34.341539 299001 retry.go:31] will retry after 294.509115ms: ssh: handshake failed: EOF
I0914 17:37:34.420072 299001 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0914 17:37:34.420152 299001 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0914 17:37:34.556715 299001 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0914 17:37:34.556781 299001 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0914 17:37:34.579180 299001 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml": (1.242991151s)
I0914 17:37:34.579402 299001 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0914 17:37:34.579509 299001 ssh_runner.go:235] Completed: sudo systemctl daemon-reload: (1.18659812s)
I0914 17:37:34.579580 299001 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0914 17:37:34.670412 299001 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0914 17:37:34.670496 299001 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0914 17:37:34.671194 299001 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0914 17:37:34.674694 299001 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0914 17:37:34.674749 299001 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0914 17:37:34.676758 299001 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0914 17:37:34.676812 299001 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0914 17:37:34.775936 299001 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0914 17:37:34.779933 299001 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0914 17:37:34.780001 299001 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0914 17:37:34.780887 299001 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0914 17:37:34.791937 299001 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0914 17:37:34.796176 299001 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0914 17:37:34.799753 299001 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0914 17:37:34.832274 299001 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0914 17:37:34.846564 299001 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0914 17:37:34.846634 299001 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0914 17:37:34.850887 299001 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0914 17:37:34.850958 299001 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0914 17:37:34.984691 299001 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0914 17:37:34.984712 299001 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0914 17:37:34.995465 299001 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0914 17:37:34.995488 299001 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0914 17:37:35.019931 299001 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0914 17:37:35.019958 299001 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0914 17:37:35.135756 299001 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0914 17:37:35.135823 299001 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0914 17:37:35.208444 299001 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0914 17:37:35.208511 299001 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0914 17:37:35.210694 299001 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0914 17:37:35.210755 299001 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0914 17:37:35.218246 299001 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0914 17:37:35.218311 299001 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0914 17:37:35.223711 299001 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0914 17:37:35.223776 299001 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0914 17:37:35.299751 299001 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0914 17:37:35.299824 299001 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0914 17:37:35.320002 299001 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0914 17:37:35.335790 299001 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0914 17:37:35.335856 299001 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0914 17:37:35.414693 299001 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0914 17:37:35.428276 299001 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0914 17:37:35.428363 299001 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0914 17:37:35.431870 299001 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0914 17:37:35.438466 299001 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0914 17:37:35.438541 299001 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0914 17:37:35.452996 299001 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0914 17:37:35.453082 299001 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0914 17:37:35.530506 299001 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0914 17:37:35.530578 299001 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0914 17:37:35.682274 299001 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0914 17:37:35.719916 299001 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0914 17:37:35.719991 299001 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0914 17:37:35.727293 299001 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0914 17:37:35.727371 299001 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0914 17:37:35.882343 299001 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0914 17:37:35.882440 299001 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0914 17:37:35.909497 299001 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0914 17:37:36.028090 299001 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0914 17:37:36.028160 299001 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0914 17:37:36.111120 299001 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0914 17:37:36.111202 299001 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0914 17:37:36.396211 299001 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0914 17:37:36.413520 299001 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0914 17:37:36.413590 299001 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0914 17:37:36.650906 299001 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0914 17:37:36.651010 299001 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0914 17:37:36.768485 299001 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.188843605s)
I0914 17:37:36.768572 299001 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.189134018s)
I0914 17:37:36.768715 299001 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0914 17:37:36.769545 299001 node_ready.go:35] waiting up to 6m0s for node "addons-478069" to be "Ready" ...
I0914 17:37:36.773736 299001 node_ready.go:49] node "addons-478069" has status "Ready":"True"
I0914 17:37:36.773803 299001 node_ready.go:38] duration metric: took 4.200314ms for node "addons-478069" to be "Ready" ...
I0914 17:37:36.773829 299001 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0914 17:37:36.792875 299001 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-cd7q4" in "kube-system" namespace to be "Ready" ...
I0914 17:37:37.020074 299001 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (2.34881251s)
I0914 17:37:37.146094 299001 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (2.370073026s)
I0914 17:37:37.308509 299001 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-478069" context rescaled to 1 replicas
I0914 17:37:37.342614 299001 pod_ready.go:98] error getting pod "coredns-7c65d6cfc9-cd7q4" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-cd7q4" not found
I0914 17:37:37.342690 299001 pod_ready.go:82] duration metric: took 549.77057ms for pod "coredns-7c65d6cfc9-cd7q4" in "kube-system" namespace to be "Ready" ...
E0914 17:37:37.342717 299001 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-7c65d6cfc9-cd7q4" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-cd7q4" not found
I0914 17:37:37.342758 299001 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-vcslc" in "kube-system" namespace to be "Ready" ...
I0914 17:37:37.399865 299001 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0914 17:37:37.399929 299001 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0914 17:37:37.755475 299001 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0914 17:37:37.755555 299001 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0914 17:37:38.139722 299001 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0914 17:37:38.576191 299001 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (3.795239975s)
I0914 17:37:39.362599 299001 pod_ready.go:103] pod "coredns-7c65d6cfc9-vcslc" in "kube-system" namespace has status "Ready":"False"
I0914 17:37:40.900628 299001 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0914 17:37:40.900778 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:40.931670 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:41.206803 299001 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0914 17:37:41.341380 299001 addons.go:234] Setting addon gcp-auth=true in "addons-478069"
I0914 17:37:41.341433 299001 host.go:66] Checking if "addons-478069" exists ...
I0914 17:37:41.341980 299001 cli_runner.go:164] Run: docker container inspect addons-478069 --format={{.State.Status}}
I0914 17:37:41.372392 299001 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0914 17:37:41.372452 299001 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-478069
I0914 17:37:41.399628 299001 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33138 SSHKeyPath:/home/jenkins/minikube-integration/19643-292860/.minikube/machines/addons-478069/id_rsa Username:docker}
I0914 17:37:41.849564 299001 pod_ready.go:103] pod "coredns-7c65d6cfc9-vcslc" in "kube-system" namespace has status "Ready":"False"
I0914 17:37:43.701014 299001 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (8.908991718s)
I0914 17:37:43.701260 299001 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (8.905019416s)
I0914 17:37:43.701297 299001 addons.go:475] Verifying addon ingress=true in "addons-478069"
I0914 17:37:43.701622 299001 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (8.901793688s)
I0914 17:37:43.701775 299001 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (8.869415993s)
I0914 17:37:43.702155 299001 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (8.382078747s)
I0914 17:37:43.702511 299001 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.287735352s)
I0914 17:37:43.702581 299001 addons.go:475] Verifying addon metrics-server=true in "addons-478069"
I0914 17:37:43.702682 299001 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (8.270739134s)
I0914 17:37:43.702726 299001 addons.go:475] Verifying addon registry=true in "addons-478069"
I0914 17:37:43.703545 299001 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (8.021181895s)
W0914 17:37:43.705335 299001 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0914 17:37:43.705370 299001 retry.go:31] will retry after 193.124491ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0914 17:37:43.703632 299001 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (7.794024839s)
I0914 17:37:43.703723 299001 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (7.307437935s)
I0914 17:37:43.706608 299001 out.go:177] * Verifying ingress addon...
I0914 17:37:43.709318 299001 out.go:177] * Verifying registry addon...
I0914 17:37:43.710916 299001 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-478069 service yakd-dashboard -n yakd-dashboard
I0914 17:37:43.712036 299001 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0914 17:37:43.715328 299001 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
W0914 17:37:43.740986 299001 out.go:270] ! Enabling 'storage-provisioner-rancher' returned an error: running callbacks: [Error making local-path the default storage class: Error while marking storage class local-path as default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
I0914 17:37:43.766426 299001 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0914 17:37:43.766530 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:43.767363 299001 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0914 17:37:43.767427 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:43.898898 299001 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0914 17:37:43.906736 299001 pod_ready.go:103] pod "coredns-7c65d6cfc9-vcslc" in "kube-system" namespace has status "Ready":"False"
I0914 17:37:44.218780 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:44.220045 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:44.542223 299001 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.40245532s)
I0914 17:37:44.542379 299001 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-478069"
I0914 17:37:44.542328 299001 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.169912309s)
I0914 17:37:44.544386 299001 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0914 17:37:44.544498 299001 out.go:177] * Verifying csi-hostpath-driver addon...
I0914 17:37:44.546424 299001 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0914 17:37:44.547370 299001 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0914 17:37:44.548686 299001 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0914 17:37:44.548737 299001 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0914 17:37:44.557737 299001 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0914 17:37:44.557817 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:44.591739 299001 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0914 17:37:44.591813 299001 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0914 17:37:44.662999 299001 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0914 17:37:44.663070 299001 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0914 17:37:44.714985 299001 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0914 17:37:44.730995 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:44.731329 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:45.075750 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:45.220025 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:45.222067 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:45.552925 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:45.680596 299001 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.7815613s)
I0914 17:37:45.719358 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:45.719786 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:45.893871 299001 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.17878592s)
I0914 17:37:45.897268 299001 addons.go:475] Verifying addon gcp-auth=true in "addons-478069"
I0914 17:37:45.899529 299001 out.go:177] * Verifying gcp-auth addon...
I0914 17:37:45.902703 299001 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0914 17:37:45.907676 299001 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0914 17:37:46.052509 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:46.218243 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:46.220342 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:46.349837 299001 pod_ready.go:103] pod "coredns-7c65d6cfc9-vcslc" in "kube-system" namespace has status "Ready":"False"
I0914 17:37:46.553522 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:46.718494 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:46.721931 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:47.053532 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:47.219983 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:47.222371 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:47.553846 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:47.720684 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:47.723812 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:48.053677 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:48.223264 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:48.223928 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:48.357638 299001 pod_ready.go:103] pod "coredns-7c65d6cfc9-vcslc" in "kube-system" namespace has status "Ready":"False"
I0914 17:37:48.553423 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:48.718267 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:48.719327 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:49.054465 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:49.226910 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:49.228038 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:49.350216 299001 pod_ready.go:93] pod "coredns-7c65d6cfc9-vcslc" in "kube-system" namespace has status "Ready":"True"
I0914 17:37:49.350288 299001 pod_ready.go:82] duration metric: took 12.007494807s for pod "coredns-7c65d6cfc9-vcslc" in "kube-system" namespace to be "Ready" ...
I0914 17:37:49.350315 299001 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-478069" in "kube-system" namespace to be "Ready" ...
I0914 17:37:49.356436 299001 pod_ready.go:93] pod "etcd-addons-478069" in "kube-system" namespace has status "Ready":"True"
I0914 17:37:49.356510 299001 pod_ready.go:82] duration metric: took 6.173145ms for pod "etcd-addons-478069" in "kube-system" namespace to be "Ready" ...
I0914 17:37:49.356539 299001 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-478069" in "kube-system" namespace to be "Ready" ...
I0914 17:37:49.362283 299001 pod_ready.go:93] pod "kube-apiserver-addons-478069" in "kube-system" namespace has status "Ready":"True"
I0914 17:37:49.362355 299001 pod_ready.go:82] duration metric: took 5.794413ms for pod "kube-apiserver-addons-478069" in "kube-system" namespace to be "Ready" ...
I0914 17:37:49.362382 299001 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-478069" in "kube-system" namespace to be "Ready" ...
I0914 17:37:49.371509 299001 pod_ready.go:93] pod "kube-controller-manager-addons-478069" in "kube-system" namespace has status "Ready":"True"
I0914 17:37:49.371584 299001 pod_ready.go:82] duration metric: took 9.179302ms for pod "kube-controller-manager-addons-478069" in "kube-system" namespace to be "Ready" ...
I0914 17:37:49.371633 299001 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-rnn2j" in "kube-system" namespace to be "Ready" ...
I0914 17:37:49.378675 299001 pod_ready.go:93] pod "kube-proxy-rnn2j" in "kube-system" namespace has status "Ready":"True"
I0914 17:37:49.378748 299001 pod_ready.go:82] duration metric: took 7.079711ms for pod "kube-proxy-rnn2j" in "kube-system" namespace to be "Ready" ...
I0914 17:37:49.378788 299001 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-478069" in "kube-system" namespace to be "Ready" ...
I0914 17:37:49.552774 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:49.717840 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:49.719786 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:49.747164 299001 pod_ready.go:93] pod "kube-scheduler-addons-478069" in "kube-system" namespace has status "Ready":"True"
I0914 17:37:49.747241 299001 pod_ready.go:82] duration metric: took 368.425694ms for pod "kube-scheduler-addons-478069" in "kube-system" namespace to be "Ready" ...
I0914 17:37:49.747271 299001 pod_ready.go:79] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-5mrzf" in "kube-system" namespace to be "Ready" ...
I0914 17:37:50.053563 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:50.218512 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:50.225070 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:50.553059 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:50.718027 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:50.721193 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:51.053635 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:51.217779 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:51.219775 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:51.553149 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:51.717308 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:51.719444 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:51.754928 299001 pod_ready.go:103] pod "nvidia-device-plugin-daemonset-5mrzf" in "kube-system" namespace has status "Ready":"False"
I0914 17:37:52.053295 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:52.221134 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:52.224114 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:52.553703 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:52.718065 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:52.719691 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:53.058435 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:53.220594 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:53.223664 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:53.553153 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:53.718976 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:53.722347 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:54.053694 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:54.220454 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:54.254652 299001 pod_ready.go:103] pod "nvidia-device-plugin-daemonset-5mrzf" in "kube-system" namespace has status "Ready":"False"
I0914 17:37:54.318261 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:54.552569 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:54.717805 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:54.719156 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:55.053261 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:55.218382 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:55.220954 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:55.552341 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:55.720634 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:55.722316 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:56.053903 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:56.219393 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:56.221374 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:56.553282 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:56.717740 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:56.720572 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:56.753912 299001 pod_ready.go:103] pod "nvidia-device-plugin-daemonset-5mrzf" in "kube-system" namespace has status "Ready":"False"
I0914 17:37:57.053321 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:57.220864 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:57.221865 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:57.553308 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:57.719996 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:57.721765 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:58.056111 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:58.219734 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:58.222480 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:58.552654 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:58.720503 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:58.720589 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:59.053302 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:59.218426 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:59.220122 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:37:59.254074 299001 pod_ready.go:103] pod "nvidia-device-plugin-daemonset-5mrzf" in "kube-system" namespace has status "Ready":"False"
I0914 17:37:59.554833 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:37:59.717745 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:37:59.719771 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:00.098609 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:00.239905 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:00.247063 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:00.554768 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:00.717762 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:00.721223 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:01.052697 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:01.218813 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:01.221549 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:01.552804 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:01.720008 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:01.720908 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:01.754686 299001 pod_ready.go:93] pod "nvidia-device-plugin-daemonset-5mrzf" in "kube-system" namespace has status "Ready":"True"
I0914 17:38:01.754714 299001 pod_ready.go:82] duration metric: took 12.007420705s for pod "nvidia-device-plugin-daemonset-5mrzf" in "kube-system" namespace to be "Ready" ...
I0914 17:38:01.754725 299001 pod_ready.go:39] duration metric: took 24.980870118s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0914 17:38:01.754787 299001 api_server.go:52] waiting for apiserver process to appear ...
I0914 17:38:01.754869 299001 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0914 17:38:01.770265 299001 api_server.go:72] duration metric: took 28.434055187s to wait for apiserver process to appear ...
I0914 17:38:01.770292 299001 api_server.go:88] waiting for apiserver healthz status ...
I0914 17:38:01.770314 299001 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0914 17:38:01.778918 299001 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0914 17:38:01.780212 299001 api_server.go:141] control plane version: v1.31.1
I0914 17:38:01.780242 299001 api_server.go:131] duration metric: took 9.942041ms to wait for apiserver health ...
I0914 17:38:01.780251 299001 system_pods.go:43] waiting for kube-system pods to appear ...
I0914 17:38:01.790092 299001 system_pods.go:59] 18 kube-system pods found
I0914 17:38:01.790132 299001 system_pods.go:61] "coredns-7c65d6cfc9-vcslc" [2baa2871-6788-4717-812d-0c1fe0be866a] Running
I0914 17:38:01.790141 299001 system_pods.go:61] "csi-hostpath-attacher-0" [dc864211-9ffb-404c-8b69-4c76566485be] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0914 17:38:01.790150 299001 system_pods.go:61] "csi-hostpath-resizer-0" [e6b0318b-9c61-4199-9166-fff674ef3cbf] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0914 17:38:01.790158 299001 system_pods.go:61] "csi-hostpathplugin-6qjvq" [ddb25972-ab1e-437f-9a24-9dc8edf3a506] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0914 17:38:01.790163 299001 system_pods.go:61] "etcd-addons-478069" [edd85234-b50b-4947-99dc-8dcc14691779] Running
I0914 17:38:01.790169 299001 system_pods.go:61] "kindnet-skpwn" [98eae4bb-bea8-4536-acf8-a055405f11e8] Running
I0914 17:38:01.790173 299001 system_pods.go:61] "kube-apiserver-addons-478069" [af7a34c3-046c-42a4-9f91-373eb901b1f6] Running
I0914 17:38:01.790177 299001 system_pods.go:61] "kube-controller-manager-addons-478069" [e4ec3e8b-e98e-4d0c-84ed-ebf7b538f10c] Running
I0914 17:38:01.790182 299001 system_pods.go:61] "kube-ingress-dns-minikube" [1022c423-9ec8-4add-9aa7-2c52c8b4fa9b] Running
I0914 17:38:01.790186 299001 system_pods.go:61] "kube-proxy-rnn2j" [ef35e57a-6f40-420c-99e3-15c83c814207] Running
I0914 17:38:01.790191 299001 system_pods.go:61] "kube-scheduler-addons-478069" [ac0a1e3d-ac31-4d68-8588-6505fd024f36] Running
I0914 17:38:01.790197 299001 system_pods.go:61] "metrics-server-84c5f94fbc-hzswq" [17e40b4b-651d-463b-b551-a297450fe05f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0914 17:38:01.790203 299001 system_pods.go:61] "nvidia-device-plugin-daemonset-5mrzf" [07826017-ddb7-43a6-9266-8cc86a3a9114] Running
I0914 17:38:01.790215 299001 system_pods.go:61] "registry-66c9cd494c-z88fn" [5f368de6-9d7a-4369-b81a-e84fc032aa5e] Running
I0914 17:38:01.790221 299001 system_pods.go:61] "registry-proxy-c8cfs" [81b66c2e-ca87-4896-b408-0013c9df1d76] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0914 17:38:01.790227 299001 system_pods.go:61] "snapshot-controller-56fcc65765-4sfpd" [cdfe5e32-0a46-41c9-a77f-1de2fcb0ed44] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0914 17:38:01.790237 299001 system_pods.go:61] "snapshot-controller-56fcc65765-c6vkl" [e99f44b6-f02c-4d1b-8e46-ff1296f1f3c1] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0914 17:38:01.790241 299001 system_pods.go:61] "storage-provisioner" [17dc3e36-c0c4-4a5b-a16c-11163a77284d] Running
I0914 17:38:01.790248 299001 system_pods.go:74] duration metric: took 9.990173ms to wait for pod list to return data ...
I0914 17:38:01.790260 299001 default_sa.go:34] waiting for default service account to be created ...
I0914 17:38:01.792965 299001 default_sa.go:45] found service account: "default"
I0914 17:38:01.792997 299001 default_sa.go:55] duration metric: took 2.724788ms for default service account to be created ...
I0914 17:38:01.793008 299001 system_pods.go:116] waiting for k8s-apps to be running ...
I0914 17:38:01.804813 299001 system_pods.go:86] 18 kube-system pods found
I0914 17:38:01.804860 299001 system_pods.go:89] "coredns-7c65d6cfc9-vcslc" [2baa2871-6788-4717-812d-0c1fe0be866a] Running
I0914 17:38:01.804874 299001 system_pods.go:89] "csi-hostpath-attacher-0" [dc864211-9ffb-404c-8b69-4c76566485be] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0914 17:38:01.804889 299001 system_pods.go:89] "csi-hostpath-resizer-0" [e6b0318b-9c61-4199-9166-fff674ef3cbf] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0914 17:38:01.804903 299001 system_pods.go:89] "csi-hostpathplugin-6qjvq" [ddb25972-ab1e-437f-9a24-9dc8edf3a506] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0914 17:38:01.804916 299001 system_pods.go:89] "etcd-addons-478069" [edd85234-b50b-4947-99dc-8dcc14691779] Running
I0914 17:38:01.804980 299001 system_pods.go:89] "kindnet-skpwn" [98eae4bb-bea8-4536-acf8-a055405f11e8] Running
I0914 17:38:01.804987 299001 system_pods.go:89] "kube-apiserver-addons-478069" [af7a34c3-046c-42a4-9f91-373eb901b1f6] Running
I0914 17:38:01.804995 299001 system_pods.go:89] "kube-controller-manager-addons-478069" [e4ec3e8b-e98e-4d0c-84ed-ebf7b538f10c] Running
I0914 17:38:01.805001 299001 system_pods.go:89] "kube-ingress-dns-minikube" [1022c423-9ec8-4add-9aa7-2c52c8b4fa9b] Running
I0914 17:38:01.805013 299001 system_pods.go:89] "kube-proxy-rnn2j" [ef35e57a-6f40-420c-99e3-15c83c814207] Running
I0914 17:38:01.805022 299001 system_pods.go:89] "kube-scheduler-addons-478069" [ac0a1e3d-ac31-4d68-8588-6505fd024f36] Running
I0914 17:38:01.805030 299001 system_pods.go:89] "metrics-server-84c5f94fbc-hzswq" [17e40b4b-651d-463b-b551-a297450fe05f] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0914 17:38:01.805040 299001 system_pods.go:89] "nvidia-device-plugin-daemonset-5mrzf" [07826017-ddb7-43a6-9266-8cc86a3a9114] Running
I0914 17:38:01.805050 299001 system_pods.go:89] "registry-66c9cd494c-z88fn" [5f368de6-9d7a-4369-b81a-e84fc032aa5e] Running
I0914 17:38:01.805067 299001 system_pods.go:89] "registry-proxy-c8cfs" [81b66c2e-ca87-4896-b408-0013c9df1d76] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0914 17:38:01.805143 299001 system_pods.go:89] "snapshot-controller-56fcc65765-4sfpd" [cdfe5e32-0a46-41c9-a77f-1de2fcb0ed44] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0914 17:38:01.805169 299001 system_pods.go:89] "snapshot-controller-56fcc65765-c6vkl" [e99f44b6-f02c-4d1b-8e46-ff1296f1f3c1] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0914 17:38:01.805178 299001 system_pods.go:89] "storage-provisioner" [17dc3e36-c0c4-4a5b-a16c-11163a77284d] Running
I0914 17:38:01.805187 299001 system_pods.go:126] duration metric: took 12.171905ms to wait for k8s-apps to be running ...
I0914 17:38:01.805199 299001 system_svc.go:44] waiting for kubelet service to be running ....
I0914 17:38:01.805270 299001 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0914 17:38:01.825930 299001 system_svc.go:56] duration metric: took 20.719446ms WaitForService to wait for kubelet
I0914 17:38:01.825976 299001 kubeadm.go:582] duration metric: took 28.489770201s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0914 17:38:01.825999 299001 node_conditions.go:102] verifying NodePressure condition ...
I0914 17:38:01.829548 299001 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0914 17:38:01.829588 299001 node_conditions.go:123] node cpu capacity is 2
I0914 17:38:01.829602 299001 node_conditions.go:105] duration metric: took 3.597156ms to run NodePressure ...
I0914 17:38:01.829615 299001 start.go:241] waiting for startup goroutines ...
I0914 17:38:02.053196 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:02.220615 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:02.221518 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:02.569279 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:02.717631 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:02.719738 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:03.053720 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:03.217947 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:03.219733 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:03.552452 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:03.719426 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:03.719690 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:04.053472 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:04.218286 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:04.221441 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:04.554178 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:04.718244 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:04.719790 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:05.051888 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:05.217202 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:05.219022 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:05.552623 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:05.722054 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:05.722740 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:06.052745 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:06.220180 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:06.221714 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:06.553216 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:06.720107 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:06.720804 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:07.053827 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:07.219641 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:07.221629 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:07.552723 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:07.722928 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:07.725073 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:08.054127 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:08.218636 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:08.220619 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:08.555237 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:08.724852 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:08.725465 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:09.053703 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:09.220218 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:09.220925 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:09.572389 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:09.718585 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:09.721882 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:10.052852 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:10.219272 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:10.220395 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:10.553193 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:10.720766 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:10.721744 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:11.053052 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:11.218166 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:11.220250 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:11.552851 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:11.717112 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:11.720018 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:12.052655 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:12.218099 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:12.219818 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:12.555748 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:12.718282 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:12.720584 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:13.054332 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:13.217332 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:13.219562 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:13.551843 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:13.718880 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:13.722649 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:14.053859 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:14.221378 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:14.222392 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:14.552405 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:14.720333 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:14.720674 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:15.055862 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:15.217381 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:15.219575 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0914 17:38:15.553000 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:15.719362 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:15.721120 299001 kapi.go:107] duration metric: took 32.005807975s to wait for kubernetes.io/minikube-addons=registry ...
I0914 17:38:16.053307 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:16.218999 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:16.612593 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:16.718028 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:17.053348 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:17.218320 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:17.551823 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:17.718585 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:18.052998 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:18.217847 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:18.554243 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:18.721703 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:19.053106 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:19.218082 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:19.567580 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:19.721433 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:20.054010 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:20.217385 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:20.552836 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:20.717924 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:21.053425 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:21.216969 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:21.553233 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:21.720343 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:22.056651 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:22.218094 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:22.552495 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:22.717605 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:23.051989 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:23.217634 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:23.555893 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:23.717259 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:24.052577 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:24.217680 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:24.554787 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:24.718171 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:25.056838 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:25.218448 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:25.554939 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:25.719162 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:26.052142 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:26.218702 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:26.552066 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:26.717175 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:27.053591 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:27.220051 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:27.553538 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:27.717439 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:28.053041 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:28.218071 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:28.556485 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:28.718055 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:29.052793 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:29.218602 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:29.553011 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:29.718726 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:30.102799 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:30.219209 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:30.553168 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:30.719609 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:31.053952 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:31.217896 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:31.552750 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:31.717925 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:32.053609 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:32.222018 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:32.552619 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:32.717965 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:33.053654 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:33.218309 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:33.552454 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:33.717719 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:34.055097 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:34.217060 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:34.552593 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:34.717953 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:35.052298 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:35.217877 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:35.552261 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0914 17:38:35.717919 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:36.052657 299001 kapi.go:107] duration metric: took 51.505280479s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0914 17:38:36.217120 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:36.717633 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:37.218229 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:37.717288 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:38.217436 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:38.717601 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:39.217438 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:39.717219 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:40.217677 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:40.717973 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:41.217127 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:41.717245 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:42.219237 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:42.717902 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:43.217834 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:43.717329 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:44.225133 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:44.718121 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:45.222119 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:45.718097 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:46.217871 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:46.717554 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:47.218687 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:47.718048 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:48.218825 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:48.717153 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:49.218300 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:49.718177 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:50.219733 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:50.718012 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:51.221644 299001 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0914 17:38:51.743427 299001 kapi.go:107] duration metric: took 1m8.031385959s to wait for app.kubernetes.io/name=ingress-nginx ...
I0914 17:39:08.907159 299001 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0914 17:39:08.907189 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:09.407153 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:09.907167 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:10.406846 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:10.906915 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:11.406227 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:11.907899 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:12.406978 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:12.906623 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:13.406037 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:13.907017 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:14.406764 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:14.906499 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:15.407112 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:15.910144 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:16.407116 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:16.907215 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:17.407382 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:17.905975 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:18.407312 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:18.906364 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:19.405699 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:19.906594 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:20.407500 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:20.906558 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:21.406018 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:21.906732 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:22.406793 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:22.907246 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:23.406032 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:23.906132 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:24.407431 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:24.906541 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:25.406707 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:25.907026 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:26.407438 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:26.906715 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:27.406501 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:27.906337 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:28.406290 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:28.906024 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:29.406387 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:29.906402 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:30.406484 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:30.906876 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:31.406770 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:31.907143 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:32.406881 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:32.906779 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:33.406552 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:33.906616 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:34.406493 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:34.906661 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:35.406629 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:35.906776 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:36.406873 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:36.906642 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:37.406543 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:37.907064 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:38.407232 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:38.907332 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:39.406459 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:39.906335 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:40.406121 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:40.907332 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:41.406507 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:41.906404 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:42.406358 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:42.906369 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:43.407928 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:43.907278 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:44.409311 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:44.906529 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:45.406823 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:45.910425 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:46.406330 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:46.906566 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:47.406602 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:47.906187 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:48.407156 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:48.907195 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:49.406616 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:49.907230 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:50.406054 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:50.906105 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:51.406498 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:51.906545 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:52.406283 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:52.905969 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:53.406472 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:53.906633 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:54.407193 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:54.907416 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:55.406552 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:55.907210 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:56.407137 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:56.906922 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:57.406334 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:57.906039 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:58.406334 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:58.906188 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:59.406295 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:39:59.906243 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:00.437683 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:00.907347 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:01.406435 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:01.906262 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:02.406298 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:02.905988 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:03.406732 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:03.906758 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:04.406591 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:04.906668 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:05.407032 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:05.910287 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:06.407232 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:06.906361 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:07.406789 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:07.906306 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:08.406438 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:08.906205 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:09.406919 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:09.906763 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:10.406708 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:10.906806 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:11.406508 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:11.907778 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:12.406358 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:12.906060 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:13.408204 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:13.906247 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:14.406374 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:14.907338 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:15.405926 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:15.906797 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:16.406860 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:16.906843 299001 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0914 17:40:17.406987 299001 kapi.go:107] duration metric: took 2m31.504280752s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0914 17:40:17.408736 299001 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-478069 cluster.
I0914 17:40:17.410465 299001 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0914 17:40:17.412255 299001 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0914 17:40:17.414310 299001 out.go:177] * Enabled addons: cloud-spanner, ingress-dns, storage-provisioner, volcano, nvidia-device-plugin, metrics-server, inspektor-gadget, yakd, default-storageclass, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
I0914 17:40:17.416024 299001 addons.go:510] duration metric: took 2m44.079524301s for enable addons: enabled=[cloud-spanner ingress-dns storage-provisioner volcano nvidia-device-plugin metrics-server inspektor-gadget yakd default-storageclass volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
I0914 17:40:17.416136 299001 start.go:246] waiting for cluster config update ...
I0914 17:40:17.416166 299001 start.go:255] writing updated cluster config ...
I0914 17:40:17.416488 299001 ssh_runner.go:195] Run: rm -f paused
I0914 17:40:17.756768 299001 start.go:600] kubectl: 1.31.0, cluster: 1.31.1 (minor skew: 0)
I0914 17:40:17.758800 299001 out.go:177] * Done! kubectl is now configured to use "addons-478069" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
3cf32c0e8215a 4f725bf50aaa5 2 minutes ago Exited gadget 5 3b183ba736adf gadget-5nf8v
41f8e1ce80fef 6ef582f3ec844 3 minutes ago Running gcp-auth 0 1c86ee7cff57c gcp-auth-89d5ffd79-lb4jk
ef87c30cd92b2 8b46b1cd48760 4 minutes ago Running admission 0 b984a40e03486 volcano-admission-77d7d48b68-fcqnn
59fcbd56249a6 289a818c8d9c5 4 minutes ago Running controller 0 7e4d671ffc242 ingress-nginx-controller-bc57996ff-wb82g
393e555036fa3 ee6d597e62dc8 5 minutes ago Running csi-snapshotter 0 bb8d008916a38 csi-hostpathplugin-6qjvq
e8e91d64c0a45 642ded511e141 5 minutes ago Running csi-provisioner 0 bb8d008916a38 csi-hostpathplugin-6qjvq
ec54ff50fc544 922312104da8a 5 minutes ago Running liveness-probe 0 bb8d008916a38 csi-hostpathplugin-6qjvq
0fb654178d646 08f6b2990811a 5 minutes ago Running hostpath 0 bb8d008916a38 csi-hostpathplugin-6qjvq
2d39241c27d3d 0107d56dbc0be 5 minutes ago Running node-driver-registrar 0 bb8d008916a38 csi-hostpathplugin-6qjvq
4d1c2cf2396ac 9a80d518f102c 5 minutes ago Running csi-attacher 0 2705d6e7f5968 csi-hostpath-attacher-0
8a8ad43317a97 487fa743e1e22 5 minutes ago Running csi-resizer 0 0845abbd6de47 csi-hostpath-resizer-0
7cb93fb966035 420193b27261a 5 minutes ago Exited patch 0 4f16a51663d7f ingress-nginx-admission-patch-nknq9
d63571f6489a6 d9c7ad4c226bf 5 minutes ago Running volcano-scheduler 0 2b0b0ebe6f6da volcano-scheduler-576bc46687-4mvft
4a5ac8ee1add9 1461903ec4fe9 5 minutes ago Running csi-external-health-monitor-controller 0 bb8d008916a38 csi-hostpathplugin-6qjvq
90df0b9d46174 420193b27261a 5 minutes ago Exited create 0 f1f048860ad45 ingress-nginx-admission-create-2c9fn
553418e13c2b5 1505f556b3a7b 5 minutes ago Running volcano-controllers 0 8db410f8c30f1 volcano-controllers-56675bb4d5-jkmfm
efe8f8ba91f7b 3410e1561990a 5 minutes ago Running registry-proxy 0 d65383de5ba01 registry-proxy-c8cfs
7fc75fca7e813 77bdba588b953 5 minutes ago Running yakd 0 3263484e63df0 yakd-dashboard-67d98fc6b-547j8
af3b74f307be4 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 189fe7b3992af snapshot-controller-56fcc65765-4sfpd
966abc687c814 5548a49bb60ba 5 minutes ago Running metrics-server 0 bb9aa91150276 metrics-server-84c5f94fbc-hzswq
0a6ee98dd8a8d 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 3d23d84ae289d snapshot-controller-56fcc65765-c6vkl
192e6a6258dcd 7ce2150c8929b 5 minutes ago Running local-path-provisioner 0 04507bf2b45d4 local-path-provisioner-86d989889c-hz7bq
fcd3ca8f0f4b8 c9cf76bb104e1 5 minutes ago Running registry 0 795e76c50a7f2 registry-66c9cd494c-z88fn
0c7f58447765d a9bac31a5be8d 5 minutes ago Running nvidia-device-plugin-ctr 0 58debe67da51d nvidia-device-plugin-daemonset-5mrzf
3ce6d9c288751 8be4bcf8ec607 5 minutes ago Running cloud-spanner-emulator 0 c460eccce05f9 cloud-spanner-emulator-769b77f747-rgckg
dbfbc7bc7744f 2f6c962e7b831 5 minutes ago Running coredns 0 4db7bf9c989ed coredns-7c65d6cfc9-vcslc
8ae5227d209cf 35508c2f890c4 5 minutes ago Running minikube-ingress-dns 0 7400a7fdab637 kube-ingress-dns-minikube
45fbc1d61fd10 ba04bb24b9575 5 minutes ago Running storage-provisioner 0 357720f9443e8 storage-provisioner
2bb23ab99048f 6a23fa8fd2b78 6 minutes ago Running kindnet-cni 0 daddf749fb331 kindnet-skpwn
3a997b13f73a3 24a140c548c07 6 minutes ago Running kube-proxy 0 dc5c01a23e2c4 kube-proxy-rnn2j
778b641a5b658 7f8aa378bb47d 6 minutes ago Running kube-scheduler 0 055b11fa5de6d kube-scheduler-addons-478069
2e1dc8ae45121 279f381cb3736 6 minutes ago Running kube-controller-manager 0 3d8396438193b kube-controller-manager-addons-478069
27bb9541e4b31 d3f53a98c0a9d 6 minutes ago Running kube-apiserver 0 9c663aaae736e kube-apiserver-addons-478069
857921eb90a12 27e3830e14027 6 minutes ago Running etcd 0 7444fc2e1c53c etcd-addons-478069
==> containerd <==
Sep 14 17:40:28 addons-478069 containerd[820]: time="2024-09-14T17:40:28.039013606Z" level=info msg="RemovePodSandbox \"c91bc5bc7f34b6106aff74ba667f8f36c0a61e06463f1d50ab0a7986e3e22d45\" returns successfully"
Sep 14 17:41:06 addons-478069 containerd[820]: time="2024-09-14T17:41:06.930003077Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\""
Sep 14 17:41:07 addons-478069 containerd[820]: time="2024-09-14T17:41:07.057467296Z" level=info msg="ImageUpdate event name:\"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" labels:{key:\"io.cri-containerd.image\" value:\"managed\"}"
Sep 14 17:41:07 addons-478069 containerd[820]: time="2024-09-14T17:41:07.058995900Z" level=info msg="stop pulling image ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec: active requests=0, bytes read=89"
Sep 14 17:41:07 addons-478069 containerd[820]: time="2024-09-14T17:41:07.062553367Z" level=info msg="Pulled image \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" with image id \"sha256:4f725bf50aaa5c697fbb84c107e9c7a3766f0f85f514ffce712d03ee5f62e8dd\", repo tag \"\", repo digest \"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\", size \"72524105\" in 132.494142ms"
Sep 14 17:41:07 addons-478069 containerd[820]: time="2024-09-14T17:41:07.062627755Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" returns image reference \"sha256:4f725bf50aaa5c697fbb84c107e9c7a3766f0f85f514ffce712d03ee5f62e8dd\""
Sep 14 17:41:07 addons-478069 containerd[820]: time="2024-09-14T17:41:07.065015426Z" level=info msg="CreateContainer within sandbox \"3b183ba736adfc849e8bab9ca1238e2ea995742daddadedcc891230b93b0f105\" for container &ContainerMetadata{Name:gadget,Attempt:5,}"
Sep 14 17:41:07 addons-478069 containerd[820]: time="2024-09-14T17:41:07.081597175Z" level=info msg="CreateContainer within sandbox \"3b183ba736adfc849e8bab9ca1238e2ea995742daddadedcc891230b93b0f105\" for &ContainerMetadata{Name:gadget,Attempt:5,} returns container id \"3cf32c0e8215aac267a517b1b91cd1e439d37d4e4fe188f710722004d8a7d947\""
Sep 14 17:41:07 addons-478069 containerd[820]: time="2024-09-14T17:41:07.082712061Z" level=info msg="StartContainer for \"3cf32c0e8215aac267a517b1b91cd1e439d37d4e4fe188f710722004d8a7d947\""
Sep 14 17:41:07 addons-478069 containerd[820]: time="2024-09-14T17:41:07.136333024Z" level=info msg="StartContainer for \"3cf32c0e8215aac267a517b1b91cd1e439d37d4e4fe188f710722004d8a7d947\" returns successfully"
Sep 14 17:41:08 addons-478069 containerd[820]: time="2024-09-14T17:41:08.737052081Z" level=info msg="shim disconnected" id=3cf32c0e8215aac267a517b1b91cd1e439d37d4e4fe188f710722004d8a7d947 namespace=k8s.io
Sep 14 17:41:08 addons-478069 containerd[820]: time="2024-09-14T17:41:08.737116745Z" level=warning msg="cleaning up after shim disconnected" id=3cf32c0e8215aac267a517b1b91cd1e439d37d4e4fe188f710722004d8a7d947 namespace=k8s.io
Sep 14 17:41:08 addons-478069 containerd[820]: time="2024-09-14T17:41:08.737127584Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Sep 14 17:41:09 addons-478069 containerd[820]: time="2024-09-14T17:41:09.098651711Z" level=info msg="RemoveContainer for \"35e83b817e20222acf1123d48ea92a4f014dedae6f7d14015498ed158c9a9af1\""
Sep 14 17:41:09 addons-478069 containerd[820]: time="2024-09-14T17:41:09.106277487Z" level=info msg="RemoveContainer for \"35e83b817e20222acf1123d48ea92a4f014dedae6f7d14015498ed158c9a9af1\" returns successfully"
Sep 14 17:41:28 addons-478069 containerd[820]: time="2024-09-14T17:41:28.043010707Z" level=info msg="RemoveContainer for \"d43d900122c87be12a2911858547f3747d0b9d4a29a27f0cff155590967e2c01\""
Sep 14 17:41:28 addons-478069 containerd[820]: time="2024-09-14T17:41:28.049396435Z" level=info msg="RemoveContainer for \"d43d900122c87be12a2911858547f3747d0b9d4a29a27f0cff155590967e2c01\" returns successfully"
Sep 14 17:41:28 addons-478069 containerd[820]: time="2024-09-14T17:41:28.051475677Z" level=info msg="StopPodSandbox for \"19c1dd37e03999d41dcf006a7161412930eb50634be2fceb4ce8c7b55bc0a754\""
Sep 14 17:41:28 addons-478069 containerd[820]: time="2024-09-14T17:41:28.059260394Z" level=info msg="TearDown network for sandbox \"19c1dd37e03999d41dcf006a7161412930eb50634be2fceb4ce8c7b55bc0a754\" successfully"
Sep 14 17:41:28 addons-478069 containerd[820]: time="2024-09-14T17:41:28.059300960Z" level=info msg="StopPodSandbox for \"19c1dd37e03999d41dcf006a7161412930eb50634be2fceb4ce8c7b55bc0a754\" returns successfully"
Sep 14 17:41:28 addons-478069 containerd[820]: time="2024-09-14T17:41:28.059915129Z" level=info msg="RemovePodSandbox for \"19c1dd37e03999d41dcf006a7161412930eb50634be2fceb4ce8c7b55bc0a754\""
Sep 14 17:41:28 addons-478069 containerd[820]: time="2024-09-14T17:41:28.059963900Z" level=info msg="Forcibly stopping sandbox \"19c1dd37e03999d41dcf006a7161412930eb50634be2fceb4ce8c7b55bc0a754\""
Sep 14 17:41:28 addons-478069 containerd[820]: time="2024-09-14T17:41:28.067456991Z" level=info msg="TearDown network for sandbox \"19c1dd37e03999d41dcf006a7161412930eb50634be2fceb4ce8c7b55bc0a754\" successfully"
Sep 14 17:41:28 addons-478069 containerd[820]: time="2024-09-14T17:41:28.073998378Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"19c1dd37e03999d41dcf006a7161412930eb50634be2fceb4ce8c7b55bc0a754\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Sep 14 17:41:28 addons-478069 containerd[820]: time="2024-09-14T17:41:28.074106702Z" level=info msg="RemovePodSandbox \"19c1dd37e03999d41dcf006a7161412930eb50634be2fceb4ce8c7b55bc0a754\" returns successfully"
==> coredns [dbfbc7bc7744f555eb1a2ea93ba73a2d22bea0a8eb822d05efaa4800368da6ca] <==
[INFO] 10.244.0.11:37956 - 36503 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000160049s
[INFO] 10.244.0.11:54643 - 4512 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.003146162s
[INFO] 10.244.0.11:54643 - 39844 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002920004s
[INFO] 10.244.0.11:40974 - 48868 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000170781s
[INFO] 10.244.0.11:40974 - 12769 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.00017339s
[INFO] 10.244.0.11:57076 - 64895 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000130035s
[INFO] 10.244.0.11:57076 - 4216 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000933611s
[INFO] 10.244.0.11:53596 - 38219 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000122412s
[INFO] 10.244.0.11:53596 - 19783 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000115561s
[INFO] 10.244.0.11:46907 - 45261 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000075512s
[INFO] 10.244.0.11:46907 - 33230 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000074322s
[INFO] 10.244.0.11:46108 - 12874 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001536941s
[INFO] 10.244.0.11:46108 - 28489 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001914861s
[INFO] 10.244.0.11:51004 - 61420 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000133899s
[INFO] 10.244.0.11:51004 - 27114 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000216927s
[INFO] 10.244.0.24:37783 - 4122 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.00017417s
[INFO] 10.244.0.24:40136 - 17091 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000175893s
[INFO] 10.244.0.24:53867 - 11465 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000139241s
[INFO] 10.244.0.24:55152 - 61531 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.00009207s
[INFO] 10.244.0.24:40894 - 44520 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000302211s
[INFO] 10.244.0.24:59614 - 62019 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000333489s
[INFO] 10.244.0.24:44089 - 15611 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.003823338s
[INFO] 10.244.0.24:35827 - 63465 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.004028514s
[INFO] 10.244.0.24:47010 - 57334 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.002018679s
[INFO] 10.244.0.24:57726 - 57265 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 610 0.001659131s
==> describe nodes <==
Name: addons-478069
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-478069
kubernetes.io/os=linux
minikube.k8s.io/commit=fbeeb744274463b05401c917e5ab21bbaf5ef95a
minikube.k8s.io/name=addons-478069
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_14T17_37_28_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-478069
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-478069"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Sat, 14 Sep 2024 17:37:25 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-478069
AcquireTime: <unset>
RenewTime: Sat, 14 Sep 2024 17:43:26 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Sat, 14 Sep 2024 17:40:31 +0000 Sat, 14 Sep 2024 17:37:22 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Sat, 14 Sep 2024 17:40:31 +0000 Sat, 14 Sep 2024 17:37:22 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Sat, 14 Sep 2024 17:40:31 +0000 Sat, 14 Sep 2024 17:37:22 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Sat, 14 Sep 2024 17:40:31 +0000 Sat, 14 Sep 2024 17:37:25 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-478069
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022296Ki
pods: 110
System Info:
Machine ID: d83bf3c096694a728a1258855dc89bb2
System UUID: 2a358f1a-2c47-4613-9d0f-a6af6be2fae7
Boot ID: 35fd0b1a-e7ce-4152-9f40-0c82d6bd6d43
Kernel Version: 5.15.0-1069-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.22
Kubelet Version: v1.31.1
Kube-Proxy Version: v1.31.1
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-769b77f747-rgckg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m
gadget gadget-5nf8v 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
gcp-auth gcp-auth-89d5ffd79-lb4jk 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m28s
ingress-nginx ingress-nginx-controller-bc57996ff-wb82g 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 5m55s
kube-system coredns-7c65d6cfc9-vcslc 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 6m3s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system csi-hostpathplugin-6qjvq 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system etcd-addons-478069 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 6m8s
kube-system kindnet-skpwn 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 6m3s
kube-system kube-apiserver-addons-478069 250m (12%) 0 (0%) 0 (0%) 0 (0%) 6m8s
kube-system kube-controller-manager-addons-478069 200m (10%) 0 (0%) 0 (0%) 0 (0%) 6m10s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
kube-system kube-proxy-rnn2j 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m3s
kube-system kube-scheduler-addons-478069 100m (5%) 0 (0%) 0 (0%) 0 (0%) 6m8s
kube-system metrics-server-84c5f94fbc-hzswq 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 5m58s
kube-system nvidia-device-plugin-daemonset-5mrzf 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m
kube-system registry-66c9cd494c-z88fn 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system registry-proxy-c8cfs 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
kube-system snapshot-controller-56fcc65765-4sfpd 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
kube-system snapshot-controller-56fcc65765-c6vkl 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m58s
local-path-storage local-path-provisioner-86d989889c-hz7bq 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
volcano-system volcano-admission-77d7d48b68-fcqnn 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
volcano-system volcano-controllers-56675bb4d5-jkmfm 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
volcano-system volcano-scheduler-576bc46687-4mvft 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m53s
yakd-dashboard yakd-dashboard-67d98fc6b-547j8 0 (0%) 0 (0%) 128Mi (1%) 256Mi (3%) 5m56s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%) 100m (5%)
memory 638Mi (8%) 476Mi (6%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m1s kube-proxy
Normal NodeHasSufficientMemory 6m15s (x8 over 6m15s) kubelet Node addons-478069 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m15s (x7 over 6m15s) kubelet Node addons-478069 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m15s (x7 over 6m15s) kubelet Node addons-478069 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 6m15s kubelet Updated Node Allocatable limit across pods
Normal Starting 6m9s kubelet Starting kubelet.
Warning CgroupV1 6m9s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 6m8s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m8s kubelet Node addons-478069 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m8s kubelet Node addons-478069 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m8s kubelet Node addons-478069 status is now: NodeHasSufficientPID
Normal RegisteredNode 6m4s node-controller Node addons-478069 event: Registered Node addons-478069 in Controller
==> dmesg <==
[Sep14 16:17] ACPI: SRAT not present
[ +0.000000] ACPI: SRAT not present
[ +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr
[ +0.014639] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[ +0.450141] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.835490] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.
[ +6.751208] kauditd_printk_skb: 36 callbacks suppressed
[Sep14 16:29] hrtimer: interrupt took 40626028 ns
[Sep14 17:07] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
==> etcd [857921eb90a126898e7cfb94ea3f9b4af89a60c0e640081a20c16cba07e35e33] <==
{"level":"info","ts":"2024-09-14T17:37:21.821741Z","caller":"embed/etcd.go:728","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}
{"level":"info","ts":"2024-09-14T17:37:21.821957Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-09-14T17:37:21.821979Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-09-14T17:37:21.822081Z","caller":"embed/etcd.go:599","msg":"serving peer traffic","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-09-14T17:37:21.822093Z","caller":"embed/etcd.go:571","msg":"cmux::serve","address":"192.168.49.2:2380"}
{"level":"info","ts":"2024-09-14T17:37:22.794984Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-09-14T17:37:22.795209Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-09-14T17:37:22.795335Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-09-14T17:37:22.795422Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-09-14T17:37:22.795498Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-14T17:37:22.795564Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-09-14T17:37:22.795653Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-14T17:37:22.798830Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-14T17:37:22.800268Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-478069 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-09-14T17:37:22.800399Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-14T17:37:22.800829Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-14T17:37:22.801006Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-14T17:37:22.801177Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-14T17:37:22.801304Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-14T17:37:22.802202Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-14T17:37:22.802331Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-09-14T17:37:22.802491Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-09-14T17:37:22.803197Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-14T17:37:22.804206Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-09-14T17:37:22.803207Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
==> gcp-auth [41f8e1ce80fef3ad1b7287ca52d4c33dd2de24a2c40f563c4522c69e6bc0a6da] <==
2024/09/14 17:40:16 GCP Auth Webhook started!
2024/09/14 17:40:34 Ready to marshal response ...
2024/09/14 17:40:34 Ready to write response ...
2024/09/14 17:40:35 Ready to marshal response ...
2024/09/14 17:40:35 Ready to write response ...
==> kernel <==
17:43:36 up 1:26, 0 users, load average: 0.09, 1.23, 2.17
Linux addons-478069 5.15.0-1069-aws #75~20.04.1-Ubuntu SMP Mon Aug 19 16:22:47 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kindnet [2bb23ab99048f2e6b5df785e9959f8ecce57b01cbf773e144018d9344f2ef156] <==
I0914 17:41:35.000625 1 main.go:299] handling current node
I0914 17:41:45.000188 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 17:41:45.000416 1 main.go:299] handling current node
I0914 17:41:54.999977 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 17:41:55.000032 1 main.go:299] handling current node
I0914 17:42:05.008854 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 17:42:05.008911 1 main.go:299] handling current node
I0914 17:42:15.001196 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 17:42:15.001288 1 main.go:299] handling current node
I0914 17:42:25.008673 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 17:42:25.008711 1 main.go:299] handling current node
I0914 17:42:35.000448 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 17:42:35.000483 1 main.go:299] handling current node
I0914 17:42:45.002254 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 17:42:45.002293 1 main.go:299] handling current node
I0914 17:42:55.001596 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 17:42:55.001804 1 main.go:299] handling current node
I0914 17:43:05.010272 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 17:43:05.010313 1 main.go:299] handling current node
I0914 17:43:15.007901 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 17:43:15.007936 1 main.go:299] handling current node
I0914 17:43:25.001223 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 17:43:25.001260 1 main.go:299] handling current node
I0914 17:43:35.000348 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0914 17:43:35.000395 1 main.go:299] handling current node
==> kube-apiserver [27bb9541e4b31f95d14a16f4a91aca7ee72156642e969968ba2d5970ad170c0d] <==
W0914 17:38:47.341895 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.164.12:443: connect: connection refused
W0914 17:38:48.386598 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.164.12:443: connect: connection refused
W0914 17:38:48.892769 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.103.174.199:443: connect: connection refused
E0914 17:38:48.892806 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.103.174.199:443: connect: connection refused" logger="UnhandledError"
W0914 17:38:48.894679 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.111.164.12:443: connect: connection refused
W0914 17:38:48.934857 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.103.174.199:443: connect: connection refused
E0914 17:38:48.934902 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.103.174.199:443: connect: connection refused" logger="UnhandledError"
W0914 17:38:48.936624 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.111.164.12:443: connect: connection refused
W0914 17:38:49.408532 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.164.12:443: connect: connection refused
W0914 17:38:50.481749 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.164.12:443: connect: connection refused
W0914 17:38:51.489004 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.164.12:443: connect: connection refused
W0914 17:38:52.504995 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.164.12:443: connect: connection refused
W0914 17:38:53.549025 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.164.12:443: connect: connection refused
W0914 17:38:54.609626 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.164.12:443: connect: connection refused
W0914 17:38:55.710286 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.164.12:443: connect: connection refused
W0914 17:38:56.782778 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.164.12:443: connect: connection refused
W0914 17:38:57.857593 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.111.164.12:443: connect: connection refused
W0914 17:39:08.794881 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.103.174.199:443: connect: connection refused
E0914 17:39:08.794921 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.103.174.199:443: connect: connection refused" logger="UnhandledError"
W0914 17:39:48.903987 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.103.174.199:443: connect: connection refused
E0914 17:39:48.904032 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.103.174.199:443: connect: connection refused" logger="UnhandledError"
W0914 17:39:48.943222 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.103.174.199:443: connect: connection refused
E0914 17:39:48.943264 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.103.174.199:443: connect: connection refused" logger="UnhandledError"
I0914 17:40:34.303675 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I0914 17:40:34.342491 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
==> kube-controller-manager [2e1dc8ae4512180f61723221f2c3843fcfb71e39cea40d158e9b94362c3306a0] <==
I0914 17:39:48.931443 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0914 17:39:48.931696 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0914 17:39:48.945241 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0914 17:39:48.953602 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0914 17:39:48.966671 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0914 17:39:48.969225 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0914 17:39:48.977352 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0914 17:39:49.842560 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0914 17:39:49.859428 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0914 17:39:50.995304 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0914 17:39:51.023223 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0914 17:39:52.002199 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0914 17:39:52.014120 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0914 17:39:52.022013 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0914 17:39:52.028916 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0914 17:39:52.038185 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0914 17:39:52.043997 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0914 17:40:16.947370 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="9.699332ms"
I0914 17:40:16.947736 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="158.334µs"
I0914 17:40:22.028007 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0914 17:40:22.028352 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0914 17:40:22.082754 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0914 17:40:22.083245 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0914 17:40:31.934547 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-478069"
I0914 17:40:34.012868 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="0s"
==> kube-proxy [3a997b13f73a3be677719c476c38ec35ad87bdeaa08f7e5db3671d4b49227c21] <==
I0914 17:37:34.527722 1 server_linux.go:66] "Using iptables proxy"
I0914 17:37:34.651518 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0914 17:37:34.651579 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0914 17:37:34.708753 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0914 17:37:34.708849 1 server_linux.go:169] "Using iptables Proxier"
I0914 17:37:34.715873 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0914 17:37:34.716392 1 server.go:483] "Version info" version="v1.31.1"
I0914 17:37:34.716406 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0914 17:37:34.720949 1 config.go:199] "Starting service config controller"
I0914 17:37:34.720983 1 shared_informer.go:313] Waiting for caches to sync for service config
I0914 17:37:34.721006 1 config.go:105] "Starting endpoint slice config controller"
I0914 17:37:34.721010 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0914 17:37:34.721732 1 config.go:328] "Starting node config controller"
I0914 17:37:34.721744 1 shared_informer.go:313] Waiting for caches to sync for node config
I0914 17:37:34.821884 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0914 17:37:34.821916 1 shared_informer.go:320] Caches are synced for service config
I0914 17:37:34.821887 1 shared_informer.go:320] Caches are synced for node config
==> kube-scheduler [778b641a5b6588f4fc2831d0197ea9b08cf606f101e37c02f36065e7b67f599e] <==
W0914 17:37:25.721018 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0914 17:37:25.722322 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
W0914 17:37:25.721100 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0914 17:37:25.722417 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0914 17:37:25.721180 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0914 17:37:25.722588 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0914 17:37:25.721212 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0914 17:37:25.722803 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0914 17:37:25.721261 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0914 17:37:25.722958 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0914 17:37:25.721293 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0914 17:37:25.723107 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0914 17:37:26.561510 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0914 17:37:26.561773 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0914 17:37:26.585121 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0914 17:37:26.585169 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0914 17:37:26.602951 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0914 17:37:26.602996 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
W0914 17:37:26.620788 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0914 17:37:26.620842 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0914 17:37:26.648466 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0914 17:37:26.648686 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0914 17:37:26.738561 1 reflector.go:561] runtime/asm_arm64.s:1222: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0914 17:37:26.738818 1 reflector.go:158] "Unhandled Error" err="runtime/asm_arm64.s:1222: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
I0914 17:37:28.806420 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 14 17:41:35 addons-478069 kubelet[1496]: I0914 17:41:35.928248 1496 scope.go:117] "RemoveContainer" containerID="3cf32c0e8215aac267a517b1b91cd1e439d37d4e4fe188f710722004d8a7d947"
Sep 14 17:41:35 addons-478069 kubelet[1496]: E0914 17:41:35.928445 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-5nf8v_gadget(2d1cefd4-5000-4feb-b972-b1fa0c546aa3)\"" pod="gadget/gadget-5nf8v" podUID="2d1cefd4-5000-4feb-b972-b1fa0c546aa3"
Sep 14 17:41:49 addons-478069 kubelet[1496]: I0914 17:41:49.928485 1496 scope.go:117] "RemoveContainer" containerID="3cf32c0e8215aac267a517b1b91cd1e439d37d4e4fe188f710722004d8a7d947"
Sep 14 17:41:49 addons-478069 kubelet[1496]: E0914 17:41:49.928683 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-5nf8v_gadget(2d1cefd4-5000-4feb-b972-b1fa0c546aa3)\"" pod="gadget/gadget-5nf8v" podUID="2d1cefd4-5000-4feb-b972-b1fa0c546aa3"
Sep 14 17:41:54 addons-478069 kubelet[1496]: I0914 17:41:54.928656 1496 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-c8cfs" secret="" err="secret \"gcp-auth\" not found"
Sep 14 17:42:04 addons-478069 kubelet[1496]: I0914 17:42:04.928619 1496 scope.go:117] "RemoveContainer" containerID="3cf32c0e8215aac267a517b1b91cd1e439d37d4e4fe188f710722004d8a7d947"
Sep 14 17:42:04 addons-478069 kubelet[1496]: E0914 17:42:04.928864 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-5nf8v_gadget(2d1cefd4-5000-4feb-b972-b1fa0c546aa3)\"" pod="gadget/gadget-5nf8v" podUID="2d1cefd4-5000-4feb-b972-b1fa0c546aa3"
Sep 14 17:42:05 addons-478069 kubelet[1496]: I0914 17:42:05.928023 1496 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-5mrzf" secret="" err="secret \"gcp-auth\" not found"
Sep 14 17:42:17 addons-478069 kubelet[1496]: I0914 17:42:17.929858 1496 scope.go:117] "RemoveContainer" containerID="3cf32c0e8215aac267a517b1b91cd1e439d37d4e4fe188f710722004d8a7d947"
Sep 14 17:42:17 addons-478069 kubelet[1496]: E0914 17:42:17.930540 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-5nf8v_gadget(2d1cefd4-5000-4feb-b972-b1fa0c546aa3)\"" pod="gadget/gadget-5nf8v" podUID="2d1cefd4-5000-4feb-b972-b1fa0c546aa3"
Sep 14 17:42:31 addons-478069 kubelet[1496]: I0914 17:42:31.929076 1496 scope.go:117] "RemoveContainer" containerID="3cf32c0e8215aac267a517b1b91cd1e439d37d4e4fe188f710722004d8a7d947"
Sep 14 17:42:31 addons-478069 kubelet[1496]: E0914 17:42:31.929826 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-5nf8v_gadget(2d1cefd4-5000-4feb-b972-b1fa0c546aa3)\"" pod="gadget/gadget-5nf8v" podUID="2d1cefd4-5000-4feb-b972-b1fa0c546aa3"
Sep 14 17:42:42 addons-478069 kubelet[1496]: I0914 17:42:42.928186 1496 scope.go:117] "RemoveContainer" containerID="3cf32c0e8215aac267a517b1b91cd1e439d37d4e4fe188f710722004d8a7d947"
Sep 14 17:42:42 addons-478069 kubelet[1496]: E0914 17:42:42.928400 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-5nf8v_gadget(2d1cefd4-5000-4feb-b972-b1fa0c546aa3)\"" pod="gadget/gadget-5nf8v" podUID="2d1cefd4-5000-4feb-b972-b1fa0c546aa3"
Sep 14 17:42:55 addons-478069 kubelet[1496]: I0914 17:42:55.927780 1496 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-z88fn" secret="" err="secret \"gcp-auth\" not found"
Sep 14 17:42:56 addons-478069 kubelet[1496]: I0914 17:42:56.928089 1496 scope.go:117] "RemoveContainer" containerID="3cf32c0e8215aac267a517b1b91cd1e439d37d4e4fe188f710722004d8a7d947"
Sep 14 17:42:56 addons-478069 kubelet[1496]: E0914 17:42:56.928304 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-5nf8v_gadget(2d1cefd4-5000-4feb-b972-b1fa0c546aa3)\"" pod="gadget/gadget-5nf8v" podUID="2d1cefd4-5000-4feb-b972-b1fa0c546aa3"
Sep 14 17:42:57 addons-478069 kubelet[1496]: I0914 17:42:57.929289 1496 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-c8cfs" secret="" err="secret \"gcp-auth\" not found"
Sep 14 17:43:09 addons-478069 kubelet[1496]: I0914 17:43:09.928013 1496 scope.go:117] "RemoveContainer" containerID="3cf32c0e8215aac267a517b1b91cd1e439d37d4e4fe188f710722004d8a7d947"
Sep 14 17:43:09 addons-478069 kubelet[1496]: E0914 17:43:09.928838 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-5nf8v_gadget(2d1cefd4-5000-4feb-b972-b1fa0c546aa3)\"" pod="gadget/gadget-5nf8v" podUID="2d1cefd4-5000-4feb-b972-b1fa0c546aa3"
Sep 14 17:43:24 addons-478069 kubelet[1496]: I0914 17:43:24.928216 1496 scope.go:117] "RemoveContainer" containerID="3cf32c0e8215aac267a517b1b91cd1e439d37d4e4fe188f710722004d8a7d947"
Sep 14 17:43:24 addons-478069 kubelet[1496]: E0914 17:43:24.928506 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-5nf8v_gadget(2d1cefd4-5000-4feb-b972-b1fa0c546aa3)\"" pod="gadget/gadget-5nf8v" podUID="2d1cefd4-5000-4feb-b972-b1fa0c546aa3"
Sep 14 17:43:32 addons-478069 kubelet[1496]: I0914 17:43:32.928217 1496 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-5mrzf" secret="" err="secret \"gcp-auth\" not found"
Sep 14 17:43:36 addons-478069 kubelet[1496]: I0914 17:43:36.927733 1496 scope.go:117] "RemoveContainer" containerID="3cf32c0e8215aac267a517b1b91cd1e439d37d4e4fe188f710722004d8a7d947"
Sep 14 17:43:36 addons-478069 kubelet[1496]: E0914 17:43:36.927934 1496 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-5nf8v_gadget(2d1cefd4-5000-4feb-b972-b1fa0c546aa3)\"" pod="gadget/gadget-5nf8v" podUID="2d1cefd4-5000-4feb-b972-b1fa0c546aa3"
==> storage-provisioner [45fbc1d61fd1033e734883a10ae76c090d58ede49d17d4872c0d6cbef2a8e6df] <==
I0914 17:37:39.124832 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0914 17:37:39.137092 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0914 17:37:39.137139 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0914 17:37:39.147035 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0914 17:37:39.147286 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-478069_64524dcf-84e7-4844-a6dc-13fdad5e0ecb!
I0914 17:37:39.148590 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"602a84e3-bcf9-4833-8849-123b7018645b", APIVersion:"v1", ResourceVersion:"571", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-478069_64524dcf-84e7-4844-a6dc-13fdad5e0ecb became leader
I0914 17:37:39.247697 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-478069_64524dcf-84e7-4844-a6dc-13fdad5e0ecb!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-478069 -n addons-478069
helpers_test.go:261: (dbg) Run: kubectl --context addons-478069 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-2c9fn ingress-nginx-admission-patch-nknq9 test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-478069 describe pod ingress-nginx-admission-create-2c9fn ingress-nginx-admission-patch-nknq9 test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-478069 describe pod ingress-nginx-admission-create-2c9fn ingress-nginx-admission-patch-nknq9 test-job-nginx-0: exit status 1 (91.229795ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-2c9fn" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-nknq9" not found
Error from server (NotFound): pods "test-job-nginx-0" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-478069 describe pod ingress-nginx-admission-create-2c9fn ingress-nginx-admission-patch-nknq9 test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (199.97s)