=== RUN TestAddons/serial/Volcano
addons_test.go:835: volcano-scheduler stabilized in 59.364305ms
addons_test.go:843: volcano-admission stabilized in 59.598901ms
addons_test.go:851: volcano-controller stabilized in 59.645259ms
addons_test.go:857: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-scheduler" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-scheduler-576bc46687-bjvgr" [2c90276f-a230-4e75-9d6e-87fcdd8038f2] Running
addons_test.go:857: (dbg) TestAddons/serial/Volcano: app=volcano-scheduler healthy within 6.00451675s
addons_test.go:861: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-admission" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-admission-77d7d48b68-2nclt" [bce48839-c974-4778-9a17-611c4fdf83c9] Running
addons_test.go:861: (dbg) TestAddons/serial/Volcano: app=volcano-admission healthy within 6.003679351s
addons_test.go:865: (dbg) TestAddons/serial/Volcano: waiting 6m0s for pods matching "app=volcano-controller" in namespace "volcano-system" ...
helpers_test.go:344: "volcano-controllers-56675bb4d5-4mnsn" [3e9e9db7-f369-4523-b532-a2174f1eef20] Running
addons_test.go:865: (dbg) TestAddons/serial/Volcano: app=volcano-controller healthy within 5.003146544s
addons_test.go:870: (dbg) Run: kubectl --context addons-281519 delete -n volcano-system job volcano-admission-init
addons_test.go:876: (dbg) Run: kubectl --context addons-281519 create -f testdata/vcjob.yaml
addons_test.go:884: (dbg) Run: kubectl --context addons-281519 get vcjob -n my-volcano
addons_test.go:902: (dbg) TestAddons/serial/Volcano: waiting 3m0s for pods matching "volcano.sh/job-name=test-job" in namespace "my-volcano" ...
helpers_test.go:344: "test-job-nginx-0" [d95deb44-7098-4bf8-a31f-8ed32a4d3565] Pending
helpers_test.go:344: "test-job-nginx-0" [d95deb44-7098-4bf8-a31f-8ed32a4d3565] Pending: PodScheduled:Unschedulable (0/1 nodes are unavailable: 1 Insufficient cpu.)
helpers_test.go:329: TestAddons/serial/Volcano: WARNING: pod list for "my-volcano" "volcano.sh/job-name=test-job" returned: client rate limiter Wait returned an error: context deadline exceeded
addons_test.go:902: ***** TestAddons/serial/Volcano: pod "volcano.sh/job-name=test-job" failed to start within 3m0s: context deadline exceeded ****
addons_test.go:902: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-281519 -n addons-281519
addons_test.go:902: TestAddons/serial/Volcano: showing logs for failed pods as of 2024-09-20 22:25:20.339196829 +0000 UTC m=+435.684571228
addons_test.go:902: (dbg) Run: kubectl --context addons-281519 describe po test-job-nginx-0 -n my-volcano
addons_test.go:902: (dbg) kubectl --context addons-281519 describe po test-job-nginx-0 -n my-volcano:
Name: test-job-nginx-0
Namespace: my-volcano
Priority: 0
Service Account: default
Node: <none>
Labels: volcano.sh/job-name=test-job
volcano.sh/job-namespace=my-volcano
volcano.sh/queue-name=test
volcano.sh/task-index=0
volcano.sh/task-spec=nginx
Annotations: scheduling.k8s.io/group-name: test-job-4e8b0082-af03-4d65-ba4a-fd45d4801ced
volcano.sh/job-name: test-job
volcano.sh/job-version: 0
volcano.sh/queue-name: test
volcano.sh/task-index: 0
volcano.sh/task-spec: nginx
volcano.sh/template-uid: test-job-nginx
Status: Pending
IP:
IPs: <none>
Controlled By: Job/test-job
Containers:
nginx:
Image: nginx:latest
Port: <none>
Host Port: <none>
Command:
sleep
10m
Limits:
cpu: 1
Requests:
cpu: 1
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-9w4pq (ro)
Conditions:
Type Status
PodScheduled False
Volumes:
kube-api-access-9w4pq:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: Burstable
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Warning FailedScheduling 2m59s volcano 0/1 nodes are unavailable: 1 Insufficient cpu.
addons_test.go:902: (dbg) Run: kubectl --context addons-281519 logs test-job-nginx-0 -n my-volcano
addons_test.go:902: (dbg) kubectl --context addons-281519 logs test-job-nginx-0 -n my-volcano:
addons_test.go:903: failed waiting for test-local-path pod: volcano.sh/job-name=test-job within 3m0s: context deadline exceeded
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/serial/Volcano]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-281519
helpers_test.go:235: (dbg) docker inspect addons-281519:
-- stdout --
[
{
"Id": "2c3782c436ad481c9ee554b4d430246c886053ffdaed1dcaaf3ca0afb46230c5",
"Created": "2024-09-20T22:18:49.402372672Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 1436907,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-20T22:18:49.534866168Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:c94982da1293baee77c00993711af197ed62d6b1a4ee12c0caa4f57c70de4fdc",
"ResolvConfPath": "/var/lib/docker/containers/2c3782c436ad481c9ee554b4d430246c886053ffdaed1dcaaf3ca0afb46230c5/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/2c3782c436ad481c9ee554b4d430246c886053ffdaed1dcaaf3ca0afb46230c5/hostname",
"HostsPath": "/var/lib/docker/containers/2c3782c436ad481c9ee554b4d430246c886053ffdaed1dcaaf3ca0afb46230c5/hosts",
"LogPath": "/var/lib/docker/containers/2c3782c436ad481c9ee554b4d430246c886053ffdaed1dcaaf3ca0afb46230c5/2c3782c436ad481c9ee554b4d430246c886053ffdaed1dcaaf3ca0afb46230c5-json.log",
"Name": "/addons-281519",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-281519:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-281519",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/7c205f21fa3c76e4407f3dc8d166e053dabf55fdd67a46dd4ec130a1feb1fb60-init/diff:/var/lib/docker/overlay2/8df9c76e9684a7991c64fd90a5e96c7a74e754e6c52c67c7cc4449c22f7eda7f/diff",
"MergedDir": "/var/lib/docker/overlay2/7c205f21fa3c76e4407f3dc8d166e053dabf55fdd67a46dd4ec130a1feb1fb60/merged",
"UpperDir": "/var/lib/docker/overlay2/7c205f21fa3c76e4407f3dc8d166e053dabf55fdd67a46dd4ec130a1feb1fb60/diff",
"WorkDir": "/var/lib/docker/overlay2/7c205f21fa3c76e4407f3dc8d166e053dabf55fdd67a46dd4ec130a1feb1fb60/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-281519",
"Source": "/var/lib/docker/volumes/addons-281519/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-281519",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-281519",
"name.minikube.sigs.k8s.io": "addons-281519",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "bff1cadfd38bbf154d6b91b200cf3ef9959a657217648ac13a3fa790fb6324c6",
"SandboxKey": "/var/run/docker/netns/bff1cadfd38b",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33529"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33530"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33533"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33531"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33532"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-281519": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "23e144e7f382786b251c06f496efa401ad6608ec6724de2f6de294594cee4a52",
"EndpointID": "57c578ca67387a3c53c978b2ff965921718959ef830d5815be8c398e7e377d90",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-281519",
"2c3782c436ad"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-281519 -n addons-281519
helpers_test.go:244: <<< TestAddons/serial/Volcano FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/serial/Volcano]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-281519 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-281519 logs -n 25: (1.690077968s)
helpers_test.go:252: TestAddons/serial/Volcano logs:
-- stdout --
==> Audit <==
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-689770 | jenkins | v1.34.0 | 20 Sep 24 22:18 UTC | |
| | -p download-only-689770 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 20 Sep 24 22:18 UTC | 20 Sep 24 22:18 UTC |
| delete | -p download-only-689770 | download-only-689770 | jenkins | v1.34.0 | 20 Sep 24 22:18 UTC | 20 Sep 24 22:18 UTC |
| start | -o=json --download-only | download-only-083529 | jenkins | v1.34.0 | 20 Sep 24 22:18 UTC | |
| | -p download-only-083529 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| | --container-runtime=containerd | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 20 Sep 24 22:18 UTC | 20 Sep 24 22:18 UTC |
| delete | -p download-only-083529 | download-only-083529 | jenkins | v1.34.0 | 20 Sep 24 22:18 UTC | 20 Sep 24 22:18 UTC |
| delete | -p download-only-689770 | download-only-689770 | jenkins | v1.34.0 | 20 Sep 24 22:18 UTC | 20 Sep 24 22:18 UTC |
| delete | -p download-only-083529 | download-only-083529 | jenkins | v1.34.0 | 20 Sep 24 22:18 UTC | 20 Sep 24 22:18 UTC |
| start | --download-only -p | download-docker-044651 | jenkins | v1.34.0 | 20 Sep 24 22:18 UTC | |
| | download-docker-044651 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p download-docker-044651 | download-docker-044651 | jenkins | v1.34.0 | 20 Sep 24 22:18 UTC | 20 Sep 24 22:18 UTC |
| start | --download-only -p | binary-mirror-390783 | jenkins | v1.34.0 | 20 Sep 24 22:18 UTC | |
| | binary-mirror-390783 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:44537 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| delete | -p binary-mirror-390783 | binary-mirror-390783 | jenkins | v1.34.0 | 20 Sep 24 22:18 UTC | 20 Sep 24 22:18 UTC |
| addons | enable dashboard -p | addons-281519 | jenkins | v1.34.0 | 20 Sep 24 22:18 UTC | |
| | addons-281519 | | | | | |
| addons | disable dashboard -p | addons-281519 | jenkins | v1.34.0 | 20 Sep 24 22:18 UTC | |
| | addons-281519 | | | | | |
| start | -p addons-281519 --wait=true | addons-281519 | jenkins | v1.34.0 | 20 Sep 24 22:18 UTC | 20 Sep 24 22:22 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=containerd | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/20 22:18:24
Running on machine: ip-172-31-21-244
Binary: Built with gc go1.23.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0920 22:18:24.794370 1436409 out.go:345] Setting OutFile to fd 1 ...
I0920 22:18:24.794581 1436409 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 22:18:24.794612 1436409 out.go:358] Setting ErrFile to fd 2...
I0920 22:18:24.794632 1436409 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 22:18:24.794912 1436409 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19672-1430253/.minikube/bin
I0920 22:18:24.795388 1436409 out.go:352] Setting JSON to false
I0920 22:18:24.796374 1436409 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":21654,"bootTime":1726849051,"procs":190,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0920 22:18:24.796478 1436409 start.go:139] virtualization:
I0920 22:18:24.799703 1436409 out.go:177] * [addons-281519] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0920 22:18:24.803053 1436409 out.go:177] - MINIKUBE_LOCATION=19672
I0920 22:18:24.803184 1436409 notify.go:220] Checking for updates...
I0920 22:18:24.809097 1436409 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0920 22:18:24.812291 1436409 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19672-1430253/kubeconfig
I0920 22:18:24.815239 1436409 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19672-1430253/.minikube
I0920 22:18:24.818248 1436409 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0920 22:18:24.821049 1436409 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0920 22:18:24.824172 1436409 driver.go:394] Setting default libvirt URI to qemu:///system
I0920 22:18:24.850588 1436409 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
I0920 22:18:24.850722 1436409 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0920 22:18:24.901755 1436409 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-20 22:18:24.891760803 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I0920 22:18:24.901870 1436409 docker.go:318] overlay module found
I0920 22:18:24.904410 1436409 out.go:177] * Using the docker driver based on user configuration
I0920 22:18:24.907066 1436409 start.go:297] selected driver: docker
I0920 22:18:24.907087 1436409 start.go:901] validating driver "docker" against <nil>
I0920 22:18:24.907102 1436409 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0920 22:18:24.907789 1436409 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0920 22:18:24.959197 1436409 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-20 22:18:24.949318695 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7]] Warnings:<nil>}}
I0920 22:18:24.959428 1436409 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0920 22:18:24.959655 1436409 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0920 22:18:24.962441 1436409 out.go:177] * Using Docker driver with root privileges
I0920 22:18:24.965556 1436409 cni.go:84] Creating CNI manager for ""
I0920 22:18:24.965624 1436409 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0920 22:18:24.965637 1436409 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
I0920 22:18:24.965737 1436409 start.go:340] cluster config:
{Name:addons-281519 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-281519 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHA
uthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0920 22:18:24.968459 1436409 out.go:177] * Starting "addons-281519" primary control-plane node in "addons-281519" cluster
I0920 22:18:24.970808 1436409 cache.go:121] Beginning downloading kic base image for docker with containerd
I0920 22:18:24.973190 1436409 out.go:177] * Pulling base image v0.0.45-1726784731-19672 ...
I0920 22:18:24.975624 1436409 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0920 22:18:24.975660 1436409 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local docker daemon
I0920 22:18:24.975678 1436409 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19672-1430253/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4
I0920 22:18:24.975687 1436409 cache.go:56] Caching tarball of preloaded images
I0920 22:18:24.975767 1436409 preload.go:172] Found /home/jenkins/minikube-integration/19672-1430253/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4 in cache, skipping download
I0920 22:18:24.975777 1436409 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on containerd
I0920 22:18:24.976150 1436409 profile.go:143] Saving config to /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/config.json ...
I0920 22:18:24.976175 1436409 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/config.json: {Name:mkf613251ad340e91edac1f8e5d166bd035d59dc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:18:24.991021 1436409 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed to local cache
I0920 22:18:24.991154 1436409 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local cache directory
I0920 22:18:24.991179 1436409 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed in local cache directory, skipping pull
I0920 22:18:24.991188 1436409 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed exists in cache, skipping pull
I0920 22:18:24.991196 1436409 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed as a tarball
I0920 22:18:24.991201 1436409 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed from local cache
I0920 22:18:42.623680 1436409 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed from cached tarball
I0920 22:18:42.623722 1436409 cache.go:194] Successfully downloaded all kic artifacts
I0920 22:18:42.623765 1436409 start.go:360] acquireMachinesLock for addons-281519: {Name:mkcb7fd9367d4e74145098ef3359e4c8911aae53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0920 22:18:42.623941 1436409 start.go:364] duration metric: took 142.241µs to acquireMachinesLock for "addons-281519"
I0920 22:18:42.623976 1436409 start.go:93] Provisioning new machine with config: &{Name:addons-281519 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-281519 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:fa
lse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0920 22:18:42.624055 1436409 start.go:125] createHost starting for "" (driver="docker")
I0920 22:18:42.625577 1436409 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0920 22:18:42.625830 1436409 start.go:159] libmachine.API.Create for "addons-281519" (driver="docker")
I0920 22:18:42.625866 1436409 client.go:168] LocalClient.Create starting
I0920 22:18:42.625991 1436409 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19672-1430253/.minikube/certs/ca.pem
I0920 22:18:42.902837 1436409 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19672-1430253/.minikube/certs/cert.pem
I0920 22:18:43.637895 1436409 cli_runner.go:164] Run: docker network inspect addons-281519 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0920 22:18:43.652426 1436409 cli_runner.go:211] docker network inspect addons-281519 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0920 22:18:43.652528 1436409 network_create.go:284] running [docker network inspect addons-281519] to gather additional debugging logs...
I0920 22:18:43.652552 1436409 cli_runner.go:164] Run: docker network inspect addons-281519
W0920 22:18:43.668174 1436409 cli_runner.go:211] docker network inspect addons-281519 returned with exit code 1
I0920 22:18:43.668217 1436409 network_create.go:287] error running [docker network inspect addons-281519]: docker network inspect addons-281519: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-281519 not found
I0920 22:18:43.668256 1436409 network_create.go:289] output of [docker network inspect addons-281519]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-281519 not found
** /stderr **
I0920 22:18:43.668362 1436409 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0920 22:18:43.684443 1436409 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40004b9030}
I0920 22:18:43.684489 1436409 network_create.go:124] attempt to create docker network addons-281519 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0920 22:18:43.684556 1436409 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-281519 addons-281519
I0920 22:18:43.755847 1436409 network_create.go:108] docker network addons-281519 192.168.49.0/24 created
I0920 22:18:43.755893 1436409 kic.go:121] calculated static IP "192.168.49.2" for the "addons-281519" container
I0920 22:18:43.755973 1436409 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0920 22:18:43.770158 1436409 cli_runner.go:164] Run: docker volume create addons-281519 --label name.minikube.sigs.k8s.io=addons-281519 --label created_by.minikube.sigs.k8s.io=true
I0920 22:18:43.787007 1436409 oci.go:103] Successfully created a docker volume addons-281519
I0920 22:18:43.787107 1436409 cli_runner.go:164] Run: docker run --rm --name addons-281519-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-281519 --entrypoint /usr/bin/test -v addons-281519:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -d /var/lib
I0920 22:18:45.311351 1436409 cli_runner.go:217] Completed: docker run --rm --name addons-281519-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-281519 --entrypoint /usr/bin/test -v addons-281519:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -d /var/lib: (1.524197281s)
I0920 22:18:45.311384 1436409 oci.go:107] Successfully prepared a docker volume addons-281519
I0920 22:18:45.311415 1436409 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0920 22:18:45.311438 1436409 kic.go:194] Starting extracting preloaded images to volume ...
I0920 22:18:45.311522 1436409 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19672-1430253/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-281519:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -I lz4 -xf /preloaded.tar -C /extractDir
I0920 22:18:49.336014 1436409 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19672-1430253/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-containerd-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-281519:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed -I lz4 -xf /preloaded.tar -C /extractDir: (4.024446116s)
I0920 22:18:49.336047 1436409 kic.go:203] duration metric: took 4.024606522s to extract preloaded images to volume ...
W0920 22:18:49.336201 1436409 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0920 22:18:49.336306 1436409 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0920 22:18:49.385786 1436409 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-281519 --name addons-281519 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-281519 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-281519 --network addons-281519 --ip 192.168.49.2 --volume addons-281519:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed
I0920 22:18:49.726664 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Running}}
I0920 22:18:49.748070 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:18:49.773199 1436409 cli_runner.go:164] Run: docker exec addons-281519 stat /var/lib/dpkg/alternatives/iptables
I0920 22:18:49.836391 1436409 oci.go:144] the created container "addons-281519" has a running status.
I0920 22:18:49.836422 1436409 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa...
I0920 22:18:50.500661 1436409 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0920 22:18:50.533222 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:18:50.563799 1436409 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0920 22:18:50.563825 1436409 kic_runner.go:114] Args: [docker exec --privileged addons-281519 chown docker:docker /home/docker/.ssh/authorized_keys]
I0920 22:18:50.624578 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:18:50.649661 1436409 machine.go:93] provisionDockerMachine start ...
I0920 22:18:50.649769 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:18:50.676862 1436409 main.go:141] libmachine: Using SSH client type: native
I0920 22:18:50.677125 1436409 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33529 <nil> <nil>}
I0920 22:18:50.677135 1436409 main.go:141] libmachine: About to run SSH command:
hostname
I0920 22:18:50.824903 1436409 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-281519
I0920 22:18:50.824937 1436409 ubuntu.go:169] provisioning hostname "addons-281519"
I0920 22:18:50.825014 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:18:50.845756 1436409 main.go:141] libmachine: Using SSH client type: native
I0920 22:18:50.846010 1436409 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33529 <nil> <nil>}
I0920 22:18:50.846022 1436409 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-281519 && echo "addons-281519" | sudo tee /etc/hostname
I0920 22:18:50.997924 1436409 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-281519
I0920 22:18:50.998011 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:18:51.027956 1436409 main.go:141] libmachine: Using SSH client type: native
I0920 22:18:51.028216 1436409 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33529 <nil> <nil>}
I0920 22:18:51.028240 1436409 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-281519' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-281519/g' /etc/hosts;
else
echo '127.0.1.1 addons-281519' | sudo tee -a /etc/hosts;
fi
fi
I0920 22:18:51.165086 1436409 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0920 22:18:51.165112 1436409 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19672-1430253/.minikube CaCertPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19672-1430253/.minikube}
I0920 22:18:51.165146 1436409 ubuntu.go:177] setting up certificates
I0920 22:18:51.165165 1436409 provision.go:84] configureAuth start
I0920 22:18:51.165235 1436409 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-281519
I0920 22:18:51.185039 1436409 provision.go:143] copyHostCerts
I0920 22:18:51.185125 1436409 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19672-1430253/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19672-1430253/.minikube/ca.pem (1082 bytes)
I0920 22:18:51.185255 1436409 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19672-1430253/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19672-1430253/.minikube/cert.pem (1123 bytes)
I0920 22:18:51.185319 1436409 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19672-1430253/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19672-1430253/.minikube/key.pem (1679 bytes)
I0920 22:18:51.185370 1436409 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19672-1430253/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19672-1430253/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19672-1430253/.minikube/certs/ca-key.pem org=jenkins.addons-281519 san=[127.0.0.1 192.168.49.2 addons-281519 localhost minikube]
I0920 22:18:51.548681 1436409 provision.go:177] copyRemoteCerts
I0920 22:18:51.548831 1436409 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0920 22:18:51.548877 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:18:51.566438 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:18:51.661826 1436409 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-1430253/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0920 22:18:51.686418 1436409 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-1430253/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0920 22:18:51.711050 1436409 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-1430253/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0920 22:18:51.736886 1436409 provision.go:87] duration metric: took 571.703783ms to configureAuth
I0920 22:18:51.736917 1436409 ubuntu.go:193] setting minikube options for container-runtime
I0920 22:18:51.737133 1436409 config.go:182] Loaded profile config "addons-281519": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0920 22:18:51.737146 1436409 machine.go:96] duration metric: took 1.087463078s to provisionDockerMachine
I0920 22:18:51.737155 1436409 client.go:171] duration metric: took 9.11128347s to LocalClient.Create
I0920 22:18:51.737175 1436409 start.go:167] duration metric: took 9.111346492s to libmachine.API.Create "addons-281519"
I0920 22:18:51.737188 1436409 start.go:293] postStartSetup for "addons-281519" (driver="docker")
I0920 22:18:51.737198 1436409 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0920 22:18:51.737257 1436409 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0920 22:18:51.737305 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:18:51.754812 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:18:51.850632 1436409 ssh_runner.go:195] Run: cat /etc/os-release
I0920 22:18:51.854004 1436409 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0920 22:18:51.854042 1436409 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0920 22:18:51.854054 1436409 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0920 22:18:51.854063 1436409 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0920 22:18:51.854078 1436409 filesync.go:126] Scanning /home/jenkins/minikube-integration/19672-1430253/.minikube/addons for local assets ...
I0920 22:18:51.854151 1436409 filesync.go:126] Scanning /home/jenkins/minikube-integration/19672-1430253/.minikube/files for local assets ...
I0920 22:18:51.854179 1436409 start.go:296] duration metric: took 116.984764ms for postStartSetup
I0920 22:18:51.854509 1436409 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-281519
I0920 22:18:51.872838 1436409 profile.go:143] Saving config to /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/config.json ...
I0920 22:18:51.873147 1436409 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0920 22:18:51.873202 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:18:51.889975 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:18:51.981547 1436409 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0920 22:18:51.986392 1436409 start.go:128] duration metric: took 9.362320824s to createHost
I0920 22:18:51.986422 1436409 start.go:83] releasing machines lock for "addons-281519", held for 9.362465018s
I0920 22:18:51.986497 1436409 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-281519
I0920 22:18:52.003991 1436409 ssh_runner.go:195] Run: cat /version.json
I0920 22:18:52.004062 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:18:52.004135 1436409 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0920 22:18:52.004221 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:18:52.031372 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:18:52.047162 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:18:52.124377 1436409 ssh_runner.go:195] Run: systemctl --version
I0920 22:18:52.253945 1436409 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0920 22:18:52.258411 1436409 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0920 22:18:52.284401 1436409 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0920 22:18:52.284485 1436409 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0920 22:18:52.314819 1436409 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0920 22:18:52.314862 1436409 start.go:495] detecting cgroup driver to use...
I0920 22:18:52.314895 1436409 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0920 22:18:52.314964 1436409 ssh_runner.go:195] Run: sudo systemctl stop -f crio
I0920 22:18:52.329691 1436409 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0920 22:18:52.341794 1436409 docker.go:217] disabling cri-docker service (if available) ...
I0920 22:18:52.341894 1436409 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
I0920 22:18:52.356342 1436409 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
I0920 22:18:52.370647 1436409 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
I0920 22:18:52.465971 1436409 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
I0920 22:18:52.550483 1436409 docker.go:233] disabling docker service ...
I0920 22:18:52.550562 1436409 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
I0920 22:18:52.570301 1436409 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
I0920 22:18:52.586677 1436409 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
I0920 22:18:52.688205 1436409 ssh_runner.go:195] Run: sudo systemctl mask docker.service
I0920 22:18:52.779757 1436409 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
I0920 22:18:52.791462 1436409 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0920 22:18:52.808754 1436409 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0920 22:18:52.819569 1436409 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0920 22:18:52.829988 1436409 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0920 22:18:52.830068 1436409 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0920 22:18:52.841299 1436409 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0920 22:18:52.853388 1436409 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0920 22:18:52.864029 1436409 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0920 22:18:52.874537 1436409 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0920 22:18:52.884319 1436409 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0920 22:18:52.894799 1436409 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0920 22:18:52.905070 1436409 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0920 22:18:52.920714 1436409 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0920 22:18:52.930142 1436409 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0920 22:18:52.939367 1436409 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 22:18:53.033430 1436409 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0920 22:18:53.170415 1436409 start.go:542] Will wait 60s for socket path /run/containerd/containerd.sock
I0920 22:18:53.170576 1436409 ssh_runner.go:195] Run: stat /run/containerd/containerd.sock
I0920 22:18:53.174297 1436409 start.go:563] Will wait 60s for crictl version
I0920 22:18:53.174413 1436409 ssh_runner.go:195] Run: which crictl
I0920 22:18:53.177734 1436409 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0920 22:18:53.215985 1436409 start.go:579] Version: 0.1.0
RuntimeName: containerd
RuntimeVersion: 1.7.22
RuntimeApiVersion: v1
I0920 22:18:53.216080 1436409 ssh_runner.go:195] Run: containerd --version
I0920 22:18:53.238163 1436409 ssh_runner.go:195] Run: containerd --version
I0920 22:18:53.262982 1436409 out.go:177] * Preparing Kubernetes v1.31.1 on containerd 1.7.22 ...
I0920 22:18:53.264393 1436409 cli_runner.go:164] Run: docker network inspect addons-281519 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0920 22:18:53.281644 1436409 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0920 22:18:53.285453 1436409 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0920 22:18:53.296241 1436409 kubeadm.go:883] updating cluster {Name:addons-281519 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-281519 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cus
tomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0920 22:18:53.296369 1436409 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime containerd
I0920 22:18:53.296436 1436409 ssh_runner.go:195] Run: sudo crictl images --output json
I0920 22:18:53.335184 1436409 containerd.go:627] all images are preloaded for containerd runtime.
I0920 22:18:53.335210 1436409 containerd.go:534] Images already preloaded, skipping extraction
I0920 22:18:53.335276 1436409 ssh_runner.go:195] Run: sudo crictl images --output json
I0920 22:18:53.376161 1436409 containerd.go:627] all images are preloaded for containerd runtime.
I0920 22:18:53.376183 1436409 cache_images.go:84] Images are preloaded, skipping loading
I0920 22:18:53.376190 1436409 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.1 containerd true true} ...
I0920 22:18:53.376298 1436409 kubeadm.go:946] kubelet [Unit]
Wants=containerd.service
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-281519 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:addons-281519 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0920 22:18:53.376365 1436409 ssh_runner.go:195] Run: sudo crictl info
I0920 22:18:53.414205 1436409 cni.go:84] Creating CNI manager for ""
I0920 22:18:53.414230 1436409 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0920 22:18:53.414241 1436409 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0920 22:18:53.414264 1436409 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-281519 NodeName:addons-281519 DNSDomain:cluster.local CRISocket:/run/containerd/containerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc
/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///run/containerd/containerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0920 22:18:53.414402 1436409 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///run/containerd/containerd.sock
name: "addons-281519"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///run/containerd/containerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0920 22:18:53.414493 1436409 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I0920 22:18:53.423764 1436409 binaries.go:44] Found k8s binaries, skipping transfer
I0920 22:18:53.423834 1436409 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0920 22:18:53.432999 1436409 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (317 bytes)
I0920 22:18:53.452009 1436409 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0920 22:18:53.471499 1436409 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2167 bytes)
I0920 22:18:53.490548 1436409 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0920 22:18:53.494196 1436409 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0920 22:18:53.506066 1436409 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 22:18:53.611126 1436409 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0920 22:18:53.633230 1436409 certs.go:68] Setting up /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519 for IP: 192.168.49.2
I0920 22:18:53.633253 1436409 certs.go:194] generating shared ca certs ...
I0920 22:18:53.633271 1436409 certs.go:226] acquiring lock for ca certs: {Name:mk47502da61b5f1b3226559bde1f043f5c30fae6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:18:53.633415 1436409 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19672-1430253/.minikube/ca.key
I0920 22:18:54.393000 1436409 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19672-1430253/.minikube/ca.crt ...
I0920 22:18:54.393035 1436409 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-1430253/.minikube/ca.crt: {Name:mk19dfdcf898c57f60127a65679411ba8a920a2b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:18:54.393235 1436409 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19672-1430253/.minikube/ca.key ...
I0920 22:18:54.393250 1436409 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-1430253/.minikube/ca.key: {Name:mk75997620b255dd670ba23679c5a962d0d70c77 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:18:54.393343 1436409 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19672-1430253/.minikube/proxy-client-ca.key
I0920 22:18:55.023117 1436409 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19672-1430253/.minikube/proxy-client-ca.crt ...
I0920 22:18:55.023153 1436409 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-1430253/.minikube/proxy-client-ca.crt: {Name:mk1c5b3d9fe4e5d219dd4482d3e4b2ede7f7e211 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:18:55.023367 1436409 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19672-1430253/.minikube/proxy-client-ca.key ...
I0920 22:18:55.023378 1436409 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-1430253/.minikube/proxy-client-ca.key: {Name:mk5b98e784867735bd69d0022813a55777661206 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:18:55.023458 1436409 certs.go:256] generating profile certs ...
I0920 22:18:55.023518 1436409 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/client.key
I0920 22:18:55.023541 1436409 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/client.crt with IP's: []
I0920 22:18:55.447833 1436409 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/client.crt ...
I0920 22:18:55.447867 1436409 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/client.crt: {Name:mka6b0c91782565cf59713313633c8289abd919d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:18:55.448064 1436409 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/client.key ...
I0920 22:18:55.448078 1436409 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/client.key: {Name:mkae0bad093d293aaafb1d48fb1bae170dac9f38 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:18:55.448167 1436409 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/apiserver.key.d08ae9ac
I0920 22:18:55.448195 1436409 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/apiserver.crt.d08ae9ac with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0920 22:18:55.864407 1436409 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/apiserver.crt.d08ae9ac ...
I0920 22:18:55.864445 1436409 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/apiserver.crt.d08ae9ac: {Name:mk1df99672b8a9cdfe996db67e96cbb8b9792f43 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:18:55.864646 1436409 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/apiserver.key.d08ae9ac ...
I0920 22:18:55.864661 1436409 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/apiserver.key.d08ae9ac: {Name:mke005cdf00ed027081eca4c7d7d62eb1d707359 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:18:55.864770 1436409 certs.go:381] copying /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/apiserver.crt.d08ae9ac -> /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/apiserver.crt
I0920 22:18:55.864854 1436409 certs.go:385] copying /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/apiserver.key.d08ae9ac -> /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/apiserver.key
I0920 22:18:55.864908 1436409 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/proxy-client.key
I0920 22:18:55.864929 1436409 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/proxy-client.crt with IP's: []
I0920 22:18:56.243851 1436409 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/proxy-client.crt ...
I0920 22:18:56.243884 1436409 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/proxy-client.crt: {Name:mk1713d5b4ca8243d786086aab0079f6b79b44c6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:18:56.244080 1436409 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/proxy-client.key ...
I0920 22:18:56.244095 1436409 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/proxy-client.key: {Name:mk7994ccf793093da4f64c2bfd54c77d590c668c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:18:56.244289 1436409 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-1430253/.minikube/certs/ca-key.pem (1679 bytes)
I0920 22:18:56.244336 1436409 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-1430253/.minikube/certs/ca.pem (1082 bytes)
I0920 22:18:56.244369 1436409 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-1430253/.minikube/certs/cert.pem (1123 bytes)
I0920 22:18:56.244399 1436409 certs.go:484] found cert: /home/jenkins/minikube-integration/19672-1430253/.minikube/certs/key.pem (1679 bytes)
I0920 22:18:56.245054 1436409 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-1430253/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0920 22:18:56.270574 1436409 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-1430253/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0920 22:18:56.295704 1436409 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-1430253/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0920 22:18:56.321355 1436409 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-1430253/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0920 22:18:56.347595 1436409 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0920 22:18:56.373290 1436409 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0920 22:18:56.399546 1436409 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0920 22:18:56.425525 1436409 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-1430253/.minikube/profiles/addons-281519/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0920 22:18:56.450782 1436409 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19672-1430253/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0920 22:18:56.475396 1436409 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0920 22:18:56.494054 1436409 ssh_runner.go:195] Run: openssl version
I0920 22:18:56.499601 1436409 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0920 22:18:56.509533 1436409 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0920 22:18:56.513460 1436409 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 20 22:18 /usr/share/ca-certificates/minikubeCA.pem
I0920 22:18:56.513532 1436409 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0920 22:18:56.520592 1436409 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0920 22:18:56.530659 1436409 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0920 22:18:56.534180 1436409 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0920 22:18:56.534250 1436409 kubeadm.go:392] StartCluster: {Name:addons-281519 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726784731-19672@sha256:7f8c62ddb0100a5b958dd19c5b5478b8c7ef13da9a0a4d6c7d18f43544e0dbed Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-281519 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:containerd CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Custom
QemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0920 22:18:56.534337 1436409 cri.go:54] listing CRI containers in root /run/containerd/runc/k8s.io: {State:paused Name: Namespaces:[kube-system]}
I0920 22:18:56.534415 1436409 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
I0920 22:18:56.572503 1436409 cri.go:89] found id: ""
I0920 22:18:56.572587 1436409 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0920 22:18:56.581529 1436409 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0920 22:18:56.590488 1436409 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0920 22:18:56.590554 1436409 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0920 22:18:56.599751 1436409 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0920 22:18:56.599776 1436409 kubeadm.go:157] found existing configuration files:
I0920 22:18:56.599835 1436409 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0920 22:18:56.608776 1436409 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0920 22:18:56.608874 1436409 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0920 22:18:56.618162 1436409 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0920 22:18:56.628214 1436409 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0920 22:18:56.628392 1436409 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0920 22:18:56.637462 1436409 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0920 22:18:56.646803 1436409 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0920 22:18:56.646885 1436409 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0920 22:18:56.655925 1436409 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0920 22:18:56.665459 1436409 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0920 22:18:56.665534 1436409 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0920 22:18:56.677195 1436409 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0920 22:18:56.727483 1436409 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1
I0920 22:18:56.727850 1436409 kubeadm.go:310] [preflight] Running pre-flight checks
I0920 22:18:56.746144 1436409 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0920 22:18:56.746221 1436409 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1070-aws[0m
I0920 22:18:56.746262 1436409 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0920 22:18:56.746313 1436409 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0920 22:18:56.746367 1436409 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0920 22:18:56.746423 1436409 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0920 22:18:56.746478 1436409 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0920 22:18:56.746528 1436409 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0920 22:18:56.746580 1436409 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0920 22:18:56.746631 1436409 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0920 22:18:56.746683 1436409 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0920 22:18:56.746733 1436409 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0920 22:18:56.811465 1436409 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0920 22:18:56.811827 1436409 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0920 22:18:56.811990 1436409 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0920 22:18:56.821280 1436409 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0920 22:18:56.823930 1436409 out.go:235] - Generating certificates and keys ...
I0920 22:18:56.824029 1436409 kubeadm.go:310] [certs] Using existing ca certificate authority
I0920 22:18:56.824105 1436409 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0920 22:18:57.306147 1436409 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0920 22:18:57.837269 1436409 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0920 22:18:58.544021 1436409 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0920 22:18:59.041780 1436409 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0920 22:18:59.738616 1436409 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0920 22:18:59.738941 1436409 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-281519 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0920 22:19:00.670761 1436409 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0920 22:19:00.671089 1436409 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-281519 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0920 22:19:01.223404 1436409 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0920 22:19:01.421003 1436409 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0920 22:19:02.102453 1436409 kubeadm.go:310] [certs] Generating "sa" key and public key
I0920 22:19:02.102710 1436409 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0920 22:19:02.762118 1436409 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0920 22:19:03.065862 1436409 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0920 22:19:03.531516 1436409 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0920 22:19:04.192300 1436409 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0920 22:19:04.939388 1436409 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0920 22:19:04.940641 1436409 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0920 22:19:04.943979 1436409 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0920 22:19:04.945679 1436409 out.go:235] - Booting up control plane ...
I0920 22:19:04.945802 1436409 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0920 22:19:04.946022 1436409 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0920 22:19:04.947513 1436409 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0920 22:19:04.970037 1436409 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0920 22:19:04.976376 1436409 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0920 22:19:04.976625 1436409 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0920 22:19:05.090635 1436409 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0920 22:19:05.090761 1436409 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0920 22:19:06.092564 1436409 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.001600963s
I0920 22:19:06.092667 1436409 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0920 22:19:12.593449 1436409 kubeadm.go:310] [api-check] The API server is healthy after 6.501707061s
I0920 22:19:12.613233 1436409 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0920 22:19:12.628544 1436409 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0920 22:19:12.655835 1436409 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0920 22:19:12.656183 1436409 kubeadm.go:310] [mark-control-plane] Marking the node addons-281519 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0920 22:19:12.672656 1436409 kubeadm.go:310] [bootstrap-token] Using token: f8t1ek.5ljo9dc2gc49m4kx
I0920 22:19:12.675262 1436409 out.go:235] - Configuring RBAC rules ...
I0920 22:19:12.675411 1436409 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0920 22:19:12.682510 1436409 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0920 22:19:12.691561 1436409 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0920 22:19:12.695750 1436409 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0920 22:19:12.700086 1436409 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0920 22:19:12.704596 1436409 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0920 22:19:13.000932 1436409 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0920 22:19:13.443686 1436409 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0920 22:19:14.001617 1436409 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0920 22:19:14.006140 1436409 kubeadm.go:310]
I0920 22:19:14.006221 1436409 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0920 22:19:14.006228 1436409 kubeadm.go:310]
I0920 22:19:14.006305 1436409 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0920 22:19:14.006310 1436409 kubeadm.go:310]
I0920 22:19:14.006335 1436409 kubeadm.go:310] mkdir -p $HOME/.kube
I0920 22:19:14.006393 1436409 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0920 22:19:14.006443 1436409 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0920 22:19:14.006448 1436409 kubeadm.go:310]
I0920 22:19:14.006502 1436409 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0920 22:19:14.006506 1436409 kubeadm.go:310]
I0920 22:19:14.006553 1436409 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0920 22:19:14.006558 1436409 kubeadm.go:310]
I0920 22:19:14.006609 1436409 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0920 22:19:14.006683 1436409 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0920 22:19:14.006750 1436409 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0920 22:19:14.006755 1436409 kubeadm.go:310]
I0920 22:19:14.006838 1436409 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0920 22:19:14.006922 1436409 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0920 22:19:14.006927 1436409 kubeadm.go:310]
I0920 22:19:14.007010 1436409 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token f8t1ek.5ljo9dc2gc49m4kx \
I0920 22:19:14.007112 1436409 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:6dc2094c469bb8347caa7d2317660641ae44274e1d549542a5b48f01e53ced76 \
I0920 22:19:14.007133 1436409 kubeadm.go:310] --control-plane
I0920 22:19:14.007138 1436409 kubeadm.go:310]
I0920 22:19:14.007222 1436409 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0920 22:19:14.007227 1436409 kubeadm.go:310]
I0920 22:19:14.007308 1436409 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token f8t1ek.5ljo9dc2gc49m4kx \
I0920 22:19:14.007498 1436409 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:6dc2094c469bb8347caa7d2317660641ae44274e1d549542a5b48f01e53ced76
I0920 22:19:14.013646 1436409 kubeadm.go:310] W0920 22:18:56.720300 1031 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0920 22:19:14.013952 1436409 kubeadm.go:310] W0920 22:18:56.721399 1031 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0920 22:19:14.014166 1436409 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1070-aws\n", err: exit status 1
I0920 22:19:14.014275 1436409 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0920 22:19:14.014296 1436409 cni.go:84] Creating CNI manager for ""
I0920 22:19:14.014308 1436409 cni.go:143] "docker" driver + "containerd" runtime found, recommending kindnet
I0920 22:19:14.019153 1436409 out.go:177] * Configuring CNI (Container Networking Interface) ...
I0920 22:19:14.022024 1436409 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
I0920 22:19:14.026893 1436409 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.1/kubectl ...
I0920 22:19:14.026915 1436409 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)
I0920 22:19:14.047130 1436409 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
I0920 22:19:14.340828 1436409 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0920 22:19:14.340987 1436409 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-281519 minikube.k8s.io/updated_at=2024_09_20T22_19_14_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=b921bee7dddd4990dd76a4773b23d7ec11e6144f minikube.k8s.io/name=addons-281519 minikube.k8s.io/primary=true
I0920 22:19:14.340993 1436409 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 22:19:14.539125 1436409 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 22:19:14.539196 1436409 ops.go:34] apiserver oom_adj: -16
I0920 22:19:15.040077 1436409 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 22:19:15.540009 1436409 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 22:19:16.039274 1436409 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 22:19:16.539272 1436409 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 22:19:17.040075 1436409 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 22:19:17.540022 1436409 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 22:19:18.039295 1436409 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 22:19:18.539232 1436409 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 22:19:18.685348 1436409 kubeadm.go:1113] duration metric: took 4.344416124s to wait for elevateKubeSystemPrivileges
I0920 22:19:18.685381 1436409 kubeadm.go:394] duration metric: took 22.15115472s to StartCluster
I0920 22:19:18.685399 1436409 settings.go:142] acquiring lock: {Name:mk8122c184de3452969dcaac75d9941b021def6f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:19:18.685510 1436409 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19672-1430253/kubeconfig
I0920 22:19:18.685883 1436409 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19672-1430253/kubeconfig: {Name:mk500657fa1ca41b8bde83419c3881ec1cdd54c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 22:19:18.686077 1436409 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:containerd ControlPlane:true Worker:true}
I0920 22:19:18.686218 1436409 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0920 22:19:18.686462 1436409 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0920 22:19:18.686559 1436409 addons.go:69] Setting yakd=true in profile "addons-281519"
I0920 22:19:18.686577 1436409 addons.go:234] Setting addon yakd=true in "addons-281519"
I0920 22:19:18.686602 1436409 host.go:66] Checking if "addons-281519" exists ...
I0920 22:19:18.687143 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:19:18.687522 1436409 config.go:182] Loaded profile config "addons-281519": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0920 22:19:18.687593 1436409 addons.go:69] Setting inspektor-gadget=true in profile "addons-281519"
I0920 22:19:18.687604 1436409 addons.go:234] Setting addon inspektor-gadget=true in "addons-281519"
I0920 22:19:18.687628 1436409 host.go:66] Checking if "addons-281519" exists ...
I0920 22:19:18.688088 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:19:18.688551 1436409 addons.go:69] Setting cloud-spanner=true in profile "addons-281519"
I0920 22:19:18.688574 1436409 addons.go:234] Setting addon cloud-spanner=true in "addons-281519"
I0920 22:19:18.688602 1436409 host.go:66] Checking if "addons-281519" exists ...
I0920 22:19:18.689076 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:19:18.691782 1436409 addons.go:69] Setting metrics-server=true in profile "addons-281519"
I0920 22:19:18.691914 1436409 addons.go:234] Setting addon metrics-server=true in "addons-281519"
I0920 22:19:18.691960 1436409 host.go:66] Checking if "addons-281519" exists ...
I0920 22:19:18.699504 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:19:18.692277 1436409 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-281519"
I0920 22:19:18.699809 1436409 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-281519"
I0920 22:19:18.699852 1436409 host.go:66] Checking if "addons-281519" exists ...
I0920 22:19:18.700334 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:19:18.692284 1436409 addons.go:69] Setting default-storageclass=true in profile "addons-281519"
I0920 22:19:18.704836 1436409 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-281519"
I0920 22:19:18.692291 1436409 addons.go:69] Setting gcp-auth=true in profile "addons-281519"
I0920 22:19:18.692301 1436409 addons.go:69] Setting ingress=true in profile "addons-281519"
I0920 22:19:18.692307 1436409 addons.go:69] Setting ingress-dns=true in profile "addons-281519"
I0920 22:19:18.704896 1436409 out.go:177] * Verifying Kubernetes components...
I0920 22:19:18.705106 1436409 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-281519"
I0920 22:19:18.705118 1436409 addons.go:69] Setting registry=true in profile "addons-281519"
I0920 22:19:18.705127 1436409 addons.go:69] Setting storage-provisioner=true in profile "addons-281519"
I0920 22:19:18.705134 1436409 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-281519"
I0920 22:19:18.705145 1436409 addons.go:69] Setting volcano=true in profile "addons-281519"
I0920 22:19:18.706912 1436409 addons.go:234] Setting addon volcano=true in "addons-281519"
I0920 22:19:18.706960 1436409 host.go:66] Checking if "addons-281519" exists ...
I0920 22:19:18.707437 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:19:18.709587 1436409 addons.go:234] Setting addon ingress-dns=true in "addons-281519"
I0920 22:19:18.709674 1436409 host.go:66] Checking if "addons-281519" exists ...
I0920 22:19:18.710342 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:19:18.730213 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:19:18.706234 1436409 addons.go:69] Setting volumesnapshots=true in profile "addons-281519"
I0920 22:19:18.730488 1436409 addons.go:234] Setting addon volumesnapshots=true in "addons-281519"
I0920 22:19:18.730535 1436409 host.go:66] Checking if "addons-281519" exists ...
I0920 22:19:18.731008 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:19:18.748250 1436409 mustload.go:65] Loading cluster: addons-281519
I0920 22:19:18.748548 1436409 config.go:182] Loaded profile config "addons-281519": Driver=docker, ContainerRuntime=containerd, KubernetesVersion=v1.31.1
I0920 22:19:18.748933 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:19:18.757115 1436409 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 22:19:18.757414 1436409 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-281519"
I0920 22:19:18.757493 1436409 host.go:66] Checking if "addons-281519" exists ...
I0920 22:19:18.758114 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:19:18.768771 1436409 addons.go:234] Setting addon ingress=true in "addons-281519"
I0920 22:19:18.768918 1436409 host.go:66] Checking if "addons-281519" exists ...
I0920 22:19:18.769462 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:19:18.769695 1436409 addons.go:234] Setting addon registry=true in "addons-281519"
I0920 22:19:18.769766 1436409 host.go:66] Checking if "addons-281519" exists ...
I0920 22:19:18.770215 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:19:18.792685 1436409 addons.go:234] Setting addon storage-provisioner=true in "addons-281519"
I0920 22:19:18.792845 1436409 host.go:66] Checking if "addons-281519" exists ...
I0920 22:19:18.793461 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:19:18.848023 1436409 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-281519"
I0920 22:19:18.848381 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:19:18.879886 1436409 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
I0920 22:19:18.879961 1436409 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0920 22:19:18.909496 1436409 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0920 22:19:18.909568 1436409 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0920 22:19:18.909674 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:19:18.912929 1436409 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0920 22:19:18.926554 1436409 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0920 22:19:18.927504 1436409 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0920 22:19:18.927527 1436409 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0920 22:19:18.928438 1436409 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0920 22:19:18.928518 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:19:18.935201 1436409 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0920 22:19:18.935419 1436409 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0920 22:19:18.935584 1436409 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0920 22:19:18.937680 1436409 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23
I0920 22:19:18.937783 1436409 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0920 22:19:18.937877 1436409 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0920 22:19:18.937948 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:19:18.938531 1436409 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0920 22:19:18.939609 1436409 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0920 22:19:18.939729 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:19:18.950158 1436409 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0920 22:19:18.952924 1436409 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0920 22:19:18.954911 1436409 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0920 22:19:18.954940 1436409 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0920 22:19:18.955005 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:19:18.956719 1436409 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0920 22:19:18.956743 1436409 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0920 22:19:18.956802 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:19:18.972594 1436409 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0920 22:19:18.975155 1436409 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0920 22:19:18.977860 1436409 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0920 22:19:18.977882 1436409 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0920 22:19:18.977958 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:19:18.978141 1436409 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0920 22:19:18.980883 1436409 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0920 22:19:18.983444 1436409 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0920 22:19:18.986234 1436409 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0920 22:19:18.990664 1436409 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0920 22:19:18.993414 1436409 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0920 22:19:19.004533 1436409 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0920 22:19:19.004564 1436409 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0920 22:19:19.004659 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:19:19.015459 1436409 addons.go:234] Setting addon default-storageclass=true in "addons-281519"
I0920 22:19:19.015503 1436409 host.go:66] Checking if "addons-281519" exists ...
I0920 22:19:19.015931 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:19:19.060788 1436409 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0920 22:19:19.067869 1436409 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0920 22:19:19.067970 1436409 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0920 22:19:19.068064 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:19:19.075696 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:19:19.090120 1436409 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-281519"
I0920 22:19:19.090164 1436409 host.go:66] Checking if "addons-281519" exists ...
I0920 22:19:19.090750 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:19:19.111525 1436409 out.go:177] - Using image docker.io/registry:2.8.3
I0920 22:19:19.114129 1436409 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0920 22:19:19.117935 1436409 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0920 22:19:19.117961 1436409 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0920 22:19:19.118032 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:19:19.128757 1436409 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0920 22:19:19.132430 1436409 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0920 22:19:19.132835 1436409 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0920 22:19:19.132853 1436409 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0920 22:19:19.132916 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:19:19.180929 1436409 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0920 22:19:19.180952 1436409 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0920 22:19:19.181041 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:19:19.184374 1436409 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0920 22:19:19.184856 1436409 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0920 22:19:19.185840 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:19:19.189227 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:19:19.189651 1436409 host.go:66] Checking if "addons-281519" exists ...
I0920 22:19:19.223969 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:19:19.240831 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:19:19.257254 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:19:19.273773 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:19:19.277198 1436409 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0920 22:19:19.277220 1436409 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0920 22:19:19.277289 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:19:19.296306 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:19:19.340553 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:19:19.343253 1436409 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0920 22:19:19.348266 1436409 out.go:177] - Using image docker.io/busybox:stable
I0920 22:19:19.357893 1436409 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0920 22:19:19.357929 1436409 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0920 22:19:19.358013 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:19:19.379209 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:19:19.398638 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:19:19.400715 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:19:19.419511 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
W0920 22:19:19.428469 1436409 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0920 22:19:19.428499 1436409 retry.go:31] will retry after 255.715274ms: ssh: handshake failed: EOF
W0920 22:19:19.429143 1436409 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0920 22:19:19.429167 1436409 retry.go:31] will retry after 248.224813ms: ssh: handshake failed: EOF
I0920 22:19:19.447809 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:19:19.698352 1436409 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0920 22:19:19.698431 1436409 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0920 22:19:19.920218 1436409 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0920 22:19:19.920241 1436409 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0920 22:19:20.035184 1436409 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0920 22:19:20.073104 1436409 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0920 22:19:20.073131 1436409 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0920 22:19:20.084381 1436409 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0920 22:19:20.118146 1436409 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0920 22:19:20.118172 1436409 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0920 22:19:20.171743 1436409 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0920 22:19:20.180746 1436409 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0920 22:19:20.204673 1436409 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0920 22:19:20.219413 1436409 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0920 22:19:20.219482 1436409 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0920 22:19:20.271635 1436409 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0920 22:19:20.271707 1436409 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0920 22:19:20.285132 1436409 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0920 22:19:20.285205 1436409 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0920 22:19:20.288529 1436409 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0920 22:19:20.347368 1436409 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0920 22:19:20.347438 1436409 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0920 22:19:20.353675 1436409 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0920 22:19:20.358262 1436409 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0920 22:19:20.364113 1436409 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0920 22:19:20.364194 1436409 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0920 22:19:20.514370 1436409 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0920 22:19:20.514442 1436409 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0920 22:19:20.518983 1436409 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0920 22:19:20.519056 1436409 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0920 22:19:20.522866 1436409 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0920 22:19:20.522938 1436409 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0920 22:19:20.554808 1436409 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0920 22:19:20.554884 1436409 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0920 22:19:20.563987 1436409 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0920 22:19:20.564067 1436409 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0920 22:19:20.606381 1436409 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0920 22:19:20.606459 1436409 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0920 22:19:20.630362 1436409 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0920 22:19:20.630432 1436409 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0920 22:19:20.681541 1436409 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0920 22:19:20.681616 1436409 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0920 22:19:20.713282 1436409 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0920 22:19:20.713361 1436409 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0920 22:19:20.758523 1436409 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0920 22:19:20.779887 1436409 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0920 22:19:20.792436 1436409 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0920 22:19:20.792510 1436409 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0920 22:19:20.829431 1436409 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0920 22:19:20.829532 1436409 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0920 22:19:20.861325 1436409 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0920 22:19:20.861400 1436409 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0920 22:19:20.874047 1436409 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0920 22:19:20.874126 1436409 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0920 22:19:20.882731 1436409 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0920 22:19:20.882808 1436409 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0920 22:19:20.897371 1436409 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0920 22:19:20.897449 1436409 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0920 22:19:21.025479 1436409 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0920 22:19:21.025555 1436409 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0920 22:19:21.142655 1436409 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0920 22:19:21.142718 1436409 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0920 22:19:21.165148 1436409 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0920 22:19:21.165211 1436409 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0920 22:19:21.186112 1436409 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0920 22:19:21.272917 1436409 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0920 22:19:21.272992 1436409 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0920 22:19:21.535305 1436409 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0920 22:19:21.535368 1436409 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0920 22:19:21.543013 1436409 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.358599673s)
I0920 22:19:21.543195 1436409 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.358315249s)
I0920 22:19:21.543266 1436409 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0920 22:19:21.545176 1436409 node_ready.go:35] waiting up to 6m0s for node "addons-281519" to be "Ready" ...
I0920 22:19:21.550890 1436409 node_ready.go:49] node "addons-281519" has status "Ready":"True"
I0920 22:19:21.550912 1436409 node_ready.go:38] duration metric: took 5.492035ms for node "addons-281519" to be "Ready" ...
I0920 22:19:21.550922 1436409 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0920 22:19:21.564897 1436409 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-86k9d" in "kube-system" namespace to be "Ready" ...
I0920 22:19:21.651402 1436409 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0920 22:19:21.652600 1436409 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0920 22:19:21.939743 1436409 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0920 22:19:21.939786 1436409 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0920 22:19:22.053645 1436409 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-281519" context rescaled to 1 replicas
I0920 22:19:22.408197 1436409 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0920 22:19:22.408227 1436409 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0920 22:19:22.568368 1436409 pod_ready.go:98] error getting pod "coredns-7c65d6cfc9-86k9d" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-86k9d" not found
I0920 22:19:22.568443 1436409 pod_ready.go:82] duration metric: took 1.003464625s for pod "coredns-7c65d6cfc9-86k9d" in "kube-system" namespace to be "Ready" ...
E0920 22:19:22.568470 1436409 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-7c65d6cfc9-86k9d" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-86k9d" not found
I0920 22:19:22.568493 1436409 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-j8ztk" in "kube-system" namespace to be "Ready" ...
I0920 22:19:22.771188 1436409 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0920 22:19:24.028076 1436409 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (3.992841906s)
I0920 22:19:24.028183 1436409 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (3.943769734s)
I0920 22:19:24.582495 1436409 pod_ready.go:103] pod "coredns-7c65d6cfc9-j8ztk" in "kube-system" namespace has status "Ready":"False"
I0920 22:19:26.402149 1436409 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0920 22:19:26.402322 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:19:26.441030 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:19:27.039603 1436409 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0920 22:19:27.076955 1436409 pod_ready.go:103] pod "coredns-7c65d6cfc9-j8ztk" in "kube-system" namespace has status "Ready":"False"
I0920 22:19:27.172220 1436409 addons.go:234] Setting addon gcp-auth=true in "addons-281519"
I0920 22:19:27.172324 1436409 host.go:66] Checking if "addons-281519" exists ...
I0920 22:19:27.173002 1436409 cli_runner.go:164] Run: docker container inspect addons-281519 --format={{.State.Status}}
I0920 22:19:27.200207 1436409 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0920 22:19:27.200261 1436409 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-281519
I0920 22:19:27.227546 1436409 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33529 SSHKeyPath:/home/jenkins/minikube-integration/19672-1430253/.minikube/machines/addons-281519/id_rsa Username:docker}
I0920 22:19:29.081181 1436409 pod_ready.go:103] pod "coredns-7c65d6cfc9-j8ztk" in "kube-system" namespace has status "Ready":"False"
I0920 22:19:29.297589 1436409 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (9.125753073s)
I0920 22:19:29.297723 1436409 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (9.116956811s)
I0920 22:19:29.297741 1436409 addons.go:475] Verifying addon ingress=true in "addons-281519"
I0920 22:19:29.297940 1436409 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (9.093244427s)
I0920 22:19:29.298001 1436409 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (9.009406299s)
I0920 22:19:29.298198 1436409 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (8.944447188s)
I0920 22:19:29.298240 1436409 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (8.939902111s)
I0920 22:19:29.298324 1436409 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (8.539728707s)
I0920 22:19:29.298339 1436409 addons.go:475] Verifying addon registry=true in "addons-281519"
I0920 22:19:29.298507 1436409 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.518534083s)
I0920 22:19:29.298522 1436409 addons.go:475] Verifying addon metrics-server=true in "addons-281519"
I0920 22:19:29.298571 1436409 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (8.112373894s)
I0920 22:19:29.298755 1436409 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (7.647269276s)
I0920 22:19:29.298852 1436409 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.646189818s)
W0920 22:19:29.298894 1436409 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0920 22:19:29.298909 1436409 retry.go:31] will retry after 240.43094ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0920 22:19:29.302046 1436409 out.go:177] * Verifying registry addon...
I0920 22:19:29.302171 1436409 out.go:177] * Verifying ingress addon...
I0920 22:19:29.302220 1436409 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-281519 service yakd-dashboard -n yakd-dashboard
I0920 22:19:29.308247 1436409 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0920 22:19:29.311811 1436409 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
W0920 22:19:29.326105 1436409 out.go:270] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class local-path as non-default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
I0920 22:19:29.357273 1436409 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0920 22:19:29.357300 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:29.358504 1436409 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0920 22:19:29.358530 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:29.539828 1436409 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0920 22:19:29.876271 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:29.877320 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:30.334133 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:30.334824 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:30.393956 1436409 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.193714641s)
I0920 22:19:30.394134 1436409 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (7.622855383s)
I0920 22:19:30.394172 1436409 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-281519"
I0920 22:19:30.397950 1436409 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0920 22:19:30.398027 1436409 out.go:177] * Verifying csi-hostpath-driver addon...
I0920 22:19:30.401211 1436409 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0920 22:19:30.402285 1436409 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0920 22:19:30.404145 1436409 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0920 22:19:30.404215 1436409 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0920 22:19:30.407182 1436409 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0920 22:19:30.407203 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:30.485901 1436409 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0920 22:19:30.485975 1436409 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0920 22:19:30.567906 1436409 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0920 22:19:30.567931 1436409 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0920 22:19:30.636215 1436409 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0920 22:19:30.813718 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:30.817202 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:30.915421 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:31.312535 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:31.316557 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:31.414826 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:31.521606 1436409 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.981716797s)
I0920 22:19:31.575025 1436409 pod_ready.go:103] pod "coredns-7c65d6cfc9-j8ztk" in "kube-system" namespace has status "Ready":"False"
I0920 22:19:31.844626 1436409 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.208281756s)
I0920 22:19:31.848567 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:31.849410 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:31.850737 1436409 addons.go:475] Verifying addon gcp-auth=true in "addons-281519"
I0920 22:19:31.854090 1436409 out.go:177] * Verifying gcp-auth addon...
I0920 22:19:31.858031 1436409 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0920 22:19:31.938242 1436409 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0920 22:19:31.939873 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:32.076208 1436409 pod_ready.go:93] pod "coredns-7c65d6cfc9-j8ztk" in "kube-system" namespace has status "Ready":"True"
I0920 22:19:32.076237 1436409 pod_ready.go:82] duration metric: took 9.507701865s for pod "coredns-7c65d6cfc9-j8ztk" in "kube-system" namespace to be "Ready" ...
I0920 22:19:32.076248 1436409 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-281519" in "kube-system" namespace to be "Ready" ...
I0920 22:19:32.081936 1436409 pod_ready.go:93] pod "etcd-addons-281519" in "kube-system" namespace has status "Ready":"True"
I0920 22:19:32.081959 1436409 pod_ready.go:82] duration metric: took 5.703492ms for pod "etcd-addons-281519" in "kube-system" namespace to be "Ready" ...
I0920 22:19:32.081973 1436409 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-281519" in "kube-system" namespace to be "Ready" ...
I0920 22:19:32.087997 1436409 pod_ready.go:93] pod "kube-apiserver-addons-281519" in "kube-system" namespace has status "Ready":"True"
I0920 22:19:32.088075 1436409 pod_ready.go:82] duration metric: took 6.092398ms for pod "kube-apiserver-addons-281519" in "kube-system" namespace to be "Ready" ...
I0920 22:19:32.088109 1436409 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-281519" in "kube-system" namespace to be "Ready" ...
I0920 22:19:32.094250 1436409 pod_ready.go:93] pod "kube-controller-manager-addons-281519" in "kube-system" namespace has status "Ready":"True"
I0920 22:19:32.094275 1436409 pod_ready.go:82] duration metric: took 6.144032ms for pod "kube-controller-manager-addons-281519" in "kube-system" namespace to be "Ready" ...
I0920 22:19:32.094287 1436409 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-n4v2z" in "kube-system" namespace to be "Ready" ...
I0920 22:19:32.100086 1436409 pod_ready.go:93] pod "kube-proxy-n4v2z" in "kube-system" namespace has status "Ready":"True"
I0920 22:19:32.100110 1436409 pod_ready.go:82] duration metric: took 5.814997ms for pod "kube-proxy-n4v2z" in "kube-system" namespace to be "Ready" ...
I0920 22:19:32.100121 1436409 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-281519" in "kube-system" namespace to be "Ready" ...
I0920 22:19:32.313141 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:32.316014 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:32.407837 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:32.475442 1436409 pod_ready.go:93] pod "kube-scheduler-addons-281519" in "kube-system" namespace has status "Ready":"True"
I0920 22:19:32.475518 1436409 pod_ready.go:82] duration metric: took 375.386348ms for pod "kube-scheduler-addons-281519" in "kube-system" namespace to be "Ready" ...
I0920 22:19:32.475561 1436409 pod_ready.go:39] duration metric: took 10.924621029s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0920 22:19:32.475596 1436409 api_server.go:52] waiting for apiserver process to appear ...
I0920 22:19:32.475694 1436409 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0920 22:19:32.491811 1436409 api_server.go:72] duration metric: took 13.805683446s to wait for apiserver process to appear ...
I0920 22:19:32.491884 1436409 api_server.go:88] waiting for apiserver healthz status ...
I0920 22:19:32.491918 1436409 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0920 22:19:32.508063 1436409 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0920 22:19:32.509223 1436409 api_server.go:141] control plane version: v1.31.1
I0920 22:19:32.509282 1436409 api_server.go:131] duration metric: took 17.379016ms to wait for apiserver health ...
I0920 22:19:32.509306 1436409 system_pods.go:43] waiting for kube-system pods to appear ...
I0920 22:19:32.682764 1436409 system_pods.go:59] 18 kube-system pods found
I0920 22:19:32.682851 1436409 system_pods.go:61] "coredns-7c65d6cfc9-j8ztk" [fe42d9e8-6d20-4a18-adc5-651049546df4] Running
I0920 22:19:32.682882 1436409 system_pods.go:61] "csi-hostpath-attacher-0" [18ff05ab-d0b4-417c-8a08-3bf722abfa99] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0920 22:19:32.682927 1436409 system_pods.go:61] "csi-hostpath-resizer-0" [09720ff4-8b14-48a3-a445-4673385d88bf] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0920 22:19:32.682954 1436409 system_pods.go:61] "csi-hostpathplugin-jmnjf" [98d57205-2ed5-421c-bd43-e91b66636889] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0920 22:19:32.682974 1436409 system_pods.go:61] "etcd-addons-281519" [d914ecc9-3216-4978-8bb2-e14bb16a1c49] Running
I0920 22:19:32.682996 1436409 system_pods.go:61] "kindnet-bnr6x" [75f3463c-68b1-4081-9767-a75327ee5bea] Running
I0920 22:19:32.683015 1436409 system_pods.go:61] "kube-apiserver-addons-281519" [003cc209-6057-4590-ba29-31ed60725ce9] Running
I0920 22:19:32.683050 1436409 system_pods.go:61] "kube-controller-manager-addons-281519" [3aa17ef1-8e27-4b92-ab41-98a698ed618d] Running
I0920 22:19:32.683072 1436409 system_pods.go:61] "kube-ingress-dns-minikube" [dc9d9b67-1936-4ebb-b2e9-9cefa370689d] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I0920 22:19:32.683092 1436409 system_pods.go:61] "kube-proxy-n4v2z" [af4e6a42-b69d-4f8b-b42f-8434f9781e59] Running
I0920 22:19:32.683111 1436409 system_pods.go:61] "kube-scheduler-addons-281519" [8ca25d9e-ba25-4069-afff-dcc23c2cf2c9] Running
I0920 22:19:32.683141 1436409 system_pods.go:61] "metrics-server-84c5f94fbc-gfmsd" [9addba80-8409-4e96-8a7e-7b6b2a4467d8] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0920 22:19:32.683171 1436409 system_pods.go:61] "nvidia-device-plugin-daemonset-8dqz2" [bac0acfc-f00e-49a4-a77c-37f2232755d1] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0920 22:19:32.683194 1436409 system_pods.go:61] "registry-66c9cd494c-5zjtf" [16691368-58ed-4373-801b-d2703e08fbf4] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0920 22:19:32.683216 1436409 system_pods.go:61] "registry-proxy-wg86m" [d207c9d3-0623-4927-8289-f3f040dc1957] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0920 22:19:32.683250 1436409 system_pods.go:61] "snapshot-controller-56fcc65765-f72fn" [bde4407d-cb85-47fb-9280-082e5822ca47] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0920 22:19:32.683277 1436409 system_pods.go:61] "snapshot-controller-56fcc65765-qfdll" [466a9281-d9d1-4ecc-8141-c93974f8cf7d] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0920 22:19:32.683299 1436409 system_pods.go:61] "storage-provisioner" [a1a844b9-60e4-4d47-bb50-4cb715b78d3f] Running
I0920 22:19:32.683323 1436409 system_pods.go:74] duration metric: took 173.995556ms to wait for pod list to return data ...
I0920 22:19:32.683354 1436409 default_sa.go:34] waiting for default service account to be created ...
I0920 22:19:32.813935 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:32.817246 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:32.873983 1436409 default_sa.go:45] found service account: "default"
I0920 22:19:32.874053 1436409 default_sa.go:55] duration metric: took 190.672548ms for default service account to be created ...
I0920 22:19:32.874079 1436409 system_pods.go:116] waiting for k8s-apps to be running ...
I0920 22:19:32.915992 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:33.088156 1436409 system_pods.go:86] 18 kube-system pods found
I0920 22:19:33.088771 1436409 system_pods.go:89] "coredns-7c65d6cfc9-j8ztk" [fe42d9e8-6d20-4a18-adc5-651049546df4] Running
I0920 22:19:33.088793 1436409 system_pods.go:89] "csi-hostpath-attacher-0" [18ff05ab-d0b4-417c-8a08-3bf722abfa99] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0920 22:19:33.088813 1436409 system_pods.go:89] "csi-hostpath-resizer-0" [09720ff4-8b14-48a3-a445-4673385d88bf] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0920 22:19:33.088827 1436409 system_pods.go:89] "csi-hostpathplugin-jmnjf" [98d57205-2ed5-421c-bd43-e91b66636889] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0920 22:19:33.088844 1436409 system_pods.go:89] "etcd-addons-281519" [d914ecc9-3216-4978-8bb2-e14bb16a1c49] Running
I0920 22:19:33.088851 1436409 system_pods.go:89] "kindnet-bnr6x" [75f3463c-68b1-4081-9767-a75327ee5bea] Running
I0920 22:19:33.088856 1436409 system_pods.go:89] "kube-apiserver-addons-281519" [003cc209-6057-4590-ba29-31ed60725ce9] Running
I0920 22:19:33.088862 1436409 system_pods.go:89] "kube-controller-manager-addons-281519" [3aa17ef1-8e27-4b92-ab41-98a698ed618d] Running
I0920 22:19:33.088871 1436409 system_pods.go:89] "kube-ingress-dns-minikube" [dc9d9b67-1936-4ebb-b2e9-9cefa370689d] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I0920 22:19:33.088876 1436409 system_pods.go:89] "kube-proxy-n4v2z" [af4e6a42-b69d-4f8b-b42f-8434f9781e59] Running
I0920 22:19:33.088881 1436409 system_pods.go:89] "kube-scheduler-addons-281519" [8ca25d9e-ba25-4069-afff-dcc23c2cf2c9] Running
I0920 22:19:33.088892 1436409 system_pods.go:89] "metrics-server-84c5f94fbc-gfmsd" [9addba80-8409-4e96-8a7e-7b6b2a4467d8] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0920 22:19:33.088900 1436409 system_pods.go:89] "nvidia-device-plugin-daemonset-8dqz2" [bac0acfc-f00e-49a4-a77c-37f2232755d1] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0920 22:19:33.088907 1436409 system_pods.go:89] "registry-66c9cd494c-5zjtf" [16691368-58ed-4373-801b-d2703e08fbf4] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0920 22:19:33.088914 1436409 system_pods.go:89] "registry-proxy-wg86m" [d207c9d3-0623-4927-8289-f3f040dc1957] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0920 22:19:33.088920 1436409 system_pods.go:89] "snapshot-controller-56fcc65765-f72fn" [bde4407d-cb85-47fb-9280-082e5822ca47] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0920 22:19:33.088927 1436409 system_pods.go:89] "snapshot-controller-56fcc65765-qfdll" [466a9281-d9d1-4ecc-8141-c93974f8cf7d] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0920 22:19:33.088939 1436409 system_pods.go:89] "storage-provisioner" [a1a844b9-60e4-4d47-bb50-4cb715b78d3f] Running
I0920 22:19:33.088948 1436409 system_pods.go:126] duration metric: took 214.849421ms to wait for k8s-apps to be running ...
I0920 22:19:33.088956 1436409 system_svc.go:44] waiting for kubelet service to be running ....
I0920 22:19:33.089027 1436409 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0920 22:19:33.124123 1436409 system_svc.go:56] duration metric: took 35.143507ms WaitForService to wait for kubelet
I0920 22:19:33.124158 1436409 kubeadm.go:582] duration metric: took 14.438049253s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0920 22:19:33.124185 1436409 node_conditions.go:102] verifying NodePressure condition ...
I0920 22:19:33.275151 1436409 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0920 22:19:33.275185 1436409 node_conditions.go:123] node cpu capacity is 2
I0920 22:19:33.275199 1436409 node_conditions.go:105] duration metric: took 151.001735ms to run NodePressure ...
I0920 22:19:33.275211 1436409 start.go:241] waiting for startup goroutines ...
I0920 22:19:33.312486 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:33.316784 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:33.407273 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:33.812827 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:33.817205 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:33.907548 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:34.316075 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:34.321162 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:34.418984 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:34.813779 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:34.817223 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:34.916269 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:35.312284 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:35.316269 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:35.414823 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:35.812031 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:35.815652 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:35.907118 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:36.312313 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:36.316357 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:36.408179 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:36.825399 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:36.826949 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:36.907611 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:37.313756 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:37.318021 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:37.416902 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:37.820868 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:37.822220 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:37.908331 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:38.312910 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:38.316560 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:38.416627 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:38.836239 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:38.838428 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:39.038982 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:39.313434 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:39.316558 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:39.415794 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:39.813645 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:39.818373 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:39.915864 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:40.312568 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:40.317074 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:40.414436 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:40.812079 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:40.815871 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:40.908054 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:41.315937 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:41.317835 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:41.408117 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:41.813340 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:41.817082 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:41.907793 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:42.313271 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:42.316312 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:42.407875 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:42.812467 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:42.816493 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:42.907454 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:43.313469 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:43.316255 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:43.407301 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:43.818003 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:43.818852 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:43.919439 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:44.321041 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:44.322933 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:44.407143 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:44.814732 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:44.818567 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:44.908969 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:45.314473 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:45.317903 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:45.407577 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:45.811690 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:45.815513 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:45.908098 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:46.312202 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:46.316785 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:46.414243 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:46.813415 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:46.817242 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:46.914479 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:47.313827 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:47.316055 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:47.408238 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:47.843643 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:47.845124 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:47.921242 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:48.315403 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:48.319704 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:48.408077 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:48.813432 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:48.816769 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:48.910144 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:49.319260 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:49.319661 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:49.408256 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:49.812089 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:49.816426 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:49.915440 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:50.312523 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:50.316810 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:50.406983 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:50.812168 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:50.815965 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:50.909919 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:51.312119 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:51.315997 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:51.407713 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:51.812260 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:51.815941 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:51.915004 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:52.313204 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:52.317023 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:52.415185 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:52.812116 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:52.816537 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:52.907679 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:53.312639 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:53.316581 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:53.407291 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:53.812519 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:53.816233 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:53.907682 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:54.313163 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:54.317158 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:54.408250 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:54.812587 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:54.816491 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:54.907893 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:55.312021 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:55.315903 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:55.406963 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:55.816667 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:55.818001 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:55.908138 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:56.312787 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:56.316416 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:56.407890 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:56.812224 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:56.816220 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:56.907129 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:57.312215 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:57.316325 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:57.407903 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:57.816009 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:57.820621 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:57.915872 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:58.312245 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:58.315991 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:58.406613 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:58.812311 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:58.816594 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:58.906975 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:59.320966 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:59.322425 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:59.421985 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:19:59.812423 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:19:59.816763 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:19:59.913915 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:00.395728 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:00.395911 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:20:00.433274 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:00.886941 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:20:00.888359 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:00.907711 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:01.314110 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:20:01.317073 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:01.410617 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:01.813049 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:20:01.816909 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:01.918202 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:02.312965 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:20:02.316896 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:02.415174 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:02.831315 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:20:02.832074 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:02.921417 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:03.315719 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:20:03.323340 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:03.408836 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:03.813183 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:20:03.819479 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:03.909788 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:04.313259 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:20:04.317568 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:04.414403 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:04.815074 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:20:04.818599 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:04.907478 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:05.313483 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:20:05.316239 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:05.407506 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:05.813996 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:20:05.817177 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:05.906911 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:06.313008 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:20:06.316793 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:06.407195 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:06.813707 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:20:06.817742 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:06.910375 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:07.312654 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:20:07.315710 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:07.407676 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:07.812882 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 22:20:07.816573 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:07.908280 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:08.312532 1436409 kapi.go:107] duration metric: took 39.004273193s to wait for kubernetes.io/minikube-addons=registry ...
I0920 22:20:08.316912 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:08.421489 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:08.816955 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:08.907724 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:09.324489 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:09.421379 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:09.823559 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:09.909428 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:10.316883 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:10.407108 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:10.816872 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:10.908318 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:11.317488 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:11.418342 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:11.816755 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:11.907445 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:12.317208 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:12.408045 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:12.817593 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:12.918635 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:13.317569 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:13.419562 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:13.816451 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:13.908200 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:14.317325 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:14.408505 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:14.817309 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:14.908831 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:15.316515 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:15.407337 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:15.816746 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:15.907987 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:16.317302 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:16.408659 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:16.817819 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:16.907871 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:17.316891 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:17.407642 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:17.816106 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:17.907862 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:18.317212 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:18.411939 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:18.817572 1436409 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 22:20:18.909605 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:19.318955 1436409 kapi.go:107] duration metric: took 50.00714099s to wait for app.kubernetes.io/name=ingress-nginx ...
I0920 22:20:19.420239 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:19.971205 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:20.411260 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:20.965758 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:21.467233 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:21.912350 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:22.407366 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:22.907193 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:23.407523 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:23.908253 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:24.407887 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:24.964744 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 22:20:25.408350 1436409 kapi.go:107] duration metric: took 55.006075083s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0920 22:20:53.873222 1436409 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0920 22:20:53.873255 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:20:54.363200 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:20:54.862981 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:20:55.361358 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:20:55.868986 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:20:56.363423 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:20:56.863115 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:20:57.362261 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:20:57.862503 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:20:58.361766 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:20:58.862109 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:20:59.362668 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:20:59.862217 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:00.370095 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:00.861361 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:01.362849 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:01.863060 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:02.361574 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:02.861969 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:03.362483 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:03.862177 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:04.362262 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:04.861831 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:05.362640 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:05.862092 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:06.362684 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:06.861534 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:07.361259 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:07.862704 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:08.362042 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:08.861973 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:09.361929 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:09.863270 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:10.361355 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:10.862337 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:11.362578 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:11.862381 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:12.362382 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:12.862509 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:13.363116 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:13.862107 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:14.362012 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:14.862721 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:15.361591 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:15.862634 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:16.362344 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:16.862134 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:17.361908 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:17.862355 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:18.361485 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:18.862247 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:19.362539 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:19.863206 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:20.361392 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:20.862777 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:21.361727 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:21.861802 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:22.361647 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:22.861560 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:23.361752 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:23.862927 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:24.366042 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:24.862413 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:25.362500 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:25.863647 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:26.361714 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:26.861989 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:27.362732 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:27.861721 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:28.361624 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:28.861887 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:29.361813 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:29.862374 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:30.362039 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:30.861880 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:31.361675 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:31.862655 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:32.361373 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:32.862760 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:33.362079 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:33.862064 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:34.362014 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:34.865218 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:35.365441 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:35.862564 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:36.361996 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:36.862201 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:37.362696 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:37.861890 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:38.363172 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:38.861995 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:39.361390 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:39.862568 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:40.361998 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:40.862224 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:41.363163 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:41.863421 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:42.362478 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:42.865312 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:43.362668 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:43.862446 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:44.362902 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:44.862165 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:45.363206 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:45.861770 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:46.362494 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:46.861536 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:47.361203 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:47.862719 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:48.362122 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:48.861657 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:49.362110 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:49.862576 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:50.361376 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:50.863035 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:51.362348 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:51.862577 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:52.361476 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:52.862451 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:53.362171 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:53.862751 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:54.362641 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:54.861996 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:55.361612 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:55.862595 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:56.361907 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:56.863749 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:57.361208 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:57.862795 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:58.362823 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:58.861985 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:59.361885 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:21:59.862541 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:22:00.363577 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:22:00.861282 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:22:01.363171 1436409 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 22:22:01.863976 1436409 kapi.go:107] duration metric: took 2m30.005961046s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0920 22:22:01.865431 1436409 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-281519 cluster.
I0920 22:22:01.867311 1436409 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0920 22:22:01.868794 1436409 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0920 22:22:01.870411 1436409 out.go:177] * Enabled addons: storage-provisioner, cloud-spanner, volcano, nvidia-device-plugin, ingress-dns, metrics-server, inspektor-gadget, yakd, storage-provisioner-rancher, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth
I0920 22:22:01.871804 1436409 addons.go:510] duration metric: took 2m43.185338708s for enable addons: enabled=[storage-provisioner cloud-spanner volcano nvidia-device-plugin ingress-dns metrics-server inspektor-gadget yakd storage-provisioner-rancher volumesnapshots registry ingress csi-hostpath-driver gcp-auth]
I0920 22:22:01.871850 1436409 start.go:246] waiting for cluster config update ...
I0920 22:22:01.871872 1436409 start.go:255] writing updated cluster config ...
I0920 22:22:01.872217 1436409 ssh_runner.go:195] Run: rm -f paused
I0920 22:22:02.246376 1436409 start.go:600] kubectl: 1.31.1, cluster: 1.31.1 (minor skew: 0)
I0920 22:22:02.249009 1436409 out.go:177] * Done! kubectl is now configured to use "addons-281519" cluster and "default" namespace by default
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
697201334df6c 4f725bf50aaa5 2 minutes ago Exited gadget 5 6316444d70172 gadget-r9tnk
82c613ca1963b 6ef582f3ec844 3 minutes ago Running gcp-auth 0 bb326161f9fe1 gcp-auth-89d5ffd79-sqfjt
70cf8afc05b9a 8b46b1cd48760 4 minutes ago Running admission 0 7d5922ce5c618 volcano-admission-77d7d48b68-2nclt
81209fe0c9343 ee6d597e62dc8 4 minutes ago Running csi-snapshotter 0 164cd13a333a2 csi-hostpathplugin-jmnjf
3e064c55a449d 642ded511e141 4 minutes ago Running csi-provisioner 0 164cd13a333a2 csi-hostpathplugin-jmnjf
277c461e0832a 922312104da8a 5 minutes ago Running liveness-probe 0 164cd13a333a2 csi-hostpathplugin-jmnjf
4fe9a52702512 08f6b2990811a 5 minutes ago Running hostpath 0 164cd13a333a2 csi-hostpathplugin-jmnjf
3372958306430 289a818c8d9c5 5 minutes ago Running controller 0 186df003730ca ingress-nginx-controller-bc57996ff-4fxgg
3fd01bab825ed 0107d56dbc0be 5 minutes ago Running node-driver-registrar 0 164cd13a333a2 csi-hostpathplugin-jmnjf
510b61b009a42 1505f556b3a7b 5 minutes ago Running volcano-controllers 0 1387169b6cbfd volcano-controllers-56675bb4d5-4mnsn
3abd29f814d8b d9c7ad4c226bf 5 minutes ago Running volcano-scheduler 0 f3c0e40cf6ae8 volcano-scheduler-576bc46687-bjvgr
41b8796c72877 3410e1561990a 5 minutes ago Running registry-proxy 0 b2b570f2a281a registry-proxy-wg86m
96f07008e929c 5548a49bb60ba 5 minutes ago Running metrics-server 0 0f7898212a76b metrics-server-84c5f94fbc-gfmsd
366a236bc36ad 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 e4e11dde0d4c7 snapshot-controller-56fcc65765-qfdll
810e3de151a73 420193b27261a 5 minutes ago Exited patch 0 2c48056be5328 ingress-nginx-admission-patch-9hv94
c15971774f54c 4d1e5c3e97420 5 minutes ago Running volume-snapshot-controller 0 27d934663923d snapshot-controller-56fcc65765-f72fn
d882202504ca8 77bdba588b953 5 minutes ago Running yakd 0 87d2910bfc617 yakd-dashboard-67d98fc6b-ffs9m
dace454c04b63 8be4bcf8ec607 5 minutes ago Running cloud-spanner-emulator 0 47e04e1439523 cloud-spanner-emulator-769b77f747-9c7s7
97c682f151204 420193b27261a 5 minutes ago Exited create 0 eb8fb78b2d431 ingress-nginx-admission-create-4twxw
b9d7d42bb4ebf c9cf76bb104e1 5 minutes ago Running registry 0 7fc9058dacac6 registry-66c9cd494c-5zjtf
e5616d409a4ed 7ce2150c8929b 5 minutes ago Running local-path-provisioner 0 2c7002ee9379e local-path-provisioner-86d989889c-ngvcw
0d4fd5293c8ff a9bac31a5be8d 5 minutes ago Running nvidia-device-plugin-ctr 0 b4be742a3c4be nvidia-device-plugin-daemonset-8dqz2
516797883a9d7 1461903ec4fe9 5 minutes ago Running csi-external-health-monitor-controller 0 164cd13a333a2 csi-hostpathplugin-jmnjf
5e80ae623c5b3 9a80d518f102c 5 minutes ago Running csi-attacher 0 555bbd3b5813f csi-hostpath-attacher-0
5bb6666a265e0 487fa743e1e22 5 minutes ago Running csi-resizer 0 226a092d14377 csi-hostpath-resizer-0
f34a766d8454f 35508c2f890c4 5 minutes ago Running minikube-ingress-dns 0 bbe9c8ab58aac kube-ingress-dns-minikube
ee40e86c6c02a 2f6c962e7b831 5 minutes ago Running coredns 0 6b2056c94408a coredns-7c65d6cfc9-j8ztk
c0bb867353d0c ba04bb24b9575 5 minutes ago Running storage-provisioner 0 2a275be78c287 storage-provisioner
b99407970954b 6a23fa8fd2b78 6 minutes ago Running kindnet-cni 0 7977367e9cd81 kindnet-bnr6x
d142e8ce55392 24a140c548c07 6 minutes ago Running kube-proxy 0 5e1d32992ba67 kube-proxy-n4v2z
6fae8e39e7194 7f8aa378bb47d 6 minutes ago Running kube-scheduler 0 79eb248bed6ba kube-scheduler-addons-281519
0512d9cd2d24c d3f53a98c0a9d 6 minutes ago Running kube-apiserver 0 cab72d8749dee kube-apiserver-addons-281519
4b9763090fada 27e3830e14027 6 minutes ago Running etcd 0 02f8f43fe4218 etcd-addons-281519
2a562655effef 279f381cb3736 6 minutes ago Running kube-controller-manager 0 a599bf2a3a3bd kube-controller-manager-addons-281519
==> containerd <==
Sep 20 22:23:03 addons-281519 containerd[816]: time="2024-09-20T22:23:03.472546464Z" level=info msg="stop pulling image ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec: active requests=0, bytes read=89"
Sep 20 22:23:03 addons-281519 containerd[816]: time="2024-09-20T22:23:03.476610511Z" level=info msg="Pulled image \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" with image id \"sha256:4f725bf50aaa5c697fbb84c107e9c7a3766f0f85f514ffce712d03ee5f62e8dd\", repo tag \"\", repo digest \"ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\", size \"72524105\" in 129.324539ms"
Sep 20 22:23:03 addons-281519 containerd[816]: time="2024-09-20T22:23:03.476667371Z" level=info msg="PullImage \"ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec\" returns image reference \"sha256:4f725bf50aaa5c697fbb84c107e9c7a3766f0f85f514ffce712d03ee5f62e8dd\""
Sep 20 22:23:03 addons-281519 containerd[816]: time="2024-09-20T22:23:03.478896908Z" level=info msg="CreateContainer within sandbox \"6316444d701721cff6caf11d15aa676c36eaa3b0127877cf8b60fa46b5db0833\" for container &ContainerMetadata{Name:gadget,Attempt:5,}"
Sep 20 22:23:03 addons-281519 containerd[816]: time="2024-09-20T22:23:03.502391551Z" level=info msg="CreateContainer within sandbox \"6316444d701721cff6caf11d15aa676c36eaa3b0127877cf8b60fa46b5db0833\" for &ContainerMetadata{Name:gadget,Attempt:5,} returns container id \"697201334df6c42431e4e4bf3c59f66339b7548007e02fed1a2650cea21b220f\""
Sep 20 22:23:03 addons-281519 containerd[816]: time="2024-09-20T22:23:03.503094567Z" level=info msg="StartContainer for \"697201334df6c42431e4e4bf3c59f66339b7548007e02fed1a2650cea21b220f\""
Sep 20 22:23:03 addons-281519 containerd[816]: time="2024-09-20T22:23:03.561524511Z" level=info msg="StartContainer for \"697201334df6c42431e4e4bf3c59f66339b7548007e02fed1a2650cea21b220f\" returns successfully"
Sep 20 22:23:05 addons-281519 containerd[816]: time="2024-09-20T22:23:05.111514944Z" level=error msg="ExecSync for \"697201334df6c42431e4e4bf3c59f66339b7548007e02fed1a2650cea21b220f\" failed" error="failed to exec in container: failed to start exec \"36a36618ed847158cfae418003946c21a7e4906fea33b04507cd8c7b8350b2af\": OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown"
Sep 20 22:23:05 addons-281519 containerd[816]: time="2024-09-20T22:23:05.130378268Z" level=error msg="ExecSync for \"697201334df6c42431e4e4bf3c59f66339b7548007e02fed1a2650cea21b220f\" failed" error="failed to exec in container: failed to start exec \"0edfb9c6159dca3300f63722f3fb48950cfff5765206c00f485183c691564185\": OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown"
Sep 20 22:23:05 addons-281519 containerd[816]: time="2024-09-20T22:23:05.157980066Z" level=error msg="ExecSync for \"697201334df6c42431e4e4bf3c59f66339b7548007e02fed1a2650cea21b220f\" failed" error="failed to exec in container: failed to start exec \"5eb3b8546774b2a1f2f492466b11fd1debcad5b6b513f9395e5399ccc8dcbc4d\": OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown"
Sep 20 22:23:05 addons-281519 containerd[816]: time="2024-09-20T22:23:05.262488738Z" level=info msg="shim disconnected" id=697201334df6c42431e4e4bf3c59f66339b7548007e02fed1a2650cea21b220f namespace=k8s.io
Sep 20 22:23:05 addons-281519 containerd[816]: time="2024-09-20T22:23:05.262547658Z" level=warning msg="cleaning up after shim disconnected" id=697201334df6c42431e4e4bf3c59f66339b7548007e02fed1a2650cea21b220f namespace=k8s.io
Sep 20 22:23:05 addons-281519 containerd[816]: time="2024-09-20T22:23:05.262561713Z" level=info msg="cleaning up dead shim" namespace=k8s.io
Sep 20 22:23:05 addons-281519 containerd[816]: time="2024-09-20T22:23:05.750614222Z" level=info msg="RemoveContainer for \"3b43504e70d472e5b01d9909cbe7fc50583b8954d8a3edf61abcfe41053acf9b\""
Sep 20 22:23:05 addons-281519 containerd[816]: time="2024-09-20T22:23:05.758908646Z" level=info msg="RemoveContainer for \"3b43504e70d472e5b01d9909cbe7fc50583b8954d8a3edf61abcfe41053acf9b\" returns successfully"
Sep 20 22:23:13 addons-281519 containerd[816]: time="2024-09-20T22:23:13.489295174Z" level=info msg="RemoveContainer for \"7d0a057c22389eb0d6b86999e0de615b19dcb4737bda1a9f2aa1262443b4054f\""
Sep 20 22:23:13 addons-281519 containerd[816]: time="2024-09-20T22:23:13.496777703Z" level=info msg="RemoveContainer for \"7d0a057c22389eb0d6b86999e0de615b19dcb4737bda1a9f2aa1262443b4054f\" returns successfully"
Sep 20 22:23:13 addons-281519 containerd[816]: time="2024-09-20T22:23:13.499041520Z" level=info msg="StopPodSandbox for \"5d444cab5effa1333e861891e1080b19f45b371762de52d42f8704bf2c8effd7\""
Sep 20 22:23:13 addons-281519 containerd[816]: time="2024-09-20T22:23:13.506960880Z" level=info msg="TearDown network for sandbox \"5d444cab5effa1333e861891e1080b19f45b371762de52d42f8704bf2c8effd7\" successfully"
Sep 20 22:23:13 addons-281519 containerd[816]: time="2024-09-20T22:23:13.507002774Z" level=info msg="StopPodSandbox for \"5d444cab5effa1333e861891e1080b19f45b371762de52d42f8704bf2c8effd7\" returns successfully"
Sep 20 22:23:13 addons-281519 containerd[816]: time="2024-09-20T22:23:13.507593833Z" level=info msg="RemovePodSandbox for \"5d444cab5effa1333e861891e1080b19f45b371762de52d42f8704bf2c8effd7\""
Sep 20 22:23:13 addons-281519 containerd[816]: time="2024-09-20T22:23:13.507832556Z" level=info msg="Forcibly stopping sandbox \"5d444cab5effa1333e861891e1080b19f45b371762de52d42f8704bf2c8effd7\""
Sep 20 22:23:13 addons-281519 containerd[816]: time="2024-09-20T22:23:13.516059216Z" level=info msg="TearDown network for sandbox \"5d444cab5effa1333e861891e1080b19f45b371762de52d42f8704bf2c8effd7\" successfully"
Sep 20 22:23:13 addons-281519 containerd[816]: time="2024-09-20T22:23:13.522805999Z" level=warning msg="Failed to get podSandbox status for container event for sandboxID \"5d444cab5effa1333e861891e1080b19f45b371762de52d42f8704bf2c8effd7\": an error occurred when try to find sandbox: not found. Sending the event with nil podSandboxStatus."
Sep 20 22:23:13 addons-281519 containerd[816]: time="2024-09-20T22:23:13.522924060Z" level=info msg="RemovePodSandbox \"5d444cab5effa1333e861891e1080b19f45b371762de52d42f8704bf2c8effd7\" returns successfully"
==> coredns [ee40e86c6c02ab6c0ea38df7c7c4b4bff3abcc11e3d56720feb6858d7586d7d1] <==
[INFO] 10.244.0.11:49576 - 42347 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.00010321s
[INFO] 10.244.0.11:43017 - 23127 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002549348s
[INFO] 10.244.0.11:43017 - 15961 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.003288318s
[INFO] 10.244.0.11:56065 - 30808 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.00014992s
[INFO] 10.244.0.11:56065 - 22874 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000090107s
[INFO] 10.244.0.11:48581 - 37758 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000131099s
[INFO] 10.244.0.11:48581 - 9850 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000046851s
[INFO] 10.244.0.11:44555 - 7691 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000063408s
[INFO] 10.244.0.11:44555 - 54534 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000054497s
[INFO] 10.244.0.11:55211 - 54699 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000384524s
[INFO] 10.244.0.11:55211 - 28588 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.005759269s
[INFO] 10.244.0.11:41946 - 19700 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.003907825s
[INFO] 10.244.0.11:41946 - 24827 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.004058664s
[INFO] 10.244.0.11:56212 - 19176 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000065541s
[INFO] 10.244.0.11:56212 - 31989 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000054612s
[INFO] 10.244.0.24:43201 - 3213 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000130516s
[INFO] 10.244.0.24:41067 - 54335 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000462824s
[INFO] 10.244.0.24:34439 - 25190 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.00021835s
[INFO] 10.244.0.24:54752 - 8557 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000138729s
[INFO] 10.244.0.24:34705 - 45423 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000141035s
[INFO] 10.244.0.24:52444 - 36028 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000155164s
[INFO] 10.244.0.24:50752 - 2577 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002607719s
[INFO] 10.244.0.24:54851 - 2839 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002280022s
[INFO] 10.244.0.24:49808 - 36151 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.00197771s
[INFO] 10.244.0.24:39416 - 64791 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 610 0.002100818s
==> describe nodes <==
Name: addons-281519
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-281519
kubernetes.io/os=linux
minikube.k8s.io/commit=b921bee7dddd4990dd76a4773b23d7ec11e6144f
minikube.k8s.io/name=addons-281519
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_20T22_19_14_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-281519
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-281519"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///run/containerd/containerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Fri, 20 Sep 2024 22:19:10 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-281519
AcquireTime: <unset>
RenewTime: Fri, 20 Sep 2024 22:25:20 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Fri, 20 Sep 2024 22:22:17 +0000 Fri, 20 Sep 2024 22:19:07 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Fri, 20 Sep 2024 22:22:17 +0000 Fri, 20 Sep 2024 22:19:07 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Fri, 20 Sep 2024 22:22:17 +0000 Fri, 20 Sep 2024 22:19:07 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Fri, 20 Sep 2024 22:22:17 +0000 Fri, 20 Sep 2024 22:19:11 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-281519
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
System Info:
Machine ID: 99ca235386744d99ab40f248457ece2b
System UUID: 274c85ae-d840-4129-bc3d-5a8be3669885
Boot ID: 7d682649-b07c-44b5-a0a6-3c50df538ea4
Kernel Version: 5.15.0-1070-aws
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: containerd://1.7.22
Kubelet Version: v1.31.1
Kube-Proxy Version: v1.31.1
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (27 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default cloud-spanner-emulator-769b77f747-9c7s7 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m
gadget gadget-r9tnk 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m57s
gcp-auth gcp-auth-89d5ffd79-sqfjt 0 (0%) 0 (0%) 0 (0%) 0 (0%) 4m29s
ingress-nginx ingress-nginx-controller-bc57996ff-4fxgg 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 5m56s
kube-system coredns-7c65d6cfc9-j8ztk 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 6m4s
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system csi-hostpathplugin-jmnjf 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m52s
kube-system etcd-addons-281519 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 6m9s
kube-system kindnet-bnr6x 100m (5%) 100m (5%) 50Mi (0%) 50Mi (0%) 6m4s
kube-system kube-apiserver-addons-281519 250m (12%) 0 (0%) 0 (0%) 0 (0%) 6m9s
kube-system kube-controller-manager-addons-281519 200m (10%) 0 (0%) 0 (0%) 0 (0%) 6m9s
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
kube-system kube-proxy-n4v2z 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m4s
kube-system kube-scheduler-addons-281519 100m (5%) 0 (0%) 0 (0%) 0 (0%) 6m9s
kube-system metrics-server-84c5f94fbc-gfmsd 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 5m58s
kube-system nvidia-device-plugin-daemonset-8dqz2 0 (0%) 0 (0%) 0 (0%) 0 (0%) 6m1s
kube-system registry-66c9cd494c-5zjtf 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
kube-system registry-proxy-wg86m 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
kube-system snapshot-controller-56fcc65765-f72fn 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
kube-system snapshot-controller-56fcc65765-qfdll 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m56s
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
local-path-storage local-path-provisioner-86d989889c-ngvcw 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m59s
volcano-system volcano-admission-77d7d48b68-2nclt 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m55s
volcano-system volcano-controllers-56675bb4d5-4mnsn 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
volcano-system volcano-scheduler-576bc46687-bjvgr 0 (0%) 0 (0%) 0 (0%) 0 (0%) 5m54s
yakd-dashboard yakd-dashboard-67d98fc6b-ffs9m 0 (0%) 0 (0%) 128Mi (1%) 256Mi (3%) 5m57s
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 1050m (52%) 100m (5%)
memory 638Mi (8%) 476Mi (6%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 6m2s kube-proxy
Normal Starting 6m9s kubelet Starting kubelet.
Warning CgroupV1 6m9s kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 6m9s kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 6m9s kubelet Node addons-281519 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 6m9s kubelet Node addons-281519 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 6m9s kubelet Node addons-281519 status is now: NodeHasSufficientPID
Normal RegisteredNode 6m5s node-controller Node addons-281519 event: Registered Node addons-281519 in Controller
==> dmesg <==
[Sep20 22:01] systemd-journald[221]: Failed to send stream file descriptor to service manager: Connection refused
==> etcd [4b9763090fada017215f2bb861233a7215d525a35730eced48990af50f662dd3] <==
{"level":"info","ts":"2024-09-20T22:19:07.049491Z","caller":"fileutil/purge.go:50","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap","max":5,"interval":"30s"}
{"level":"info","ts":"2024-09-20T22:19:07.049500Z","caller":"fileutil/purge.go:50","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}
{"level":"info","ts":"2024-09-20T22:19:07.049566Z","caller":"etcdserver/server.go:751","msg":"started as single-node; fast-forwarding election ticks","local-member-id":"aec36adc501070cc","forward-ticks":9,"forward-duration":"900ms","election-ticks":10,"election-timeout":"1s"}
{"level":"info","ts":"2024-09-20T22:19:07.049856Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc switched to configuration voters=(12593026477526642892)"}
{"level":"info","ts":"2024-09-20T22:19:07.049935Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}
{"level":"info","ts":"2024-09-20T22:19:07.828740Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-09-20T22:19:07.828976Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-09-20T22:19:07.829148Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-09-20T22:19:07.829247Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-09-20T22:19:07.829309Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-20T22:19:07.829413Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-09-20T22:19:07.829491Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-20T22:19:07.832880Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-281519 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-09-20T22:19:07.833172Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-20T22:19:07.833343Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-20T22:19:07.833752Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-20T22:19:07.835451Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-20T22:19:07.849661Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-09-20T22:19:07.849664Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-09-20T22:19:07.850048Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-09-20T22:19:07.850184Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-20T22:19:07.850284Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-20T22:19:07.861777Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-09-20T22:19:07.850411Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-20T22:19:07.868860Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
==> gcp-auth [82c613ca1963bde260fc22083f4c582670975e9adc7197ef0ce54afd0b0b80d9] <==
2024/09/20 22:22:01 GCP Auth Webhook started!
2024/09/20 22:22:19 Ready to marshal response ...
2024/09/20 22:22:19 Ready to write response ...
2024/09/20 22:22:20 Ready to marshal response ...
2024/09/20 22:22:20 Ready to write response ...
==> kernel <==
22:25:22 up 6:07, 0 users, load average: 0.08, 1.58, 2.85
Linux addons-281519 5.15.0-1070-aws #76~20.04.1-Ubuntu SMP Mon Sep 2 12:20:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kindnet [b99407970954b73b50217f4cb38139b36bc2eae4b2cca203545577c9d4f74733] <==
I0920 22:23:20.145992 1 main.go:299] handling current node
I0920 22:23:30.156426 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 22:23:30.156461 1 main.go:299] handling current node
I0920 22:23:40.153069 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 22:23:40.153108 1 main.go:299] handling current node
I0920 22:23:50.146093 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 22:23:50.146131 1 main.go:299] handling current node
I0920 22:24:00.148871 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 22:24:00.149164 1 main.go:299] handling current node
I0920 22:24:10.152838 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 22:24:10.152880 1 main.go:299] handling current node
I0920 22:24:20.145847 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 22:24:20.145881 1 main.go:299] handling current node
I0920 22:24:30.149670 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 22:24:30.149783 1 main.go:299] handling current node
I0920 22:24:40.153575 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 22:24:40.153671 1 main.go:299] handling current node
I0920 22:24:50.154718 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 22:24:50.154757 1 main.go:299] handling current node
I0920 22:25:00.168776 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 22:25:00.168911 1 main.go:299] handling current node
I0920 22:25:10.145659 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 22:25:10.145921 1 main.go:299] handling current node
I0920 22:25:20.146256 1 main.go:295] Handling node with IPs: map[192.168.49.2:{}]
I0920 22:25:20.146289 1 main.go:299] handling current node
==> kube-apiserver [0512d9cd2d24cc3e0615cd1296ed1f9b19448e5b56f910bc0cce629a12f2a16c] <==
W0920 22:20:28.823106 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.147.17:443: connect: connection refused
W0920 22:20:29.827860 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.147.17:443: connect: connection refused
W0920 22:20:30.838195 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.147.17:443: connect: connection refused
W0920 22:20:31.907698 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.147.17:443: connect: connection refused
W0920 22:20:32.948041 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.147.17:443: connect: connection refused
W0920 22:20:33.952433 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.147.17:443: connect: connection refused
W0920 22:20:34.847876 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.97.150.253:443: connect: connection refused
E0920 22:20:34.848093 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.97.150.253:443: connect: connection refused" logger="UnhandledError"
W0920 22:20:34.849981 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.101.147.17:443: connect: connection refused
W0920 22:20:34.879826 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.97.150.253:443: connect: connection refused
E0920 22:20:34.879871 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.97.150.253:443: connect: connection refused" logger="UnhandledError"
W0920 22:20:34.881576 1 dispatcher.go:225] Failed calling webhook, failing closed mutatepod.volcano.sh: failed calling webhook "mutatepod.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/pods/mutate?timeout=10s": dial tcp 10.101.147.17:443: connect: connection refused
W0920 22:20:35.012533 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.147.17:443: connect: connection refused
W0920 22:20:36.053792 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.147.17:443: connect: connection refused
W0920 22:20:37.110716 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.147.17:443: connect: connection refused
W0920 22:20:38.157479 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.147.17:443: connect: connection refused
W0920 22:20:39.224061 1 dispatcher.go:225] Failed calling webhook, failing closed mutatequeue.volcano.sh: failed calling webhook "mutatequeue.volcano.sh": failed to call webhook: Post "https://volcano-admission-service.volcano-system.svc:443/queues/mutate?timeout=10s": dial tcp 10.101.147.17:443: connect: connection refused
W0920 22:20:53.807552 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.97.150.253:443: connect: connection refused
E0920 22:20:53.807593 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.97.150.253:443: connect: connection refused" logger="UnhandledError"
W0920 22:21:34.862050 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.97.150.253:443: connect: connection refused
E0920 22:21:34.862098 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.97.150.253:443: connect: connection refused" logger="UnhandledError"
W0920 22:21:34.888531 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.97.150.253:443: connect: connection refused
E0920 22:21:34.888592 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.97.150.253:443: connect: connection refused" logger="UnhandledError"
I0920 22:22:19.808555 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I0920 22:22:19.849505 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
==> kube-controller-manager [2a562655effefba2a4c0f5fb7686da9feccb0aefe1690828cfe617dc01e58627] <==
I0920 22:21:34.918500 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0920 22:21:34.937324 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0920 22:21:34.937374 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0920 22:21:34.960819 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0920 22:21:35.488022 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0920 22:21:35.881499 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0920 22:21:36.478310 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0920 22:21:36.492466 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0920 22:21:36.887614 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0920 22:21:37.623857 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0920 22:21:37.646565 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0920 22:21:37.896155 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0920 22:21:37.906742 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0920 22:21:37.913887 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="1s"
I0920 22:21:38.654026 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0920 22:21:38.662532 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0920 22:21:38.669939 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="1s"
I0920 22:22:01.594179 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="13.529619ms"
I0920 22:22:01.594261 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="gcp-auth/gcp-auth-89d5ffd79" duration="40.786µs"
I0920 22:22:07.025684 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0920 22:22:07.071919 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-create" delay="0s"
I0920 22:22:08.015708 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0920 22:22:08.081281 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="gcp-auth/gcp-auth-certs-patch" delay="0s"
I0920 22:22:17.112424 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-281519"
I0920 22:22:19.500778 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="volcano-system/volcano-admission-init" delay="0s"
==> kube-proxy [d142e8ce55392098ceef9d74165efdf78142ce196e765ce3b5c7259d2087d797] <==
I0920 22:19:19.733557 1 server_linux.go:66] "Using iptables proxy"
I0920 22:19:19.809828 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0920 22:19:19.809909 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0920 22:19:19.850406 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0920 22:19:19.850486 1 server_linux.go:169] "Using iptables Proxier"
I0920 22:19:19.852470 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0920 22:19:19.861458 1 server.go:483] "Version info" version="v1.31.1"
I0920 22:19:19.861505 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0920 22:19:19.865967 1 config.go:199] "Starting service config controller"
I0920 22:19:19.866018 1 shared_informer.go:313] Waiting for caches to sync for service config
I0920 22:19:19.866076 1 config.go:105] "Starting endpoint slice config controller"
I0920 22:19:19.866081 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0920 22:19:19.867980 1 config.go:328] "Starting node config controller"
I0920 22:19:19.867998 1 shared_informer.go:313] Waiting for caches to sync for node config
I0920 22:19:19.966440 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0920 22:19:19.966497 1 shared_informer.go:320] Caches are synced for service config
I0920 22:19:19.968191 1 shared_informer.go:320] Caches are synced for node config
==> kube-scheduler [6fae8e39e7194bf171e1b73bf5aa3f0187a7bad5172e6e81ca9f734dd383aa1c] <==
W0920 22:19:10.844308 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0920 22:19:10.844365 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0920 22:19:10.844503 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0920 22:19:10.844537 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0920 22:19:10.844624 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0920 22:19:10.844643 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0920 22:19:10.844838 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0920 22:19:10.844925 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0920 22:19:10.845440 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0920 22:19:10.845609 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0920 22:19:11.654141 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0920 22:19:11.654190 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0920 22:19:11.749869 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0920 22:19:11.750177 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0920 22:19:11.857206 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0920 22:19:11.857262 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0920 22:19:11.930079 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0920 22:19:11.930128 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0920 22:19:11.968612 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0920 22:19:11.968878 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0920 22:19:12.064508 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0920 22:19:12.064553 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0920 22:19:12.080182 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0920 22:19:12.080230 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
I0920 22:19:12.436912 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 20 22:23:20 addons-281519 kubelet[1497]: I0920 22:23:20.345464 1497 scope.go:117] "RemoveContainer" containerID="697201334df6c42431e4e4bf3c59f66339b7548007e02fed1a2650cea21b220f"
Sep 20 22:23:20 addons-281519 kubelet[1497]: E0920 22:23:20.345688 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-r9tnk_gadget(20cfb543-cce1-4c47-b904-0d75f3979d1e)\"" pod="gadget/gadget-r9tnk" podUID="20cfb543-cce1-4c47-b904-0d75f3979d1e"
Sep 20 22:23:29 addons-281519 kubelet[1497]: I0920 22:23:29.345421 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-5zjtf" secret="" err="secret \"gcp-auth\" not found"
Sep 20 22:23:29 addons-281519 kubelet[1497]: I0920 22:23:29.345937 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-8dqz2" secret="" err="secret \"gcp-auth\" not found"
Sep 20 22:23:32 addons-281519 kubelet[1497]: I0920 22:23:32.345519 1497 scope.go:117] "RemoveContainer" containerID="697201334df6c42431e4e4bf3c59f66339b7548007e02fed1a2650cea21b220f"
Sep 20 22:23:32 addons-281519 kubelet[1497]: E0920 22:23:32.345754 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-r9tnk_gadget(20cfb543-cce1-4c47-b904-0d75f3979d1e)\"" pod="gadget/gadget-r9tnk" podUID="20cfb543-cce1-4c47-b904-0d75f3979d1e"
Sep 20 22:23:47 addons-281519 kubelet[1497]: I0920 22:23:47.345760 1497 scope.go:117] "RemoveContainer" containerID="697201334df6c42431e4e4bf3c59f66339b7548007e02fed1a2650cea21b220f"
Sep 20 22:23:47 addons-281519 kubelet[1497]: E0920 22:23:47.346478 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-r9tnk_gadget(20cfb543-cce1-4c47-b904-0d75f3979d1e)\"" pod="gadget/gadget-r9tnk" podUID="20cfb543-cce1-4c47-b904-0d75f3979d1e"
Sep 20 22:24:00 addons-281519 kubelet[1497]: I0920 22:24:00.362091 1497 scope.go:117] "RemoveContainer" containerID="697201334df6c42431e4e4bf3c59f66339b7548007e02fed1a2650cea21b220f"
Sep 20 22:24:00 addons-281519 kubelet[1497]: E0920 22:24:00.362383 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-r9tnk_gadget(20cfb543-cce1-4c47-b904-0d75f3979d1e)\"" pod="gadget/gadget-r9tnk" podUID="20cfb543-cce1-4c47-b904-0d75f3979d1e"
Sep 20 22:24:03 addons-281519 kubelet[1497]: I0920 22:24:03.346103 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-proxy-wg86m" secret="" err="secret \"gcp-auth\" not found"
Sep 20 22:24:14 addons-281519 kubelet[1497]: I0920 22:24:14.345281 1497 scope.go:117] "RemoveContainer" containerID="697201334df6c42431e4e4bf3c59f66339b7548007e02fed1a2650cea21b220f"
Sep 20 22:24:14 addons-281519 kubelet[1497]: E0920 22:24:14.345575 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-r9tnk_gadget(20cfb543-cce1-4c47-b904-0d75f3979d1e)\"" pod="gadget/gadget-r9tnk" podUID="20cfb543-cce1-4c47-b904-0d75f3979d1e"
Sep 20 22:24:26 addons-281519 kubelet[1497]: I0920 22:24:26.345032 1497 scope.go:117] "RemoveContainer" containerID="697201334df6c42431e4e4bf3c59f66339b7548007e02fed1a2650cea21b220f"
Sep 20 22:24:26 addons-281519 kubelet[1497]: E0920 22:24:26.345263 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-r9tnk_gadget(20cfb543-cce1-4c47-b904-0d75f3979d1e)\"" pod="gadget/gadget-r9tnk" podUID="20cfb543-cce1-4c47-b904-0d75f3979d1e"
Sep 20 22:24:30 addons-281519 kubelet[1497]: I0920 22:24:30.345317 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/nvidia-device-plugin-daemonset-8dqz2" secret="" err="secret \"gcp-auth\" not found"
Sep 20 22:24:40 addons-281519 kubelet[1497]: I0920 22:24:40.345280 1497 kubelet_pods.go:1007] "Unable to retrieve pull secret, the image pull may not succeed." pod="kube-system/registry-66c9cd494c-5zjtf" secret="" err="secret \"gcp-auth\" not found"
Sep 20 22:24:41 addons-281519 kubelet[1497]: I0920 22:24:41.345230 1497 scope.go:117] "RemoveContainer" containerID="697201334df6c42431e4e4bf3c59f66339b7548007e02fed1a2650cea21b220f"
Sep 20 22:24:41 addons-281519 kubelet[1497]: E0920 22:24:41.345705 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-r9tnk_gadget(20cfb543-cce1-4c47-b904-0d75f3979d1e)\"" pod="gadget/gadget-r9tnk" podUID="20cfb543-cce1-4c47-b904-0d75f3979d1e"
Sep 20 22:24:53 addons-281519 kubelet[1497]: I0920 22:24:53.347134 1497 scope.go:117] "RemoveContainer" containerID="697201334df6c42431e4e4bf3c59f66339b7548007e02fed1a2650cea21b220f"
Sep 20 22:24:53 addons-281519 kubelet[1497]: E0920 22:24:53.347323 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-r9tnk_gadget(20cfb543-cce1-4c47-b904-0d75f3979d1e)\"" pod="gadget/gadget-r9tnk" podUID="20cfb543-cce1-4c47-b904-0d75f3979d1e"
Sep 20 22:25:05 addons-281519 kubelet[1497]: I0920 22:25:05.345661 1497 scope.go:117] "RemoveContainer" containerID="697201334df6c42431e4e4bf3c59f66339b7548007e02fed1a2650cea21b220f"
Sep 20 22:25:05 addons-281519 kubelet[1497]: E0920 22:25:05.345861 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-r9tnk_gadget(20cfb543-cce1-4c47-b904-0d75f3979d1e)\"" pod="gadget/gadget-r9tnk" podUID="20cfb543-cce1-4c47-b904-0d75f3979d1e"
Sep 20 22:25:18 addons-281519 kubelet[1497]: I0920 22:25:18.344957 1497 scope.go:117] "RemoveContainer" containerID="697201334df6c42431e4e4bf3c59f66339b7548007e02fed1a2650cea21b220f"
Sep 20 22:25:18 addons-281519 kubelet[1497]: E0920 22:25:18.345219 1497 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=gadget pod=gadget-r9tnk_gadget(20cfb543-cce1-4c47-b904-0d75f3979d1e)\"" pod="gadget/gadget-r9tnk" podUID="20cfb543-cce1-4c47-b904-0d75f3979d1e"
==> storage-provisioner [c0bb867353d0ca6b978764de47fb31ae4c94652de81131ce3f9442e96f49e621] <==
I0920 22:19:24.757440 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0920 22:19:24.769600 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0920 22:19:24.769680 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0920 22:19:24.781281 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0920 22:19:24.781447 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-281519_afe4dfd8-469e-4526-a54e-63ae296ef41a!
I0920 22:19:24.782699 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"38c13bbb-b4d8-44c3-a1cc-1593ecfc1fdc", APIVersion:"v1", ResourceVersion:"553", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-281519_afe4dfd8-469e-4526-a54e-63ae296ef41a became leader
I0920 22:19:24.882567 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-281519_afe4dfd8-469e-4526-a54e-63ae296ef41a!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-281519 -n addons-281519
helpers_test.go:261: (dbg) Run: kubectl --context addons-281519 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: ingress-nginx-admission-create-4twxw ingress-nginx-admission-patch-9hv94 test-job-nginx-0
helpers_test.go:274: ======> post-mortem[TestAddons/serial/Volcano]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-281519 describe pod ingress-nginx-admission-create-4twxw ingress-nginx-admission-patch-9hv94 test-job-nginx-0
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-281519 describe pod ingress-nginx-admission-create-4twxw ingress-nginx-admission-patch-9hv94 test-job-nginx-0: exit status 1 (89.686662ms)
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-4twxw" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-9hv94" not found
Error from server (NotFound): pods "test-job-nginx-0" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-281519 describe pod ingress-nginx-admission-create-4twxw ingress-nginx-admission-patch-9hv94 test-job-nginx-0: exit status 1
--- FAIL: TestAddons/serial/Volcano (201.05s)