=== RUN TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry
=== CONT TestAddons/parallel/Registry
addons_test.go:332: registry stabilized in 2.648873ms
addons_test.go:334: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-66c9cd494c-gfmv4" [0f09071c-4485-4e48-a170-d531d56fd35c] Running
addons_test.go:334: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.003044805s
addons_test.go:337: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-chxww" [f8ed4610-be7a-4b55-bcd6-dbb3920e9ff3] Running
addons_test.go:337: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.003611961s
addons_test.go:342: (dbg) Run: kubectl --context addons-794116 delete po -l run=registry-test --now
addons_test.go:347: (dbg) Run: kubectl --context addons-794116 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:347: (dbg) Non-zero exit: kubectl --context addons-794116 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": exit status 1 (1m0.07272278s)
-- stdout --
pod "registry-test" deleted
-- /stdout --
** stderr **
error: timed out waiting for the condition
** /stderr **
addons_test.go:349: failed to hit registry.kube-system.svc.cluster.local. args "kubectl --context addons-794116 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c \"wget --spider -S http://registry.kube-system.svc.cluster.local\"" failed: exit status 1
addons_test.go:353: expected curl response be "HTTP/1.1 200", but got *pod "registry-test" deleted
*
addons_test.go:361: (dbg) Run: out/minikube-linux-amd64 -p addons-794116 ip
2024/09/13 23:40:18 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:390: (dbg) Run: out/minikube-linux-amd64 -p addons-794116 addons disable registry --alsologtostderr -v=1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/parallel/Registry]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-794116
helpers_test.go:235: (dbg) docker inspect addons-794116:
-- stdout --
[
{
"Id": "e955bd978692d6a4122ed147d28e91050245e5024293afcac45d7ea94aff0dcb",
"Created": "2024-09-13T23:27:15.232503875Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 14120,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-13T23:27:15.364981776Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:fb4c54d38bc255b13af7cf88ad73ea4984e36b44c4e3dc7bb7254a48e49cb35f",
"ResolvConfPath": "/var/lib/docker/containers/e955bd978692d6a4122ed147d28e91050245e5024293afcac45d7ea94aff0dcb/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/e955bd978692d6a4122ed147d28e91050245e5024293afcac45d7ea94aff0dcb/hostname",
"HostsPath": "/var/lib/docker/containers/e955bd978692d6a4122ed147d28e91050245e5024293afcac45d7ea94aff0dcb/hosts",
"LogPath": "/var/lib/docker/containers/e955bd978692d6a4122ed147d28e91050245e5024293afcac45d7ea94aff0dcb/e955bd978692d6a4122ed147d28e91050245e5024293afcac45d7ea94aff0dcb-json.log",
"Name": "/addons-794116",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-794116:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "addons-794116",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/760c18ec3e86aadcac815ba3292cd1bffcdeff3767fe37c3e462fa0ba7a7a7dc-init/diff:/var/lib/docker/overlay2/965d0374b84c91cf7c53733bff1ad21be77fb6940113f2e44415f380d7ed4fe1/diff",
"MergedDir": "/var/lib/docker/overlay2/760c18ec3e86aadcac815ba3292cd1bffcdeff3767fe37c3e462fa0ba7a7a7dc/merged",
"UpperDir": "/var/lib/docker/overlay2/760c18ec3e86aadcac815ba3292cd1bffcdeff3767fe37c3e462fa0ba7a7a7dc/diff",
"WorkDir": "/var/lib/docker/overlay2/760c18ec3e86aadcac815ba3292cd1bffcdeff3767fe37c3e462fa0ba7a7a7dc/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-794116",
"Source": "/var/lib/docker/volumes/addons-794116/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-794116",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-794116",
"name.minikube.sigs.k8s.io": "addons-794116",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "ae88d3a24157e6cfffcb5c988df56e90677a5592ff7202c51c9ac432227405ed",
"SandboxKey": "/var/run/docker/netns/ae88d3a24157",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32768"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32769"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32772"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32770"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32771"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-794116": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "301df9a7e900579030cce613e7ca165a339a5fbabd0532d3f2fa268497a4bb2b",
"EndpointID": "f9e31ad20468a84967f378fae1a9bc732829c7cf9eb446e396008504058cdc77",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-794116",
"e955bd978692"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p addons-794116 -n addons-794116
helpers_test.go:244: <<< TestAddons/parallel/Registry FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/parallel/Registry]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p addons-794116 logs -n 25
helpers_test.go:252: TestAddons/parallel/Registry logs:
-- stdout --
==> Audit <==
|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| delete | -p download-docker-398633 | download-docker-398633 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | 13 Sep 24 23:26 UTC |
| start | --download-only -p | binary-mirror-717802 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | |
| | binary-mirror-717802 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:32877 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| delete | -p binary-mirror-717802 | binary-mirror-717802 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | 13 Sep 24 23:26 UTC |
| addons | enable dashboard -p | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | |
| | addons-794116 | | | | | |
| addons | disable dashboard -p | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | |
| | addons-794116 | | | | | |
| start | -p addons-794116 --wait=true | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | 13 Sep 24 23:30 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
| | --addons=helm-tiller | | | | | |
| addons | addons-794116 addons disable | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:30 UTC | 13 Sep 24 23:31 UTC |
| | volcano --alsologtostderr -v=1 | | | | | |
| addons | addons-794116 addons disable | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:39 UTC | 13 Sep 24 23:39 UTC |
| | yakd --alsologtostderr -v=1 | | | | | |
| addons | addons-794116 addons disable | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:39 UTC | 13 Sep 24 23:39 UTC |
| | helm-tiller --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| addons | disable nvidia-device-plugin | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:39 UTC | 13 Sep 24 23:39 UTC |
| | -p addons-794116 | | | | | |
| ssh | addons-794116 ssh cat | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:39 UTC | 13 Sep 24 23:39 UTC |
| | /opt/local-path-provisioner/pvc-6b1450aa-8425-40e9-a121-ba8dd1de215e_default_test-pvc/file1 | | | | | |
| addons | disable cloud-spanner -p | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:39 UTC | 13 Sep 24 23:39 UTC |
| | addons-794116 | | | | | |
| addons | addons-794116 addons disable | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:39 UTC | 13 Sep 24 23:40 UTC |
| | storage-provisioner-rancher | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | enable headlamp | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:39 UTC | 13 Sep 24 23:39 UTC |
| | -p addons-794116 | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-794116 addons disable | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:39 UTC | 13 Sep 24 23:39 UTC |
| | headlamp --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| addons | addons-794116 addons | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:39 UTC | 13 Sep 24 23:39 UTC |
| | disable csi-hostpath-driver | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-794116 addons | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:39 UTC | 13 Sep 24 23:39 UTC |
| | disable metrics-server | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-794116 addons | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:39 UTC | 13 Sep 24 23:39 UTC |
| | disable volumesnapshots | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | disable inspektor-gadget -p | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:39 UTC | 13 Sep 24 23:40 UTC |
| | addons-794116 | | | | | |
| ssh | addons-794116 ssh curl -s | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:40 UTC | 13 Sep 24 23:40 UTC |
| | http://127.0.0.1/ -H 'Host: | | | | | |
| | nginx.example.com' | | | | | |
| ip | addons-794116 ip | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:40 UTC | 13 Sep 24 23:40 UTC |
| addons | addons-794116 addons disable | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:40 UTC | 13 Sep 24 23:40 UTC |
| | ingress-dns --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| addons | addons-794116 addons disable | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:40 UTC | 13 Sep 24 23:40 UTC |
| | ingress --alsologtostderr -v=1 | | | | | |
| ip | addons-794116 ip | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:40 UTC | 13 Sep 24 23:40 UTC |
| addons | addons-794116 addons disable | addons-794116 | jenkins | v1.34.0 | 13 Sep 24 23:40 UTC | 13 Sep 24 23:40 UTC |
| | registry --alsologtostderr | | | | | |
| | -v=1 | | | | | |
|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/13 23:26:53
Running on machine: ubuntu-20-agent
Binary: Built with gc go1.23.0 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0913 23:26:53.726981 13384 out.go:345] Setting OutFile to fd 1 ...
I0913 23:26:53.727232 13384 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0913 23:26:53.727242 13384 out.go:358] Setting ErrFile to fd 2...
I0913 23:26:53.727248 13384 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0913 23:26:53.727458 13384 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19640-5233/.minikube/bin
I0913 23:26:53.728048 13384 out.go:352] Setting JSON to false
I0913 23:26:53.728857 13384 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent","uptime":560,"bootTime":1726269454,"procs":173,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1068-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0913 23:26:53.728953 13384 start.go:139] virtualization: kvm guest
I0913 23:26:53.730998 13384 out.go:177] * [addons-794116] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I0913 23:26:53.732290 13384 notify.go:220] Checking for updates...
I0913 23:26:53.732298 13384 out.go:177] - MINIKUBE_LOCATION=19640
I0913 23:26:53.733637 13384 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0913 23:26:53.734934 13384 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19640-5233/kubeconfig
I0913 23:26:53.736190 13384 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19640-5233/.minikube
I0913 23:26:53.737400 13384 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0913 23:26:53.738817 13384 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0913 23:26:53.740211 13384 driver.go:394] Setting default libvirt URI to qemu:///system
I0913 23:26:53.761137 13384 docker.go:123] docker version: linux-27.2.1:Docker Engine - Community
I0913 23:26:53.761223 13384 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0913 23:26:53.804051 13384 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:26 OomKillDisable:true NGoroutines:45 SystemTime:2024-09-13 23:26:53.795490691 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647931392 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent Labels:[] ExperimentalBuild:false ServerVersion:27.2.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I0913 23:26:53.804153 13384 docker.go:318] overlay module found
I0913 23:26:53.805907 13384 out.go:177] * Using the docker driver based on user configuration
I0913 23:26:53.807447 13384 start.go:297] selected driver: docker
I0913 23:26:53.807458 13384 start.go:901] validating driver "docker" against <nil>
I0913 23:26:53.807468 13384 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0913 23:26:53.808243 13384 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0913 23:26:53.859551 13384 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:26 OomKillDisable:true NGoroutines:45 SystemTime:2024-09-13 23:26:53.850864418 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1068-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647931392 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent Labels:[] ExperimentalBuild:false ServerVersion:27.2.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerError
s:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I0913 23:26:53.859711 13384 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0913 23:26:53.859922 13384 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0913 23:26:53.861547 13384 out.go:177] * Using Docker driver with root privileges
I0913 23:26:53.862924 13384 cni.go:84] Creating CNI manager for ""
I0913 23:26:53.862981 13384 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0913 23:26:53.862992 13384 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0913 23:26:53.863049 13384 start.go:340] cluster config:
{Name:addons-794116 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-794116 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock:
SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0913 23:26:53.864301 13384 out.go:177] * Starting "addons-794116" primary control-plane node in "addons-794116" cluster
I0913 23:26:53.865489 13384 cache.go:121] Beginning downloading kic base image for docker with docker
I0913 23:26:53.866869 13384 out.go:177] * Pulling base image v0.0.45-1726243947-19640 ...
I0913 23:26:53.868189 13384 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker
I0913 23:26:53.868210 13384 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 in local docker daemon
I0913 23:26:53.868229 13384 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19640-5233/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-amd64.tar.lz4
I0913 23:26:53.868241 13384 cache.go:56] Caching tarball of preloaded images
I0913 23:26:53.868316 13384 preload.go:172] Found /home/jenkins/minikube-integration/19640-5233/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0913 23:26:53.868330 13384 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker
I0913 23:26:53.868687 13384 profile.go:143] Saving config to /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/config.json ...
I0913 23:26:53.868710 13384 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/config.json: {Name:mk639203eb5af59b52e495976b1b496dac05ebda Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:26:53.884849 13384 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 to local cache
I0913 23:26:53.884962 13384 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 in local cache directory
I0913 23:26:53.884983 13384 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 in local cache directory, skipping pull
I0913 23:26:53.884989 13384 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 exists in cache, skipping pull
I0913 23:26:53.884996 13384 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 as a tarball
I0913 23:26:53.885003 13384 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 from local cache
I0913 23:27:05.885128 13384 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 from cached tarball
I0913 23:27:05.885173 13384 cache.go:194] Successfully downloaded all kic artifacts
I0913 23:27:05.885219 13384 start.go:360] acquireMachinesLock for addons-794116: {Name:mke5a55736d17aa9d07bacd9d88d2045e8a8297c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0913 23:27:05.885323 13384 start.go:364] duration metric: took 81.049µs to acquireMachinesLock for "addons-794116"
I0913 23:27:05.885352 13384 start.go:93] Provisioning new machine with config: &{Name:addons-794116 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-794116 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cust
omQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0913 23:27:05.885439 13384 start.go:125] createHost starting for "" (driver="docker")
I0913 23:27:05.887256 13384 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0913 23:27:05.887520 13384 start.go:159] libmachine.API.Create for "addons-794116" (driver="docker")
I0913 23:27:05.887552 13384 client.go:168] LocalClient.Create starting
I0913 23:27:05.887655 13384 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19640-5233/.minikube/certs/ca.pem
I0913 23:27:05.939845 13384 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19640-5233/.minikube/certs/cert.pem
I0913 23:27:06.263210 13384 cli_runner.go:164] Run: docker network inspect addons-794116 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0913 23:27:06.279491 13384 cli_runner.go:211] docker network inspect addons-794116 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0913 23:27:06.279551 13384 network_create.go:284] running [docker network inspect addons-794116] to gather additional debugging logs...
I0913 23:27:06.279571 13384 cli_runner.go:164] Run: docker network inspect addons-794116
W0913 23:27:06.293810 13384 cli_runner.go:211] docker network inspect addons-794116 returned with exit code 1
I0913 23:27:06.293849 13384 network_create.go:287] error running [docker network inspect addons-794116]: docker network inspect addons-794116: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-794116 not found
I0913 23:27:06.293866 13384 network_create.go:289] output of [docker network inspect addons-794116]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-794116 not found
** /stderr **
I0913 23:27:06.293965 13384 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0913 23:27:06.309297 13384 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc0015548e0}
I0913 23:27:06.309350 13384 network_create.go:124] attempt to create docker network addons-794116 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0913 23:27:06.309392 13384 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-794116 addons-794116
I0913 23:27:06.368396 13384 network_create.go:108] docker network addons-794116 192.168.49.0/24 created
I0913 23:27:06.368429 13384 kic.go:121] calculated static IP "192.168.49.2" for the "addons-794116" container
I0913 23:27:06.368487 13384 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0913 23:27:06.383198 13384 cli_runner.go:164] Run: docker volume create addons-794116 --label name.minikube.sigs.k8s.io=addons-794116 --label created_by.minikube.sigs.k8s.io=true
I0913 23:27:06.399970 13384 oci.go:103] Successfully created a docker volume addons-794116
I0913 23:27:06.400053 13384 cli_runner.go:164] Run: docker run --rm --name addons-794116-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-794116 --entrypoint /usr/bin/test -v addons-794116:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 -d /var/lib
I0913 23:27:11.320918 13384 cli_runner.go:217] Completed: docker run --rm --name addons-794116-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-794116 --entrypoint /usr/bin/test -v addons-794116:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 -d /var/lib: (4.920828431s)
I0913 23:27:11.320951 13384 oci.go:107] Successfully prepared a docker volume addons-794116
I0913 23:27:11.320979 13384 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker
I0913 23:27:11.320998 13384 kic.go:194] Starting extracting preloaded images to volume ...
I0913 23:27:11.321069 13384 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19640-5233/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v addons-794116:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 -I lz4 -xf /preloaded.tar -C /extractDir
I0913 23:27:15.170500 13384 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19640-5233/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v addons-794116:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 -I lz4 -xf /preloaded.tar -C /extractDir: (3.849374666s)
I0913 23:27:15.170529 13384 kic.go:203] duration metric: took 3.84952911s to extract preloaded images to volume ...
W0913 23:27:15.170643 13384 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0913 23:27:15.170740 13384 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0913 23:27:15.217785 13384 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-794116 --name addons-794116 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-794116 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-794116 --network addons-794116 --ip 192.168.49.2 --volume addons-794116:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243
I0913 23:27:15.523536 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Running}}
I0913 23:27:15.541194 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:15.560264 13384 cli_runner.go:164] Run: docker exec addons-794116 stat /var/lib/dpkg/alternatives/iptables
I0913 23:27:15.601970 13384 oci.go:144] the created container "addons-794116" has a running status.
I0913 23:27:15.602006 13384 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa...
I0913 23:27:15.653388 13384 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0913 23:27:15.673214 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:15.690289 13384 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0913 23:27:15.690316 13384 kic_runner.go:114] Args: [docker exec --privileged addons-794116 chown docker:docker /home/docker/.ssh/authorized_keys]
I0913 23:27:15.729855 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:15.747564 13384 machine.go:93] provisionDockerMachine start ...
I0913 23:27:15.747658 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:15.766955 13384 main.go:141] libmachine: Using SSH client type: native
I0913 23:27:15.767220 13384 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0913 23:27:15.767239 13384 main.go:141] libmachine: About to run SSH command:
hostname
I0913 23:27:15.768073 13384 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:35238->127.0.0.1:32768: read: connection reset by peer
I0913 23:27:18.896801 13384 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-794116
I0913 23:27:18.896838 13384 ubuntu.go:169] provisioning hostname "addons-794116"
I0913 23:27:18.896912 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:18.913770 13384 main.go:141] libmachine: Using SSH client type: native
I0913 23:27:18.913980 13384 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0913 23:27:18.913994 13384 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-794116 && echo "addons-794116" | sudo tee /etc/hostname
I0913 23:27:19.051516 13384 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-794116
I0913 23:27:19.051593 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:19.067857 13384 main.go:141] libmachine: Using SSH client type: native
I0913 23:27:19.068066 13384 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0913 23:27:19.068084 13384 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-794116' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-794116/g' /etc/hosts;
else
echo '127.0.1.1 addons-794116' | sudo tee -a /etc/hosts;
fi
fi
I0913 23:27:19.197346 13384 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0913 23:27:19.197371 13384 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19640-5233/.minikube CaCertPath:/home/jenkins/minikube-integration/19640-5233/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19640-5233/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19640-5233/.minikube}
I0913 23:27:19.197407 13384 ubuntu.go:177] setting up certificates
I0913 23:27:19.197422 13384 provision.go:84] configureAuth start
I0913 23:27:19.197468 13384 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-794116
I0913 23:27:19.213908 13384 provision.go:143] copyHostCerts
I0913 23:27:19.213981 13384 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19640-5233/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19640-5233/.minikube/ca.pem (1078 bytes)
I0913 23:27:19.214130 13384 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19640-5233/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19640-5233/.minikube/cert.pem (1123 bytes)
I0913 23:27:19.214224 13384 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19640-5233/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19640-5233/.minikube/key.pem (1679 bytes)
I0913 23:27:19.214308 13384 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19640-5233/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19640-5233/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19640-5233/.minikube/certs/ca-key.pem org=jenkins.addons-794116 san=[127.0.0.1 192.168.49.2 addons-794116 localhost minikube]
I0913 23:27:19.287011 13384 provision.go:177] copyRemoteCerts
I0913 23:27:19.287075 13384 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0913 23:27:19.287106 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:19.303863 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:19.397677 13384 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-5233/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)
I0913 23:27:19.418967 13384 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-5233/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0913 23:27:19.440259 13384 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-5233/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0913 23:27:19.461421 13384 provision.go:87] duration metric: took 263.987318ms to configureAuth
I0913 23:27:19.461453 13384 ubuntu.go:193] setting minikube options for container-runtime
I0913 23:27:19.461633 13384 config.go:182] Loaded profile config "addons-794116": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.1
I0913 23:27:19.461678 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:19.478515 13384 main.go:141] libmachine: Using SSH client type: native
I0913 23:27:19.478681 13384 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0913 23:27:19.478693 13384 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0913 23:27:19.609741 13384 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0913 23:27:19.609771 13384 ubuntu.go:71] root file system type: overlay
I0913 23:27:19.609908 13384 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I0913 23:27:19.609988 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:19.626734 13384 main.go:141] libmachine: Using SSH client type: native
I0913 23:27:19.626899 13384 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0913 23:27:19.626956 13384 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0913 23:27:19.767736 13384 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0913 23:27:19.767807 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:19.784081 13384 main.go:141] libmachine: Using SSH client type: native
I0913 23:27:19.784247 13384 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x86c560] 0x86f240 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0913 23:27:19.784263 13384 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0913 23:27:20.475845 13384 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2024-09-06 12:06:41.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2024-09-13 23:27:19.765088416 +0000
@@ -1,46 +1,49 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
-Wants=network-online.target containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
+Wants=network-online.target
Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutStartSec=0
-RestartSec=2
-Restart=always
+Restart=on-failure
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
+LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0913 23:27:20.475879 13384 machine.go:96] duration metric: took 4.72829498s to provisionDockerMachine
I0913 23:27:20.475895 13384 client.go:171] duration metric: took 14.588332244s to LocalClient.Create
I0913 23:27:20.475917 13384 start.go:167] duration metric: took 14.588395958s to libmachine.API.Create "addons-794116"
I0913 23:27:20.475928 13384 start.go:293] postStartSetup for "addons-794116" (driver="docker")
I0913 23:27:20.475940 13384 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0913 23:27:20.476011 13384 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0913 23:27:20.476057 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:20.492031 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:20.585971 13384 ssh_runner.go:195] Run: cat /etc/os-release
I0913 23:27:20.588983 13384 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0913 23:27:20.589011 13384 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0913 23:27:20.589019 13384 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0913 23:27:20.589025 13384 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0913 23:27:20.589034 13384 filesync.go:126] Scanning /home/jenkins/minikube-integration/19640-5233/.minikube/addons for local assets ...
I0913 23:27:20.589091 13384 filesync.go:126] Scanning /home/jenkins/minikube-integration/19640-5233/.minikube/files for local assets ...
I0913 23:27:20.589113 13384 start.go:296] duration metric: took 113.179341ms for postStartSetup
I0913 23:27:20.589379 13384 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-794116
I0913 23:27:20.605951 13384 profile.go:143] Saving config to /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/config.json ...
I0913 23:27:20.606202 13384 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0913 23:27:20.606241 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:20.623077 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:20.714019 13384 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0913 23:27:20.718186 13384 start.go:128] duration metric: took 14.832732017s to createHost
I0913 23:27:20.718212 13384 start.go:83] releasing machines lock for "addons-794116", held for 14.83287507s
I0913 23:27:20.718277 13384 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-794116
I0913 23:27:20.734937 13384 ssh_runner.go:195] Run: cat /version.json
I0913 23:27:20.734984 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:20.735058 13384 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0913 23:27:20.735138 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:20.752329 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:20.752687 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:20.910974 13384 ssh_runner.go:195] Run: systemctl --version
I0913 23:27:20.914928 13384 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0913 23:27:20.918622 13384 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0913 23:27:20.940259 13384 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0913 23:27:20.940333 13384 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0913 23:27:20.965288 13384 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0913 23:27:20.965326 13384 start.go:495] detecting cgroup driver to use...
I0913 23:27:20.965365 13384 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0913 23:27:20.965470 13384 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0913 23:27:20.980145 13384 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0913 23:27:20.988911 13384 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0913 23:27:20.997751 13384 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0913 23:27:20.997804 13384 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0913 23:27:21.006649 13384 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0913 23:27:21.015976 13384 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0913 23:27:21.025398 13384 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0913 23:27:21.034988 13384 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0913 23:27:21.043613 13384 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0913 23:27:21.053318 13384 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0913 23:27:21.062436 13384 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0913 23:27:21.071858 13384 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0913 23:27:21.079664 13384 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0913 23:27:21.087009 13384 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0913 23:27:21.157768 13384 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0913 23:27:21.232255 13384 start.go:495] detecting cgroup driver to use...
I0913 23:27:21.232306 13384 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0913 23:27:21.232372 13384 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0913 23:27:21.242778 13384 cruntime.go:279] skipping containerd shutdown because we are bound to it
I0913 23:27:21.242846 13384 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0913 23:27:21.253609 13384 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0913 23:27:21.268991 13384 ssh_runner.go:195] Run: which cri-dockerd
I0913 23:27:21.272594 13384 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0913 23:27:21.281638 13384 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)
I0913 23:27:21.298266 13384 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0913 23:27:21.380455 13384 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0913 23:27:21.477168 13384 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0913 23:27:21.477293 13384 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0913 23:27:21.493785 13384 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0913 23:27:21.566157 13384 ssh_runner.go:195] Run: sudo systemctl restart docker
I0913 23:27:21.827478 13384 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
I0913 23:27:21.838253 13384 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0913 23:27:21.848701 13384 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I0913 23:27:21.929914 13384 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0913 23:27:22.011171 13384 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0913 23:27:22.082536 13384 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I0913 23:27:22.094402 13384 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0913 23:27:22.103750 13384 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0913 23:27:22.182412 13384 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
I0913 23:27:22.240136 13384 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock
I0913 23:27:22.240219 13384 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I0913 23:27:22.243453 13384 start.go:563] Will wait 60s for crictl version
I0913 23:27:22.243497 13384 ssh_runner.go:195] Run: which crictl
I0913 23:27:22.246516 13384 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0913 23:27:22.276026 13384 start.go:579] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 27.2.1
RuntimeApiVersion: v1
I0913 23:27:22.276077 13384 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0913 23:27:22.298349 13384 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0913 23:27:22.326113 13384 out.go:235] * Preparing Kubernetes v1.31.1 on Docker 27.2.1 ...
I0913 23:27:22.326198 13384 cli_runner.go:164] Run: docker network inspect addons-794116 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0913 23:27:22.342014 13384 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0913 23:27:22.345341 13384 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0913 23:27:22.355146 13384 kubeadm.go:883] updating cluster {Name:addons-794116 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-794116 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuF
irmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0913 23:27:22.355257 13384 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker
I0913 23:27:22.355303 13384 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0913 23:27:22.372959 13384 docker.go:685] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.31.1
registry.k8s.io/kube-controller-manager:v1.31.1
registry.k8s.io/kube-scheduler:v1.31.1
registry.k8s.io/kube-proxy:v1.31.1
registry.k8s.io/coredns/coredns:v1.11.3
registry.k8s.io/etcd:3.5.15-0
registry.k8s.io/pause:3.10
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0913 23:27:22.372983 13384 docker.go:615] Images already preloaded, skipping extraction
I0913 23:27:22.373080 13384 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0913 23:27:22.390892 13384 docker.go:685] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.31.1
registry.k8s.io/kube-scheduler:v1.31.1
registry.k8s.io/kube-controller-manager:v1.31.1
registry.k8s.io/kube-proxy:v1.31.1
registry.k8s.io/coredns/coredns:v1.11.3
registry.k8s.io/etcd:3.5.15-0
registry.k8s.io/pause:3.10
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0913 23:27:22.390917 13384 cache_images.go:84] Images are preloaded, skipping loading
I0913 23:27:22.390926 13384 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.1 docker true true} ...
I0913 23:27:22.391012 13384 kubeadm.go:946] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-794116 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:addons-794116 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0913 23:27:22.391066 13384 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0913 23:27:22.433250 13384 cni.go:84] Creating CNI manager for ""
I0913 23:27:22.433277 13384 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0913 23:27:22.433289 13384 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0913 23:27:22.433307 13384 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-794116 NodeName:addons-794116 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuber
netes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0913 23:27:22.433439 13384 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/cri-dockerd.sock
name: "addons-794116"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0913 23:27:22.433493 13384 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I0913 23:27:22.441548 13384 binaries.go:44] Found k8s binaries, skipping transfer
I0913 23:27:22.441609 13384 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0913 23:27:22.449605 13384 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (312 bytes)
I0913 23:27:22.465219 13384 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0913 23:27:22.480521 13384 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2155 bytes)
I0913 23:27:22.495574 13384 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0913 23:27:22.498604 13384 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0913 23:27:22.508259 13384 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0913 23:27:22.588726 13384 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0913 23:27:22.601249 13384 certs.go:68] Setting up /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116 for IP: 192.168.49.2
I0913 23:27:22.601275 13384 certs.go:194] generating shared ca certs ...
I0913 23:27:22.601294 13384 certs.go:226] acquiring lock for ca certs: {Name:mke84d4959018a2308ed4ab133eed0abe61c0e34 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:22.601439 13384 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19640-5233/.minikube/ca.key
I0913 23:27:22.847587 13384 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19640-5233/.minikube/ca.crt ...
I0913 23:27:22.847615 13384 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-5233/.minikube/ca.crt: {Name:mkfd888702ea3ff1d9845998234205c98043829a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:22.847782 13384 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19640-5233/.minikube/ca.key ...
I0913 23:27:22.847791 13384 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-5233/.minikube/ca.key: {Name:mk68122cad8a72e7a620733cdeef78e7f4ad7eb3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:22.847879 13384 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19640-5233/.minikube/proxy-client-ca.key
I0913 23:27:23.026505 13384 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19640-5233/.minikube/proxy-client-ca.crt ...
I0913 23:27:23.026537 13384 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-5233/.minikube/proxy-client-ca.crt: {Name:mkea2dc0d53867b9003dd3ee6f4370cffc2c0bdf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:23.026770 13384 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19640-5233/.minikube/proxy-client-ca.key ...
I0913 23:27:23.026788 13384 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-5233/.minikube/proxy-client-ca.key: {Name:mk1b67a039c21c0894eaa296b050c5d2e9cf4f5b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:23.026887 13384 certs.go:256] generating profile certs ...
I0913 23:27:23.026952 13384 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/client.key
I0913 23:27:23.026966 13384 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/client.crt with IP's: []
I0913 23:27:23.198702 13384 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/client.crt ...
I0913 23:27:23.198735 13384 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/client.crt: {Name:mkcc95ffc356336551f33265759ace6bd5e292c0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:23.198926 13384 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/client.key ...
I0913 23:27:23.198947 13384 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/client.key: {Name:mk61d593593c22b9e0fd5dceaba0532ecdcb8a55 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:23.199044 13384 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/apiserver.key.af2e173e
I0913 23:27:23.199064 13384 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/apiserver.crt.af2e173e with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0913 23:27:23.311294 13384 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/apiserver.crt.af2e173e ...
I0913 23:27:23.311325 13384 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/apiserver.crt.af2e173e: {Name:mkf030d10a0b74029d10abbb4b3a53378c1e7366 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:23.311515 13384 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/apiserver.key.af2e173e ...
I0913 23:27:23.311532 13384 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/apiserver.key.af2e173e: {Name:mk5660e3df7a83e71fa37fca19419614217022a8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:23.311631 13384 certs.go:381] copying /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/apiserver.crt.af2e173e -> /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/apiserver.crt
I0913 23:27:23.311710 13384 certs.go:385] copying /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/apiserver.key.af2e173e -> /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/apiserver.key
I0913 23:27:23.311755 13384 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/proxy-client.key
I0913 23:27:23.311773 13384 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/proxy-client.crt with IP's: []
I0913 23:27:23.403683 13384 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/proxy-client.crt ...
I0913 23:27:23.403718 13384 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/proxy-client.crt: {Name:mk610cecd9dd11b897930bb8066a44ecf1c48697 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:23.403909 13384 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/proxy-client.key ...
I0913 23:27:23.403925 13384 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/proxy-client.key: {Name:mk67bff6695e137dd8dd76db8ade74913b6f2821 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:23.404169 13384 certs.go:484] found cert: /home/jenkins/minikube-integration/19640-5233/.minikube/certs/ca-key.pem (1679 bytes)
I0913 23:27:23.404208 13384 certs.go:484] found cert: /home/jenkins/minikube-integration/19640-5233/.minikube/certs/ca.pem (1078 bytes)
I0913 23:27:23.404233 13384 certs.go:484] found cert: /home/jenkins/minikube-integration/19640-5233/.minikube/certs/cert.pem (1123 bytes)
I0913 23:27:23.404255 13384 certs.go:484] found cert: /home/jenkins/minikube-integration/19640-5233/.minikube/certs/key.pem (1679 bytes)
I0913 23:27:23.404855 13384 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-5233/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0913 23:27:23.425907 13384 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-5233/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0913 23:27:23.446762 13384 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-5233/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0913 23:27:23.467784 13384 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-5233/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0913 23:27:23.488580 13384 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0913 23:27:23.509287 13384 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0913 23:27:23.529859 13384 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0913 23:27:23.550861 13384 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-5233/.minikube/profiles/addons-794116/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0913 23:27:23.572098 13384 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-5233/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0913 23:27:23.593427 13384 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0913 23:27:23.609350 13384 ssh_runner.go:195] Run: openssl version
I0913 23:27:23.614459 13384 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0913 23:27:23.623276 13384 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0913 23:27:23.626455 13384 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 13 23:27 /usr/share/ca-certificates/minikubeCA.pem
I0913 23:27:23.626509 13384 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0913 23:27:23.633020 13384 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0913 23:27:23.641713 13384 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0913 23:27:23.644815 13384 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0913 23:27:23.644857 13384 kubeadm.go:392] StartCluster: {Name:addons-794116 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-794116 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirm
warePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0913 23:27:23.644947 13384 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0913 23:27:23.662201 13384 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0913 23:27:23.670385 13384 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0913 23:27:23.678215 13384 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0913 23:27:23.678276 13384 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0913 23:27:23.685945 13384 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0913 23:27:23.685962 13384 kubeadm.go:157] found existing configuration files:
I0913 23:27:23.685999 13384 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0913 23:27:23.693373 13384 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0913 23:27:23.693435 13384 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0913 23:27:23.700634 13384 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0913 23:27:23.708295 13384 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0913 23:27:23.708343 13384 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0913 23:27:23.715813 13384 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0913 23:27:23.723535 13384 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0913 23:27:23.723586 13384 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0913 23:27:23.731093 13384 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0913 23:27:23.738780 13384 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0913 23:27:23.738838 13384 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0913 23:27:23.746034 13384 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0913 23:27:23.778088 13384 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1
I0913 23:27:23.778174 13384 kubeadm.go:310] [preflight] Running pre-flight checks
I0913 23:27:23.796070 13384 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0913 23:27:23.796156 13384 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1068-gcp[0m
I0913 23:27:23.796242 13384 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0913 23:27:23.796329 13384 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0913 23:27:23.796404 13384 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0913 23:27:23.796468 13384 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0913 23:27:23.796530 13384 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0913 23:27:23.796577 13384 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0913 23:27:23.796624 13384 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0913 23:27:23.796697 13384 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0913 23:27:23.796768 13384 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0913 23:27:23.796836 13384 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0913 23:27:23.842856 13384 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0913 23:27:23.842987 13384 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0913 23:27:23.843131 13384 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0913 23:27:23.853500 13384 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0913 23:27:23.855516 13384 out.go:235] - Generating certificates and keys ...
I0913 23:27:23.855629 13384 kubeadm.go:310] [certs] Using existing ca certificate authority
I0913 23:27:23.855721 13384 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0913 23:27:24.028521 13384 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0913 23:27:24.342607 13384 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0913 23:27:24.579627 13384 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0913 23:27:24.679051 13384 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0913 23:27:24.806335 13384 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0913 23:27:24.806480 13384 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-794116 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0913 23:27:24.982516 13384 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0913 23:27:24.982646 13384 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-794116 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0913 23:27:25.054576 13384 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0913 23:27:25.382562 13384 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0913 23:27:25.633223 13384 kubeadm.go:310] [certs] Generating "sa" key and public key
I0913 23:27:25.633295 13384 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0913 23:27:25.772529 13384 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0913 23:27:25.872088 13384 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0913 23:27:26.022205 13384 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0913 23:27:26.122658 13384 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0913 23:27:26.465384 13384 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0913 23:27:26.465844 13384 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0913 23:27:26.468087 13384 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0913 23:27:26.471208 13384 out.go:235] - Booting up control plane ...
I0913 23:27:26.471343 13384 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0913 23:27:26.471414 13384 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0913 23:27:26.471520 13384 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0913 23:27:26.479394 13384 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0913 23:27:26.484293 13384 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0913 23:27:26.484379 13384 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0913 23:27:26.564911 13384 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0913 23:27:26.565062 13384 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0913 23:27:27.066352 13384 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 501.560771ms
I0913 23:27:27.066470 13384 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0913 23:27:31.568020 13384 kubeadm.go:310] [api-check] The API server is healthy after 4.501604244s
I0913 23:27:31.578559 13384 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0913 23:27:31.590024 13384 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0913 23:27:31.607458 13384 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0913 23:27:31.607804 13384 kubeadm.go:310] [mark-control-plane] Marking the node addons-794116 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0913 23:27:31.615917 13384 kubeadm.go:310] [bootstrap-token] Using token: d1ywyo.k8bjzmbvapa273ho
I0913 23:27:31.617689 13384 out.go:235] - Configuring RBAC rules ...
I0913 23:27:31.617845 13384 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0913 23:27:31.621680 13384 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0913 23:27:31.627229 13384 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0913 23:27:31.629969 13384 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0913 23:27:31.632668 13384 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0913 23:27:31.635054 13384 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0913 23:27:31.974293 13384 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0913 23:27:32.394914 13384 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0913 23:27:32.973909 13384 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0913 23:27:32.974766 13384 kubeadm.go:310]
I0913 23:27:32.974858 13384 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0913 23:27:32.974869 13384 kubeadm.go:310]
I0913 23:27:32.974972 13384 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0913 23:27:32.974985 13384 kubeadm.go:310]
I0913 23:27:32.975021 13384 kubeadm.go:310] mkdir -p $HOME/.kube
I0913 23:27:32.975116 13384 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0913 23:27:32.975192 13384 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0913 23:27:32.975201 13384 kubeadm.go:310]
I0913 23:27:32.975269 13384 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0913 23:27:32.975284 13384 kubeadm.go:310]
I0913 23:27:32.975325 13384 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0913 23:27:32.975331 13384 kubeadm.go:310]
I0913 23:27:32.975407 13384 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0913 23:27:32.975520 13384 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0913 23:27:32.975624 13384 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0913 23:27:32.975650 13384 kubeadm.go:310]
I0913 23:27:32.975764 13384 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0913 23:27:32.975848 13384 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0913 23:27:32.975858 13384 kubeadm.go:310]
I0913 23:27:32.975955 13384 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token d1ywyo.k8bjzmbvapa273ho \
I0913 23:27:32.976081 13384 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:9db4175747bb737d8a39c512bf3352efde389e43962c19157f0336ad176c42b0 \
I0913 23:27:32.976108 13384 kubeadm.go:310] --control-plane
I0913 23:27:32.976116 13384 kubeadm.go:310]
I0913 23:27:32.976207 13384 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0913 23:27:32.976215 13384 kubeadm.go:310]
I0913 23:27:32.976305 13384 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token d1ywyo.k8bjzmbvapa273ho \
I0913 23:27:32.976452 13384 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:9db4175747bb737d8a39c512bf3352efde389e43962c19157f0336ad176c42b0
I0913 23:27:32.978404 13384 kubeadm.go:310] W0913 23:27:23.775723 1923 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0913 23:27:32.978665 13384 kubeadm.go:310] W0913 23:27:23.776297 1923 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0913 23:27:32.978867 13384 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1068-gcp\n", err: exit status 1
I0913 23:27:32.978977 13384 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0913 23:27:32.979007 13384 cni.go:84] Creating CNI manager for ""
I0913 23:27:32.979026 13384 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0913 23:27:32.981091 13384 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0913 23:27:32.982485 13384 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0913 23:27:32.990751 13384 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
I0913 23:27:33.007493 13384 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0913 23:27:33.007557 13384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:33.007566 13384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-794116 minikube.k8s.io/updated_at=2024_09_13T23_27_33_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=7ca96ba7bd97af6e0063398921096f1cca785d18 minikube.k8s.io/name=addons-794116 minikube.k8s.io/primary=true
I0913 23:27:33.092949 13384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:33.092960 13384 ops.go:34] apiserver oom_adj: -16
I0913 23:27:33.593818 13384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:34.093672 13384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:34.593840 13384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:35.093910 13384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:35.593161 13384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:36.093489 13384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:36.594038 13384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:37.093615 13384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:37.593073 13384 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:37.656093 13384 kubeadm.go:1113] duration metric: took 4.648598468s to wait for elevateKubeSystemPrivileges
I0913 23:27:37.656128 13384 kubeadm.go:394] duration metric: took 14.011273786s to StartCluster
I0913 23:27:37.656150 13384 settings.go:142] acquiring lock: {Name:mka91989d6d7a65515c533a78dd563f87912137c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:37.656272 13384 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19640-5233/kubeconfig
I0913 23:27:37.656789 13384 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-5233/kubeconfig: {Name:mkc8aab5a1909b3591993f223a6ef363a51b3cc1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:37.657026 13384 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0913 23:27:37.657049 13384 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0913 23:27:37.657090 13384 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:true inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0913 23:27:37.657206 13384 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-794116"
I0913 23:27:37.657211 13384 addons.go:69] Setting yakd=true in profile "addons-794116"
I0913 23:27:37.657227 13384 addons.go:234] Setting addon yakd=true in "addons-794116"
I0913 23:27:37.657247 13384 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-794116"
I0913 23:27:37.657260 13384 host.go:66] Checking if "addons-794116" exists ...
I0913 23:27:37.657249 13384 addons.go:69] Setting metrics-server=true in profile "addons-794116"
I0913 23:27:37.657268 13384 host.go:66] Checking if "addons-794116" exists ...
I0913 23:27:37.657279 13384 addons.go:234] Setting addon metrics-server=true in "addons-794116"
I0913 23:27:37.657280 13384 config.go:182] Loaded profile config "addons-794116": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.1
I0913 23:27:37.657316 13384 host.go:66] Checking if "addons-794116" exists ...
I0913 23:27:37.657320 13384 addons.go:69] Setting cloud-spanner=true in profile "addons-794116"
I0913 23:27:37.657319 13384 addons.go:69] Setting storage-provisioner=true in profile "addons-794116"
I0913 23:27:37.657345 13384 addons.go:69] Setting helm-tiller=true in profile "addons-794116"
I0913 23:27:37.657356 13384 addons.go:234] Setting addon helm-tiller=true in "addons-794116"
I0913 23:27:37.657383 13384 host.go:66] Checking if "addons-794116" exists ...
I0913 23:27:37.657386 13384 addons.go:234] Setting addon storage-provisioner=true in "addons-794116"
I0913 23:27:37.657396 13384 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-794116"
I0913 23:27:37.657425 13384 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-794116"
I0913 23:27:37.657426 13384 host.go:66] Checking if "addons-794116" exists ...
I0913 23:27:37.657821 13384 addons.go:234] Setting addon cloud-spanner=true in "addons-794116"
I0913 23:27:37.657892 13384 host.go:66] Checking if "addons-794116" exists ...
I0913 23:27:37.657984 13384 addons.go:69] Setting registry=true in profile "addons-794116"
I0913 23:27:37.657998 13384 addons.go:69] Setting ingress=true in profile "addons-794116"
I0913 23:27:37.658013 13384 addons.go:234] Setting addon registry=true in "addons-794116"
I0913 23:27:37.658025 13384 addons.go:234] Setting addon ingress=true in "addons-794116"
I0913 23:27:37.658037 13384 host.go:66] Checking if "addons-794116" exists ...
I0913 23:27:37.658076 13384 host.go:66] Checking if "addons-794116" exists ...
I0913 23:27:37.658090 13384 addons.go:69] Setting ingress-dns=true in profile "addons-794116"
I0913 23:27:37.658119 13384 addons.go:234] Setting addon ingress-dns=true in "addons-794116"
I0913 23:27:37.658163 13384 host.go:66] Checking if "addons-794116" exists ...
I0913 23:27:37.658184 13384 host.go:66] Checking if "addons-794116" exists ...
I0913 23:27:37.658436 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:37.658575 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:37.658587 13384 addons.go:69] Setting default-storageclass=true in profile "addons-794116"
I0913 23:27:37.658604 13384 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-794116"
I0913 23:27:37.658739 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:37.657994 13384 addons.go:69] Setting inspektor-gadget=true in profile "addons-794116"
I0913 23:27:37.658901 13384 addons.go:234] Setting addon inspektor-gadget=true in "addons-794116"
I0913 23:27:37.658923 13384 host.go:66] Checking if "addons-794116" exists ...
I0913 23:27:37.658746 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:37.659330 13384 addons.go:69] Setting volcano=true in profile "addons-794116"
I0913 23:27:37.659353 13384 addons.go:234] Setting addon volcano=true in "addons-794116"
I0913 23:27:37.659426 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:37.659475 13384 host.go:66] Checking if "addons-794116" exists ...
I0913 23:27:37.659594 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:37.658929 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:37.660232 13384 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-794116"
I0913 23:27:37.660273 13384 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-794116"
I0913 23:27:37.660698 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:37.660754 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:37.661895 13384 out.go:177] * Verifying Kubernetes components...
I0913 23:27:37.661912 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:37.662130 13384 addons.go:69] Setting volumesnapshots=true in profile "addons-794116"
I0913 23:27:37.662156 13384 addons.go:234] Setting addon volumesnapshots=true in "addons-794116"
I0913 23:27:37.662192 13384 host.go:66] Checking if "addons-794116" exists ...
I0913 23:27:37.662265 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:37.662943 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:37.658576 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:37.664362 13384 addons.go:69] Setting gcp-auth=true in profile "addons-794116"
I0913 23:27:37.664389 13384 mustload.go:65] Loading cluster: addons-794116
I0913 23:27:37.670547 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:37.674460 13384 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0913 23:27:37.689107 13384 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0913 23:27:37.689933 13384 config.go:182] Loaded profile config "addons-794116": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.1
I0913 23:27:37.690186 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:37.690295 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:37.691421 13384 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0913 23:27:37.692775 13384 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0913 23:27:37.694573 13384 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0913 23:27:37.694601 13384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0913 23:27:37.694664 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:37.722944 13384 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23
I0913 23:27:37.724653 13384 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0913 23:27:37.724842 13384 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0913 23:27:37.724855 13384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0913 23:27:37.724912 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:37.725077 13384 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0913 23:27:37.725105 13384 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
I0913 23:27:37.725852 13384 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0913 23:27:37.726704 13384 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0913 23:27:37.732743 13384 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0913 23:27:37.732803 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:37.726761 13384 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0913 23:27:37.732866 13384 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0913 23:27:37.732927 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:37.732608 13384 addons.go:234] Setting addon default-storageclass=true in "addons-794116"
I0913 23:27:37.733905 13384 host.go:66] Checking if "addons-794116" exists ...
I0913 23:27:37.734209 13384 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0913 23:27:37.734388 13384 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0913 23:27:37.734403 13384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0913 23:27:37.734459 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:37.734994 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:37.735546 13384 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0913 23:27:37.736435 13384 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0913 23:27:37.737453 13384 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0913 23:27:37.737475 13384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0913 23:27:37.737550 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:37.737959 13384 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0913 23:27:37.738324 13384 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0913 23:27:37.738339 13384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0913 23:27:37.738385 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:37.739379 13384 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0913 23:27:37.740782 13384 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0913 23:27:37.740892 13384 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0913 23:27:37.740906 13384 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0913 23:27:37.740983 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:37.741379 13384 host.go:66] Checking if "addons-794116" exists ...
I0913 23:27:37.742869 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:37.743317 13384 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0913 23:27:37.745101 13384 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0913 23:27:37.746751 13384 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0913 23:27:37.748094 13384 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0913 23:27:37.749322 13384 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0913 23:27:37.749345 13384 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0913 23:27:37.749425 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:37.768019 13384 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-794116"
I0913 23:27:37.768080 13384 host.go:66] Checking if "addons-794116" exists ...
I0913 23:27:37.768589 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:37.774508 13384 out.go:177] - Using image docker.io/registry:2.8.3
I0913 23:27:37.776116 13384 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0913 23:27:37.778055 13384 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0913 23:27:37.778076 13384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0913 23:27:37.778136 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:37.785697 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:37.787743 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:37.790276 13384 out.go:177] - Using image ghcr.io/helm/tiller:v2.17.0
I0913 23:27:37.791620 13384 addons.go:431] installing /etc/kubernetes/addons/helm-tiller-dp.yaml
I0913 23:27:37.791642 13384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-dp.yaml (2422 bytes)
I0913 23:27:37.791698 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:37.796894 13384 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0913 23:27:37.798635 13384 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0913 23:27:37.799803 13384 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0913 23:27:37.801047 13384 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0913 23:27:37.801050 13384 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0913 23:27:37.801118 13384 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0913 23:27:37.801189 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:37.803536 13384 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0913 23:27:37.803558 13384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0913 23:27:37.803633 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:37.817699 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:37.817772 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:37.819268 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:37.819537 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:37.822010 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:37.823296 13384 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0913 23:27:37.823314 13384 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0913 23:27:37.823407 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:37.823431 13384 out.go:177] - Using image docker.io/busybox:stable
I0913 23:27:37.824729 13384 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0913 23:27:37.826218 13384 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0913 23:27:37.826243 13384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0913 23:27:37.826301 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:37.828746 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:37.828953 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:37.836478 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:37.837330 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:37.838050 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:37.850558 13384 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0913 23:27:37.851143 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
W0913 23:27:37.854567 13384 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0913 23:27:37.854595 13384 retry.go:31] will retry after 256.347169ms: ssh: handshake failed: EOF
I0913 23:27:37.867783 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:37.869852 13384 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0913 23:27:38.072337 13384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0913 23:27:38.149990 13384 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0913 23:27:38.150073 13384 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0913 23:27:38.247457 13384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0913 23:27:38.248762 13384 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0913 23:27:38.248786 13384 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0913 23:27:38.252094 13384 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0913 23:27:38.252167 13384 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0913 23:27:38.343785 13384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0913 23:27:38.345035 13384 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0913 23:27:38.345061 13384 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0913 23:27:38.346049 13384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0913 23:27:38.362969 13384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0913 23:27:38.445629 13384 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0913 23:27:38.445722 13384 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0913 23:27:38.454280 13384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0913 23:27:38.543274 13384 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0913 23:27:38.543368 13384 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0913 23:27:38.551224 13384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0913 23:27:38.556042 13384 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0913 23:27:38.556070 13384 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0913 23:27:38.560508 13384 addons.go:431] installing /etc/kubernetes/addons/helm-tiller-rbac.yaml
I0913 23:27:38.560530 13384 ssh_runner.go:362] scp helm-tiller/helm-tiller-rbac.yaml --> /etc/kubernetes/addons/helm-tiller-rbac.yaml (1188 bytes)
I0913 23:27:38.560611 13384 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0913 23:27:38.560625 13384 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0913 23:27:38.658598 13384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0913 23:27:38.743596 13384 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0913 23:27:38.743906 13384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0913 23:27:38.862842 13384 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0913 23:27:38.862930 13384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0913 23:27:38.943055 13384 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0913 23:27:38.943127 13384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0913 23:27:38.950084 13384 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0913 23:27:38.950158 13384 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0913 23:27:38.960211 13384 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0913 23:27:38.960240 13384 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0913 23:27:39.155190 13384 addons.go:431] installing /etc/kubernetes/addons/helm-tiller-svc.yaml
I0913 23:27:39.155269 13384 ssh_runner.go:362] scp helm-tiller/helm-tiller-svc.yaml --> /etc/kubernetes/addons/helm-tiller-svc.yaml (951 bytes)
I0913 23:27:39.167354 13384 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0913 23:27:39.167444 13384 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0913 23:27:39.250588 13384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0913 23:27:39.262411 13384 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0913 23:27:39.262512 13384 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0913 23:27:39.344017 13384 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (1.474095855s)
I0913 23:27:39.345075 13384 node_ready.go:35] waiting up to 6m0s for node "addons-794116" to be "Ready" ...
I0913 23:27:39.345350 13384 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (1.493299023s)
I0913 23:27:39.345380 13384 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0913 23:27:39.356593 13384 node_ready.go:49] node "addons-794116" has status "Ready":"True"
I0913 23:27:39.356624 13384 node_ready.go:38] duration metric: took 11.504372ms for node "addons-794116" to be "Ready" ...
I0913 23:27:39.356635 13384 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0913 23:27:39.357410 13384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0913 23:27:39.369751 13384 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-qq29j" in "kube-system" namespace to be "Ready" ...
I0913 23:27:39.746203 13384 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0913 23:27:39.746238 13384 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0913 23:27:39.746915 13384 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0913 23:27:39.746981 13384 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0913 23:27:39.756206 13384 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0913 23:27:39.756233 13384 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0913 23:27:39.848351 13384 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (1.775979301s)
I0913 23:27:39.850257 13384 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-794116" context rescaled to 1 replicas
I0913 23:27:40.044754 13384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml
I0913 23:27:40.052732 13384 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0913 23:27:40.052816 13384 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0913 23:27:40.258859 13384 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0913 23:27:40.258954 13384 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0913 23:27:40.351218 13384 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0913 23:27:40.351249 13384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0913 23:27:40.353274 13384 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0913 23:27:40.353298 13384 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0913 23:27:40.653150 13384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0913 23:27:40.746269 13384 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0913 23:27:40.746362 13384 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0913 23:27:41.042272 13384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0913 23:27:41.055140 13384 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0913 23:27:41.055237 13384 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0913 23:27:41.447335 13384 pod_ready.go:103] pod "coredns-7c65d6cfc9-qq29j" in "kube-system" namespace has status "Ready":"False"
I0913 23:27:41.742437 13384 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0913 23:27:41.742525 13384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0913 23:27:41.754099 13384 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0913 23:27:41.754183 13384 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0913 23:27:42.165333 13384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0913 23:27:42.246037 13384 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0913 23:27:42.246063 13384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0913 23:27:42.965366 13384 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0913 23:27:42.965434 13384 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0913 23:27:43.255238 13384 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0913 23:27:43.255278 13384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0913 23:27:43.448883 13384 pod_ready.go:103] pod "coredns-7c65d6cfc9-qq29j" in "kube-system" namespace has status "Ready":"False"
I0913 23:27:43.458924 13384 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0913 23:27:43.459008 13384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0913 23:27:43.965948 13384 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0913 23:27:43.965973 13384 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0913 23:27:44.651471 13384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0913 23:27:44.757928 13384 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0913 23:27:44.758054 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:44.782155 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:45.450906 13384 pod_ready.go:103] pod "coredns-7c65d6cfc9-qq29j" in "kube-system" namespace has status "Ready":"False"
I0913 23:27:45.954437 13384 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0913 23:27:46.355200 13384 addons.go:234] Setting addon gcp-auth=true in "addons-794116"
I0913 23:27:46.355287 13384 host.go:66] Checking if "addons-794116" exists ...
I0913 23:27:46.355928 13384 cli_runner.go:164] Run: docker container inspect addons-794116 --format={{.State.Status}}
I0913 23:27:46.375782 13384 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0913 23:27:46.375826 13384 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-794116
I0913 23:27:46.393110 13384 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-5233/.minikube/machines/addons-794116/id_rsa Username:docker}
I0913 23:27:47.453222 13384 pod_ready.go:103] pod "coredns-7c65d6cfc9-qq29j" in "kube-system" namespace has status "Ready":"False"
I0913 23:27:47.662003 13384 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (9.414505407s)
I0913 23:27:47.662041 13384 addons.go:475] Verifying addon ingress=true in "addons-794116"
I0913 23:27:47.662320 13384 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (9.318503642s)
I0913 23:27:47.664104 13384 out.go:177] * Verifying ingress addon...
I0913 23:27:47.667942 13384 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0913 23:27:47.746826 13384 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0913 23:27:47.746910 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:48.248039 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:48.749773 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:49.248152 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:49.752669 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:49.951823 13384 pod_ready.go:103] pod "coredns-7c65d6cfc9-qq29j" in "kube-system" namespace has status "Ready":"False"
I0913 23:27:50.252118 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:50.456263 13384 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (12.110175552s)
I0913 23:27:50.456440 13384 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (12.093433145s)
I0913 23:27:50.456533 13384 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (12.002168223s)
I0913 23:27:50.456621 13384 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (11.905374564s)
I0913 23:27:50.456707 13384 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (11.798021232s)
I0913 23:27:50.456980 13384 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (11.206260979s)
I0913 23:27:50.457044 13384 addons.go:475] Verifying addon registry=true in "addons-794116"
I0913 23:27:50.457444 13384 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (11.100002087s)
I0913 23:27:50.457666 13384 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml: (10.412830848s)
I0913 23:27:50.457788 13384 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (9.804533523s)
I0913 23:27:50.458113 13384 addons.go:475] Verifying addon metrics-server=true in "addons-794116"
I0913 23:27:50.457881 13384 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (9.415476021s)
I0913 23:27:50.457959 13384 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (8.292530803s)
W0913 23:27:50.458155 13384 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0913 23:27:50.458248 13384 retry.go:31] will retry after 183.964038ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0913 23:27:50.459212 13384 out.go:177] * Verifying registry addon...
I0913 23:27:50.459295 13384 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-794116 service yakd-dashboard -n yakd-dashboard
I0913 23:27:50.463311 13384 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0913 23:27:50.467289 13384 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0913 23:27:50.467784 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:50.643141 13384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0913 23:27:50.747551 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:51.045122 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:51.173277 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:51.466934 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:51.746445 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:51.954682 13384 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (7.303107976s)
I0913 23:27:51.954718 13384 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-794116"
I0913 23:27:51.954758 13384 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (5.578946605s)
I0913 23:27:51.956478 13384 out.go:177] * Verifying csi-hostpath-driver addon...
I0913 23:27:51.956479 13384 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0913 23:27:51.961642 13384 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0913 23:27:51.962336 13384 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0913 23:27:51.963571 13384 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0913 23:27:51.963630 13384 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0913 23:27:51.968010 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:51.969874 13384 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0913 23:27:51.969897 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:52.062610 13384 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0913 23:27:52.062636 13384 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0913 23:27:52.085261 13384 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0913 23:27:52.085280 13384 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0913 23:27:52.161266 13384 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0913 23:27:52.172646 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:52.446784 13384 pod_ready.go:98] pod "coredns-7c65d6cfc9-qq29j" in "kube-system" namespace has status phase "Succeeded" (skipping!): {Phase:Succeeded Conditions:[{Type:PodReadyToStartContainers Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-13 23:27:52 +0000 UTC Reason: Message:} {Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-13 23:27:37 +0000 UTC Reason:PodCompleted Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-13 23:27:37 +0000 UTC Reason:PodCompleted Message:} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-13 23:27:37 +0000 UTC Reason:PodCompleted Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-13 23:27:37 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:192.168.49.2 HostIPs:[{IP:192.168.49.2
}] PodIP:10.244.0.2 PodIPs:[{IP:10.244.0.2}] StartTime:2024-09-13 23:27:37 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:coredns State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2024-09-13 23:27:40 +0000 UTC,FinishedAt:2024-09-13 23:27:51 +0000 UTC,ContainerID:docker://b82c283fcb278732a0b6dee3a9f940d92f30e9b38a7687a2f1759fa8f3bd42c5,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:registry.k8s.io/coredns/coredns:v1.11.3 ImageID:docker-pullable://registry.k8s.io/coredns/coredns@sha256:9caabbf6238b189a65d0d6e6ac138de60d6a1c419e5a341fbbb7c78382559c6e ContainerID:docker://b82c283fcb278732a0b6dee3a9f940d92f30e9b38a7687a2f1759fa8f3bd42c5 Started:0xc000d7f7d0 AllocatedResources:map[] Resources:nil VolumeMounts:[{Name:config-volume MountPath:/etc/coredns ReadOnly:true RecursiveReadOnly:0xc0006c8ce0} {Name:kube-api-access-bwvpn MountPath:/var/run/secrets/kubernetes.io/serviceaccount
ReadOnly:true RecursiveReadOnly:0xc0006c8d00}] User:nil AllocatedResourcesStatus:[]}] QOSClass:Burstable EphemeralContainerStatuses:[] Resize: ResourceClaimStatuses:[]}
I0913 23:27:52.446817 13384 pod_ready.go:82] duration metric: took 13.077037935s for pod "coredns-7c65d6cfc9-qq29j" in "kube-system" namespace to be "Ready" ...
E0913 23:27:52.446830 13384 pod_ready.go:67] WaitExtra: waitPodCondition: pod "coredns-7c65d6cfc9-qq29j" in "kube-system" namespace has status phase "Succeeded" (skipping!): {Phase:Succeeded Conditions:[{Type:PodReadyToStartContainers Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-13 23:27:52 +0000 UTC Reason: Message:} {Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-13 23:27:37 +0000 UTC Reason:PodCompleted Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-13 23:27:37 +0000 UTC Reason:PodCompleted Message:} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-13 23:27:37 +0000 UTC Reason:PodCompleted Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-09-13 23:27:37 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:192.168.4
9.2 HostIPs:[{IP:192.168.49.2}] PodIP:10.244.0.2 PodIPs:[{IP:10.244.0.2}] StartTime:2024-09-13 23:27:37 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:coredns State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2024-09-13 23:27:40 +0000 UTC,FinishedAt:2024-09-13 23:27:51 +0000 UTC,ContainerID:docker://b82c283fcb278732a0b6dee3a9f940d92f30e9b38a7687a2f1759fa8f3bd42c5,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:registry.k8s.io/coredns/coredns:v1.11.3 ImageID:docker-pullable://registry.k8s.io/coredns/coredns@sha256:9caabbf6238b189a65d0d6e6ac138de60d6a1c419e5a341fbbb7c78382559c6e ContainerID:docker://b82c283fcb278732a0b6dee3a9f940d92f30e9b38a7687a2f1759fa8f3bd42c5 Started:0xc000d7f7d0 AllocatedResources:map[] Resources:nil VolumeMounts:[{Name:config-volume MountPath:/etc/coredns ReadOnly:true RecursiveReadOnly:0xc0006c8ce0} {Name:kube-api-access-bwvpn MountPath:/var/run/secrets
/kubernetes.io/serviceaccount ReadOnly:true RecursiveReadOnly:0xc0006c8d00}] User:nil AllocatedResourcesStatus:[]}] QOSClass:Burstable EphemeralContainerStatuses:[] Resize: ResourceClaimStatuses:[]}
I0913 23:27:52.446842 13384 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-sh6nk" in "kube-system" namespace to be "Ready" ...
I0913 23:27:52.466815 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:52.467265 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:52.743413 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:52.967897 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:53.044248 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:53.166888 13384 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.523692357s)
I0913 23:27:53.243918 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:53.466892 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:53.566114 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:53.582848 13384 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.421532449s)
I0913 23:27:53.585148 13384 addons.go:475] Verifying addon gcp-auth=true in "addons-794116"
I0913 23:27:53.587641 13384 out.go:177] * Verifying gcp-auth addon...
I0913 23:27:53.589631 13384 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0913 23:27:53.666419 13384 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0913 23:27:53.672332 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:53.966315 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:53.966955 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:54.171592 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:54.451990 13384 pod_ready.go:103] pod "coredns-7c65d6cfc9-sh6nk" in "kube-system" namespace has status "Ready":"False"
I0913 23:27:54.466589 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:54.467195 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:54.694038 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:54.966723 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:54.967037 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:55.172297 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:55.466219 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:55.466674 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:55.672687 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:55.966900 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:55.967296 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:56.172103 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:56.453183 13384 pod_ready.go:103] pod "coredns-7c65d6cfc9-sh6nk" in "kube-system" namespace has status "Ready":"False"
I0913 23:27:56.466812 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:56.467275 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:56.695487 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:56.966176 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:56.967201 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:57.171414 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:57.467113 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:57.468630 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:57.671704 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:57.966437 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:57.966446 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:58.171769 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:58.466816 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:58.467765 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:58.672281 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:58.952399 13384 pod_ready.go:103] pod "coredns-7c65d6cfc9-sh6nk" in "kube-system" namespace has status "Ready":"False"
I0913 23:27:58.966344 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:58.966854 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:59.171380 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:59.466902 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:59.467312 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:59.671851 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:59.966539 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:59.966836 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:00.172081 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:00.466707 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:00.466773 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:00.694879 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:00.966423 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:00.967431 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:01.172707 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:01.452052 13384 pod_ready.go:103] pod "coredns-7c65d6cfc9-sh6nk" in "kube-system" namespace has status "Ready":"False"
I0913 23:28:01.466615 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:01.466825 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:01.694628 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:01.966713 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:01.967085 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:02.171519 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:02.468285 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:02.468791 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:02.671981 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:02.966492 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:02.966585 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:03.171610 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:03.466723 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:03.566149 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:03.671239 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:03.952887 13384 pod_ready.go:103] pod "coredns-7c65d6cfc9-sh6nk" in "kube-system" namespace has status "Ready":"False"
I0913 23:28:03.966195 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:03.966769 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:04.173788 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:04.467164 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:04.467711 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:04.672326 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:04.966649 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:04.967518 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:05.172524 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:05.466221 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:05.467059 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:05.672126 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:05.953176 13384 pod_ready.go:103] pod "coredns-7c65d6cfc9-sh6nk" in "kube-system" namespace has status "Ready":"False"
I0913 23:28:05.966709 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:05.967059 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:06.171583 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:06.466344 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:06.466707 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:06.672449 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:06.967916 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:06.969180 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:07.172323 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:07.467450 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:07.468259 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:07.672665 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:07.966196 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:07.966220 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:08.174483 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:08.467136 13384 pod_ready.go:103] pod "coredns-7c65d6cfc9-sh6nk" in "kube-system" namespace has status "Ready":"False"
I0913 23:28:08.468150 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:08.469056 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:08.696723 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:08.966844 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:08.967137 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:09.172038 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:09.467321 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:09.468755 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:09.672543 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:09.966692 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:09.967363 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:10.172098 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:10.466658 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:10.467201 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:10.672734 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:10.952666 13384 pod_ready.go:103] pod "coredns-7c65d6cfc9-sh6nk" in "kube-system" namespace has status "Ready":"False"
I0913 23:28:10.967020 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:10.967085 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:11.172305 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:11.466625 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:11.467210 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:11.671890 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:11.966527 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:11.966847 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:12.172326 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:12.466497 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:12.467124 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:12.672753 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:12.966327 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:12.966590 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:13.172197 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:13.452335 13384 pod_ready.go:103] pod "coredns-7c65d6cfc9-sh6nk" in "kube-system" namespace has status "Ready":"False"
I0913 23:28:13.466728 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:13.467233 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:13.672722 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:13.952994 13384 pod_ready.go:93] pod "coredns-7c65d6cfc9-sh6nk" in "kube-system" namespace has status "Ready":"True"
I0913 23:28:13.953020 13384 pod_ready.go:82] duration metric: took 21.506168334s for pod "coredns-7c65d6cfc9-sh6nk" in "kube-system" namespace to be "Ready" ...
I0913 23:28:13.953034 13384 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-794116" in "kube-system" namespace to be "Ready" ...
I0913 23:28:13.957879 13384 pod_ready.go:93] pod "etcd-addons-794116" in "kube-system" namespace has status "Ready":"True"
I0913 23:28:13.957899 13384 pod_ready.go:82] duration metric: took 4.857968ms for pod "etcd-addons-794116" in "kube-system" namespace to be "Ready" ...
I0913 23:28:13.957912 13384 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-794116" in "kube-system" namespace to be "Ready" ...
I0913 23:28:13.962429 13384 pod_ready.go:93] pod "kube-apiserver-addons-794116" in "kube-system" namespace has status "Ready":"True"
I0913 23:28:13.962477 13384 pod_ready.go:82] duration metric: took 4.531205ms for pod "kube-apiserver-addons-794116" in "kube-system" namespace to be "Ready" ...
I0913 23:28:13.962486 13384 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-794116" in "kube-system" namespace to be "Ready" ...
I0913 23:28:13.966269 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:13.966511 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:13.966903 13384 pod_ready.go:93] pod "kube-controller-manager-addons-794116" in "kube-system" namespace has status "Ready":"True"
I0913 23:28:13.966924 13384 pod_ready.go:82] duration metric: took 4.432041ms for pod "kube-controller-manager-addons-794116" in "kube-system" namespace to be "Ready" ...
I0913 23:28:13.966934 13384 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-ssdhx" in "kube-system" namespace to be "Ready" ...
I0913 23:28:13.971456 13384 pod_ready.go:93] pod "kube-proxy-ssdhx" in "kube-system" namespace has status "Ready":"True"
I0913 23:28:13.971480 13384 pod_ready.go:82] duration metric: took 4.535922ms for pod "kube-proxy-ssdhx" in "kube-system" namespace to be "Ready" ...
I0913 23:28:13.971488 13384 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-794116" in "kube-system" namespace to be "Ready" ...
I0913 23:28:14.172607 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:14.350670 13384 pod_ready.go:93] pod "kube-scheduler-addons-794116" in "kube-system" namespace has status "Ready":"True"
I0913 23:28:14.350698 13384 pod_ready.go:82] duration metric: took 379.201694ms for pod "kube-scheduler-addons-794116" in "kube-system" namespace to be "Ready" ...
I0913 23:28:14.350712 13384 pod_ready.go:79] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-4bdd4" in "kube-system" namespace to be "Ready" ...
I0913 23:28:14.466615 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:14.467261 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:14.672230 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:14.750811 13384 pod_ready.go:93] pod "nvidia-device-plugin-daemonset-4bdd4" in "kube-system" namespace has status "Ready":"True"
I0913 23:28:14.750836 13384 pod_ready.go:82] duration metric: took 400.116738ms for pod "nvidia-device-plugin-daemonset-4bdd4" in "kube-system" namespace to be "Ready" ...
I0913 23:28:14.750845 13384 pod_ready.go:39] duration metric: took 35.394197309s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0913 23:28:14.750864 13384 api_server.go:52] waiting for apiserver process to appear ...
I0913 23:28:14.750921 13384 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0913 23:28:14.765020 13384 api_server.go:72] duration metric: took 37.107931497s to wait for apiserver process to appear ...
I0913 23:28:14.765045 13384 api_server.go:88] waiting for apiserver healthz status ...
I0913 23:28:14.765065 13384 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0913 23:28:14.768727 13384 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0913 23:28:14.769640 13384 api_server.go:141] control plane version: v1.31.1
I0913 23:28:14.769665 13384 api_server.go:131] duration metric: took 4.613297ms to wait for apiserver health ...
I0913 23:28:14.769679 13384 system_pods.go:43] waiting for kube-system pods to appear ...
I0913 23:28:14.956404 13384 system_pods.go:59] 18 kube-system pods found
I0913 23:28:14.956437 13384 system_pods.go:61] "coredns-7c65d6cfc9-sh6nk" [8e308f00-c8d6-4392-a336-8615ac072fa0] Running
I0913 23:28:14.956446 13384 system_pods.go:61] "csi-hostpath-attacher-0" [df4d5c0f-83db-4b83-bd18-5a59a20aa374] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0913 23:28:14.956453 13384 system_pods.go:61] "csi-hostpath-resizer-0" [07b18f2d-e4b3-465b-9d9e-6a498955529c] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0913 23:28:14.956460 13384 system_pods.go:61] "csi-hostpathplugin-bfdr2" [0f066616-a108-43e1-b9aa-34f7e860b2c0] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0913 23:28:14.956464 13384 system_pods.go:61] "etcd-addons-794116" [6d616382-87d8-4323-bd84-5162702f5c13] Running
I0913 23:28:14.956471 13384 system_pods.go:61] "kube-apiserver-addons-794116" [ac1afe8c-5d7d-4aa9-901b-98836a7ee2f2] Running
I0913 23:28:14.956475 13384 system_pods.go:61] "kube-controller-manager-addons-794116" [f1b2fabb-82ec-4c87-8c64-c2abc548f80f] Running
I0913 23:28:14.956481 13384 system_pods.go:61] "kube-ingress-dns-minikube" [bc6d8257-6483-4171-a6be-d6104a246881] Running
I0913 23:28:14.956484 13384 system_pods.go:61] "kube-proxy-ssdhx" [bc334323-1000-4d4a-924e-e123e244817d] Running
I0913 23:28:14.956488 13384 system_pods.go:61] "kube-scheduler-addons-794116" [4d927762-586d-43cf-b3f9-f429702cbe44] Running
I0913 23:28:14.956493 13384 system_pods.go:61] "metrics-server-84c5f94fbc-nvvcp" [0d109fff-d448-40b7-8f31-d74ccc5dc0a2] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0913 23:28:14.956499 13384 system_pods.go:61] "nvidia-device-plugin-daemonset-4bdd4" [02179234-f14e-40d1-ad09-9dfc38705284] Running
I0913 23:28:14.956504 13384 system_pods.go:61] "registry-66c9cd494c-gfmv4" [0f09071c-4485-4e48-a170-d531d56fd35c] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0913 23:28:14.956508 13384 system_pods.go:61] "registry-proxy-chxww" [f8ed4610-be7a-4b55-bcd6-dbb3920e9ff3] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0913 23:28:14.956517 13384 system_pods.go:61] "snapshot-controller-56fcc65765-hzxxc" [803d5cfe-d912-4c76-a86e-a7c08f9ee8f5] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0913 23:28:14.956525 13384 system_pods.go:61] "snapshot-controller-56fcc65765-s92x7" [a96a3d64-0e82-4965-b116-5d8b96181760] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0913 23:28:14.956529 13384 system_pods.go:61] "storage-provisioner" [30354958-21c2-4f13-af4f-fcce4f4a7cde] Running
I0913 23:28:14.956534 13384 system_pods.go:61] "tiller-deploy-b48cc5f79-cx8kt" [ac846881-5d31-4bc5-8680-f2742edc0d2f] Pending / Ready:ContainersNotReady (containers with unready status: [tiller]) / ContainersReady:ContainersNotReady (containers with unready status: [tiller])
I0913 23:28:14.956541 13384 system_pods.go:74] duration metric: took 186.857118ms to wait for pod list to return data ...
I0913 23:28:14.956551 13384 default_sa.go:34] waiting for default service account to be created ...
I0913 23:28:14.966684 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:14.967617 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:15.149941 13384 default_sa.go:45] found service account: "default"
I0913 23:28:15.149967 13384 default_sa.go:55] duration metric: took 193.409779ms for default service account to be created ...
I0913 23:28:15.149976 13384 system_pods.go:116] waiting for k8s-apps to be running ...
I0913 23:28:15.172348 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:15.354785 13384 system_pods.go:86] 18 kube-system pods found
I0913 23:28:15.354814 13384 system_pods.go:89] "coredns-7c65d6cfc9-sh6nk" [8e308f00-c8d6-4392-a336-8615ac072fa0] Running
I0913 23:28:15.354824 13384 system_pods.go:89] "csi-hostpath-attacher-0" [df4d5c0f-83db-4b83-bd18-5a59a20aa374] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0913 23:28:15.354831 13384 system_pods.go:89] "csi-hostpath-resizer-0" [07b18f2d-e4b3-465b-9d9e-6a498955529c] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0913 23:28:15.354839 13384 system_pods.go:89] "csi-hostpathplugin-bfdr2" [0f066616-a108-43e1-b9aa-34f7e860b2c0] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0913 23:28:15.354843 13384 system_pods.go:89] "etcd-addons-794116" [6d616382-87d8-4323-bd84-5162702f5c13] Running
I0913 23:28:15.354848 13384 system_pods.go:89] "kube-apiserver-addons-794116" [ac1afe8c-5d7d-4aa9-901b-98836a7ee2f2] Running
I0913 23:28:15.354852 13384 system_pods.go:89] "kube-controller-manager-addons-794116" [f1b2fabb-82ec-4c87-8c64-c2abc548f80f] Running
I0913 23:28:15.354857 13384 system_pods.go:89] "kube-ingress-dns-minikube" [bc6d8257-6483-4171-a6be-d6104a246881] Running
I0913 23:28:15.354860 13384 system_pods.go:89] "kube-proxy-ssdhx" [bc334323-1000-4d4a-924e-e123e244817d] Running
I0913 23:28:15.354864 13384 system_pods.go:89] "kube-scheduler-addons-794116" [4d927762-586d-43cf-b3f9-f429702cbe44] Running
I0913 23:28:15.354871 13384 system_pods.go:89] "metrics-server-84c5f94fbc-nvvcp" [0d109fff-d448-40b7-8f31-d74ccc5dc0a2] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0913 23:28:15.354874 13384 system_pods.go:89] "nvidia-device-plugin-daemonset-4bdd4" [02179234-f14e-40d1-ad09-9dfc38705284] Running
I0913 23:28:15.354880 13384 system_pods.go:89] "registry-66c9cd494c-gfmv4" [0f09071c-4485-4e48-a170-d531d56fd35c] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0913 23:28:15.354888 13384 system_pods.go:89] "registry-proxy-chxww" [f8ed4610-be7a-4b55-bcd6-dbb3920e9ff3] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0913 23:28:15.354896 13384 system_pods.go:89] "snapshot-controller-56fcc65765-hzxxc" [803d5cfe-d912-4c76-a86e-a7c08f9ee8f5] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0913 23:28:15.354904 13384 system_pods.go:89] "snapshot-controller-56fcc65765-s92x7" [a96a3d64-0e82-4965-b116-5d8b96181760] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0913 23:28:15.354910 13384 system_pods.go:89] "storage-provisioner" [30354958-21c2-4f13-af4f-fcce4f4a7cde] Running
I0913 23:28:15.354918 13384 system_pods.go:89] "tiller-deploy-b48cc5f79-cx8kt" [ac846881-5d31-4bc5-8680-f2742edc0d2f] Pending / Ready:ContainersNotReady (containers with unready status: [tiller]) / ContainersReady:ContainersNotReady (containers with unready status: [tiller])
I0913 23:28:15.354924 13384 system_pods.go:126] duration metric: took 204.942662ms to wait for k8s-apps to be running ...
I0913 23:28:15.354933 13384 system_svc.go:44] waiting for kubelet service to be running ....
I0913 23:28:15.354982 13384 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0913 23:28:15.366152 13384 system_svc.go:56] duration metric: took 11.20851ms WaitForService to wait for kubelet
I0913 23:28:15.366182 13384 kubeadm.go:582] duration metric: took 37.709098248s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0913 23:28:15.366204 13384 node_conditions.go:102] verifying NodePressure condition ...
I0913 23:28:15.466312 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:15.467130 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:15.551068 13384 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I0913 23:28:15.551093 13384 node_conditions.go:123] node cpu capacity is 8
I0913 23:28:15.551105 13384 node_conditions.go:105] duration metric: took 184.895514ms to run NodePressure ...
I0913 23:28:15.551115 13384 start.go:241] waiting for startup goroutines ...
I0913 23:28:15.672383 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:15.966946 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:15.968184 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:16.171884 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:16.467057 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:16.467258 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:16.672189 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:16.966596 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:16.967033 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:17.172866 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:17.466565 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:17.467377 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:17.672833 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:17.966772 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:17.967280 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:18.173076 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:18.466299 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:18.467175 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:18.672182 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:18.966282 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:18.966490 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:19.171605 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:19.467587 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:19.467850 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:19.672524 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:19.966609 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:19.966886 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:20.171952 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:20.466189 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:20.466408 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:20.672089 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:20.966491 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:20.966734 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:21.171733 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:21.466750 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:21.467672 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:21.694746 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:21.966592 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:21.967102 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:22.172596 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:22.466906 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:22.466962 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:22.672183 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:23.017799 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:23.018519 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:23.172258 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:23.466449 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:23.466566 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:23.672146 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:23.966952 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:23.967142 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:24.171236 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:24.466347 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:24.466515 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:24.695168 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:24.966244 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:24.966834 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:25.171556 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:25.466330 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:25.466871 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:25.671607 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:25.967227 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:25.967340 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:26.172283 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:26.467063 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:26.467433 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:26.672236 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:26.966636 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:26.966954 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:27.172690 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:27.466469 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:27.466634 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:27.672033 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:27.966832 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:27.967589 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:28.172305 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:28.466479 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:28.466761 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:28.672105 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:28.966644 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:28.967469 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:29.171794 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:29.466361 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:29.466703 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:29.672240 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:29.966684 13384 kapi.go:107] duration metric: took 39.503374263s to wait for kubernetes.io/minikube-addons=registry ...
I0913 23:28:29.967178 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:30.171962 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:30.466413 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:30.672503 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:30.969178 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:31.172457 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:31.467095 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:31.671585 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:31.967283 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:32.171842 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:32.466636 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:32.672330 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:32.969766 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:33.174756 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:33.467039 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:33.673171 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:33.967164 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:34.172408 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:34.466529 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:34.672255 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:34.966832 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:35.171527 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:35.466666 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:35.671921 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:35.966752 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:36.171781 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:36.467692 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:36.672492 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:36.966728 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:37.171646 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:37.466993 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:37.671924 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:37.966122 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:38.172847 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:38.467257 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:38.672914 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:38.966421 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:39.171582 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:39.467296 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:39.672672 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:39.967017 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:40.194606 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:40.467469 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:40.672429 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:40.967010 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:41.203728 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:41.467457 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:41.672300 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:41.967086 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:42.194335 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:42.468346 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:42.673186 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:42.967060 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:43.172635 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:43.466835 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:43.671434 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:43.966799 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:44.172532 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:44.466861 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:44.672156 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:44.966229 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:45.172565 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:45.467074 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:45.671513 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:45.967124 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:46.172532 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:46.467113 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:46.694892 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:46.967363 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:47.171849 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:47.468145 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:47.694340 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:47.966671 13384 kapi.go:107] duration metric: took 56.004334338s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0913 23:28:48.171165 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:48.672036 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:49.172087 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:49.672525 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:50.171437 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:50.694303 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:51.171612 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:51.672641 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:52.172663 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:52.744871 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:53.172399 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:53.672032 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:54.173432 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:54.672527 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:55.172069 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:55.672136 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:56.171879 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:56.694964 13384 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:57.171723 13384 kapi.go:107] duration metric: took 1m9.503780357s to wait for app.kubernetes.io/name=ingress-nginx ...
I0913 23:29:17.093566 13384 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0913 23:29:17.093585 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:17.593578 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:18.092500 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:18.593644 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:19.092765 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:19.593275 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:20.093149 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:20.593649 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:21.092904 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:21.594126 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:22.093277 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:22.593373 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:23.093753 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:23.593625 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:24.092639 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:24.593043 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:25.093356 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:25.592944 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:26.093400 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:26.593271 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:27.093730 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:27.593421 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:28.092402 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:28.593684 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:29.093027 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:29.592325 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:30.093266 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:30.593103 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:31.093553 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:31.593832 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:32.093029 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:32.593630 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:33.093081 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:33.593794 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:34.093019 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:34.592695 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:35.092907 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:35.593588 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:36.093382 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:36.593589 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:37.093727 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:37.593509 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:38.093485 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:38.593327 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:39.093883 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:39.593552 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:40.093300 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:40.593406 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:41.093735 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:41.593549 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:42.092848 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:42.593291 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:43.093724 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:43.594038 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:44.093279 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:44.593356 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:45.092925 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:45.592980 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:46.093016 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:46.593208 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:47.093370 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:47.593214 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:48.093375 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:48.593795 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:49.093285 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:49.593130 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:50.092950 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:50.592782 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:51.093670 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:51.594055 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:52.093622 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:52.593387 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:53.093823 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:53.594203 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:54.092433 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:54.593548 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:55.092802 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:55.593872 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:56.093799 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:56.592640 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:57.094191 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:57.593432 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:58.093874 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:58.593889 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:59.093242 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:59.593516 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:00.093162 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:00.593795 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:01.093918 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:01.593252 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:02.094020 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:02.593824 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:03.093939 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:03.592978 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:04.093988 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:04.592921 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:05.093795 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:05.593649 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:06.093662 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:06.593967 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:07.093170 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:07.593309 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:08.093423 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:08.593619 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:09.092971 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:09.592924 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:10.093038 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:10.593116 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:11.093478 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:11.594029 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:12.093584 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:12.593507 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:13.093854 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:13.593864 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:14.093710 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:14.592566 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:15.092829 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:15.592701 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:16.093056 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:16.593269 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:17.093230 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:17.593355 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:18.092565 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:18.592718 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:19.093294 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:19.593179 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:20.093497 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:20.593444 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:21.093872 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:21.593958 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:22.093167 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:22.593396 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:23.093857 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:23.592844 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:24.093632 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:24.593354 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:25.093875 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:25.593635 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:26.093425 13384 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:26.593654 13384 kapi.go:107] duration metric: took 2m33.004020241s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0913 23:30:26.596044 13384 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-794116 cluster.
I0913 23:30:26.597791 13384 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0913 23:30:26.599672 13384 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0913 23:30:26.601644 13384 out.go:177] * Enabled addons: nvidia-device-plugin, default-storageclass, volcano, ingress-dns, cloud-spanner, storage-provisioner, helm-tiller, metrics-server, inspektor-gadget, yakd, storage-provisioner-rancher, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
I0913 23:30:26.603076 13384 addons.go:510] duration metric: took 2m48.945995664s for enable addons: enabled=[nvidia-device-plugin default-storageclass volcano ingress-dns cloud-spanner storage-provisioner helm-tiller metrics-server inspektor-gadget yakd storage-provisioner-rancher volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
I0913 23:30:26.603123 13384 start.go:246] waiting for cluster config update ...
I0913 23:30:26.603153 13384 start.go:255] writing updated cluster config ...
I0913 23:30:26.603436 13384 ssh_runner.go:195] Run: rm -f paused
I0913 23:30:26.653138 13384 start.go:600] kubectl: 1.31.0, cluster: 1.31.1 (minor skew: 0)
I0913 23:30:26.655801 13384 out.go:177] * Done! kubectl is now configured to use "addons-794116" cluster and "default" namespace by default
==> Docker <==
Sep 13 23:39:55 addons-794116 cri-dockerd[1607]: time="2024-09-13T23:39:55Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/aa43a0bf38647cd31cf7bbb47cda4559896fc9d07b334d852417ec646dee84db/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local europe-west1-b.c.k8s-minikube.internal c.k8s-minikube.internal google.internal options ndots:5]"
Sep 13 23:39:55 addons-794116 cri-dockerd[1607]: time="2024-09-13T23:39:55Z" level=info msg="Stop pulling image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec: Status: Image is up to date for ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec"
Sep 13 23:39:56 addons-794116 dockerd[1342]: time="2024-09-13T23:39:56.678664775Z" level=error msg="stream copy error: reading from a closed fifo"
Sep 13 23:39:56 addons-794116 dockerd[1342]: time="2024-09-13T23:39:56.678664773Z" level=error msg="stream copy error: reading from a closed fifo"
Sep 13 23:39:56 addons-794116 dockerd[1342]: time="2024-09-13T23:39:56.680708032Z" level=error msg="Error running exec 3ac0b1e1c4db32508f1cffc972dc7ecdd346bf097322c6c0165076adeada6802 in container: OCI runtime exec failed: exec failed: unable to start container process: error executing setns process: exit status 1: unknown"
Sep 13 23:39:56 addons-794116 dockerd[1342]: time="2024-09-13T23:39:56.880710502Z" level=info msg="ignoring event" container=6ca504e3289df78e3ab488d3cdda0a3c72017222fbae51d9732fc56e5e211db4 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:39:58 addons-794116 cri-dockerd[1607]: time="2024-09-13T23:39:58Z" level=info msg="Stop pulling image docker.io/nginx:alpine: Status: Downloaded newer image for nginx:alpine"
Sep 13 23:39:58 addons-794116 dockerd[1342]: time="2024-09-13T23:39:58.780250801Z" level=info msg="Attempting next endpoint for pull after error: Head \"https://gcr.io/v2/k8s-minikube/busybox/manifests/latest\": unauthorized: authentication failed"
Sep 13 23:39:58 addons-794116 dockerd[1342]: time="2024-09-13T23:39:58.782470499Z" level=error msg="Handler for POST /v1.43/images/create returned error: Head \"https://gcr.io/v2/k8s-minikube/busybox/manifests/latest\": unauthorized: authentication failed"
Sep 13 23:39:59 addons-794116 dockerd[1342]: time="2024-09-13T23:39:59.043069620Z" level=info msg="Container failed to exit within 30s of signal 15 - using the force" container=6058bddc21cebec8a04d1cf4b69bb2dec9d441c4a4769f9f05387e3e926e7632
Sep 13 23:39:59 addons-794116 dockerd[1342]: time="2024-09-13T23:39:59.066019495Z" level=info msg="ignoring event" container=6058bddc21cebec8a04d1cf4b69bb2dec9d441c4a4769f9f05387e3e926e7632 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:39:59 addons-794116 dockerd[1342]: time="2024-09-13T23:39:59.187885565Z" level=info msg="ignoring event" container=16364e8a8e63689728ebb339aea96afa0198b902c8fd531d154940931ea3ad30 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:39:59 addons-794116 dockerd[1342]: time="2024-09-13T23:39:59.258397739Z" level=info msg="ignoring event" container=33848f6605e83cf38195fc56e76cafaabb3e7a2dbd83fedde537ca4fefbd6a14 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:40:05 addons-794116 cri-dockerd[1607]: time="2024-09-13T23:40:05Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/78198a3add2c5dab4c47a24126526a5b088a54405ebedd13f42b51fee27b1b0d/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local europe-west1-b.c.k8s-minikube.internal c.k8s-minikube.internal google.internal options ndots:5]"
Sep 13 23:40:05 addons-794116 dockerd[1342]: time="2024-09-13T23:40:05.936540982Z" level=info msg="ignoring event" container=e7e374c7c4d9e57190cf279a772475d580896354e40ef0a54326c9d7e4080bda module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:40:05 addons-794116 dockerd[1342]: time="2024-09-13T23:40:05.982536255Z" level=info msg="ignoring event" container=ca2d2b720ed70170c7a3af031a9e58770fad934a935c8ca143108d956d9ab37b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:40:07 addons-794116 cri-dockerd[1607]: time="2024-09-13T23:40:07Z" level=info msg="Stop pulling image docker.io/kicbase/echo-server:1.0: Status: Downloaded newer image for kicbase/echo-server:1.0"
Sep 13 23:40:09 addons-794116 dockerd[1342]: time="2024-09-13T23:40:09.858588502Z" level=info msg="Container failed to exit within 2s of signal 15 - using the force" container=0cb2f67069b12047697724e26706d23584334c148f854c2a67e0a66751b00909
Sep 13 23:40:09 addons-794116 dockerd[1342]: time="2024-09-13T23:40:09.917392095Z" level=info msg="ignoring event" container=0cb2f67069b12047697724e26706d23584334c148f854c2a67e0a66751b00909 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:40:10 addons-794116 dockerd[1342]: time="2024-09-13T23:40:10.068977079Z" level=info msg="ignoring event" container=deb0d25b87fae9eeb6689cb3d7f93f39779646d54ca64014ed99fd5c4f94766b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:40:18 addons-794116 dockerd[1342]: time="2024-09-13T23:40:18.161107350Z" level=info msg="ignoring event" container=5788be0a541ca2b1d19f926c5d649f9cab06dbd0d11f24fc9271dd99da696d63 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:40:18 addons-794116 dockerd[1342]: time="2024-09-13T23:40:18.666937020Z" level=info msg="ignoring event" container=56416f9da8cd1bb77c3edbfa3d1fea78f0f82f42f14f047a732517c2c86c45cb module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:40:18 addons-794116 dockerd[1342]: time="2024-09-13T23:40:18.755361685Z" level=info msg="ignoring event" container=8eff0fa59ec2bbd6a61e40dfd6f44066ceadc9694e098cb8097ba6deb04d6811 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:40:18 addons-794116 dockerd[1342]: time="2024-09-13T23:40:18.824685524Z" level=info msg="ignoring event" container=77881dfebcdf59cbc298dfe797f5171fe9cf40a180707d0d3847915e9adaccaf module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:40:18 addons-794116 dockerd[1342]: time="2024-09-13T23:40:18.925923982Z" level=info msg="ignoring event" container=24a2f08f38fda7be55c978f3130000e954abaa8f90fcb430f7ebedb60d31496c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
67edd3b012855 kicbase/echo-server@sha256:127ac38a2bb9537b7f252addff209ea6801edcac8a92c8b1104dacd66a583ed6 12 seconds ago Running hello-world-app 0 78198a3add2c5 hello-world-app-55bf9c44b4-ml7wb
d84ee93502a04 nginx@sha256:a5127daff3d6f4606be3100a252419bfa84fd6ee5cd74d0feaca1a5068f97dcf 21 seconds ago Running nginx 0 aa43a0bf38647 nginx
804d8cbaf01f4 a416a98b71e22 51 seconds ago Exited helper-pod 0 6a11a154763d8 helper-pod-delete-pvc-6b1450aa-8425-40e9-a121-ba8dd1de215e
be0509575f77e gcr.io/k8s-minikube/gcp-auth-webhook@sha256:e6c5b3bc32072ea370d34c27836efd11b3519d25bd444c2a8efc339cff0e20fb 9 minutes ago Running gcp-auth 0 cf8a10a0ea851 gcp-auth-89d5ffd79-stlrf
9d523912d9d27 registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a320a50cc91bd15fd2d6fa6de58bd98c1bd64b9a6f926ce23a600d87043455a3 11 minutes ago Exited patch 0 892996805ad55 ingress-nginx-admission-patch-lmqxq
c69b93593535a registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a320a50cc91bd15fd2d6fa6de58bd98c1bd64b9a6f926ce23a600d87043455a3 11 minutes ago Exited create 0 6f122dd6cb61c ingress-nginx-admission-create-8htpj
7df3761985c43 6e38f40d628db 12 minutes ago Running storage-provisioner 0 ece6fbfc7e5f1 storage-provisioner
4838dc100cd2e c69fa2e9cbf5f 12 minutes ago Running coredns 0 f3dc729632ace coredns-7c65d6cfc9-sh6nk
0c4bc70da4b09 60c005f310ff3 12 minutes ago Running kube-proxy 0 d46e7bea5f9e4 kube-proxy-ssdhx
da914588a1926 2e96e5913fc06 12 minutes ago Running etcd 0 f034be59877e2 etcd-addons-794116
a1fd5e27686b7 6bab7719df100 12 minutes ago Running kube-apiserver 0 7f5a25984aef5 kube-apiserver-addons-794116
f486296d84ea6 9aa1fad941575 12 minutes ago Running kube-scheduler 0 3082e388bcdaa kube-scheduler-addons-794116
d610571bfc7bf 175ffd71cce3d 12 minutes ago Running kube-controller-manager 0 302302b5eafa2 kube-controller-manager-addons-794116
==> coredns [4838dc100cd2] <==
[INFO] 10.244.0.9:43946 - 30013 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000117179s
[INFO] 10.244.0.9:39985 - 58315 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000072278s
[INFO] 10.244.0.9:39985 - 20431 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000111573s
[INFO] 10.244.0.9:60966 - 43401 "A IN registry.kube-system.svc.cluster.local.europe-west1-b.c.k8s-minikube.internal. udp 95 false 512" NXDOMAIN qr,rd,ra 95 0.004888396s
[INFO] 10.244.0.9:60966 - 48013 "AAAA IN registry.kube-system.svc.cluster.local.europe-west1-b.c.k8s-minikube.internal. udp 95 false 512" NXDOMAIN qr,rd,ra 95 0.006281633s
[INFO] 10.244.0.9:38352 - 55485 "AAAA IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 80 false 512" NXDOMAIN qr,rd,ra 80 0.004319561s
[INFO] 10.244.0.9:38352 - 64958 "A IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 80 false 512" NXDOMAIN qr,rd,ra 80 0.004406885s
[INFO] 10.244.0.9:43358 - 12163 "A IN registry.kube-system.svc.cluster.local.google.internal. udp 72 false 512" NXDOMAIN qr,rd,ra 72 0.004346011s
[INFO] 10.244.0.9:43358 - 10630 "AAAA IN registry.kube-system.svc.cluster.local.google.internal. udp 72 false 512" NXDOMAIN qr,rd,ra 72 0.004669968s
[INFO] 10.244.0.9:42333 - 8006 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000062268s
[INFO] 10.244.0.9:42333 - 35653 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000102764s
[INFO] 10.244.0.26:38147 - 50907 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.00033364s
[INFO] 10.244.0.26:41524 - 12111 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000404747s
[INFO] 10.244.0.26:36134 - 26032 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000140402s
[INFO] 10.244.0.26:53047 - 50919 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.00019173s
[INFO] 10.244.0.26:49106 - 7615 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000092295s
[INFO] 10.244.0.26:55456 - 42516 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000152778s
[INFO] 10.244.0.26:46794 - 14809 "AAAA IN storage.googleapis.com.europe-west1-b.c.k8s-minikube.internal. udp 90 false 1232" NXDOMAIN qr,rd,ra 79 0.008159742s
[INFO] 10.244.0.26:55664 - 51047 "A IN storage.googleapis.com.europe-west1-b.c.k8s-minikube.internal. udp 90 false 1232" NXDOMAIN qr,rd,ra 79 0.009567764s
[INFO] 10.244.0.26:48991 - 59276 "AAAA IN storage.googleapis.com.c.k8s-minikube.internal. udp 75 false 1232" NXDOMAIN qr,rd,ra 64 0.006965088s
[INFO] 10.244.0.26:60792 - 2858 "A IN storage.googleapis.com.c.k8s-minikube.internal. udp 75 false 1232" NXDOMAIN qr,rd,ra 64 0.008014326s
[INFO] 10.244.0.26:43251 - 38676 "AAAA IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 56 0.005361184s
[INFO] 10.244.0.26:52245 - 6779 "A IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 56 0.005888296s
[INFO] 10.244.0.26:49539 - 37788 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 140 0.00193958s
[INFO] 10.244.0.26:40697 - 59604 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 116 0.002108012s
==> describe nodes <==
Name: addons-794116
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=addons-794116
kubernetes.io/os=linux
minikube.k8s.io/commit=7ca96ba7bd97af6e0063398921096f1cca785d18
minikube.k8s.io/name=addons-794116
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_13T23_27_33_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-794116
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Fri, 13 Sep 2024 23:27:30 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-794116
AcquireTime: <unset>
RenewTime: Fri, 13 Sep 2024 23:40:18 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Fri, 13 Sep 2024 23:40:07 +0000 Fri, 13 Sep 2024 23:27:28 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Fri, 13 Sep 2024 23:40:07 +0000 Fri, 13 Sep 2024 23:27:28 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Fri, 13 Sep 2024 23:40:07 +0000 Fri, 13 Sep 2024 23:27:28 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Fri, 13 Sep 2024 23:40:07 +0000 Fri, 13 Sep 2024 23:27:30 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-794116
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32859308Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32859308Ki
pods: 110
System Info:
Machine ID: e087975bdc0f4d19bbf51db5d21375de
System UUID: c8253a2f-18f2-4c02-8e7c-501ee2982979
Boot ID: 7c833354-6da6-42b8-a687-6ba7895616fb
Kernel Version: 5.15.0-1068-gcp
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://27.2.1
Kubelet Version: v1.31.1
Kube-Proxy Version: v1.31.1
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (11 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 9m14s
default hello-world-app-55bf9c44b4-ml7wb 0 (0%) 0 (0%) 0 (0%) 0 (0%) 14s
default nginx 0 (0%) 0 (0%) 0 (0%) 0 (0%) 25s
gcp-auth gcp-auth-89d5ffd79-stlrf 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
kube-system coredns-7c65d6cfc9-sh6nk 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 12m
kube-system etcd-addons-794116 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 12m
kube-system kube-apiserver-addons-794116 250m (3%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-controller-manager-addons-794116 200m (2%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-proxy-ssdhx 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-scheduler-addons-794116 100m (1%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (9%) 0 (0%)
memory 170Mi (0%) 170Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 12m kube-proxy
Warning CgroupV1 12m kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeHasSufficientMemory 12m (x8 over 12m) kubelet Node addons-794116 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 12m (x7 over 12m) kubelet Node addons-794116 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 12m (x7 over 12m) kubelet Node addons-794116 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 12m kubelet Updated Node Allocatable limit across pods
Normal Starting 12m kubelet Starting kubelet.
Warning CgroupV1 12m kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 12m kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 12m kubelet Node addons-794116 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 12m kubelet Node addons-794116 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 12m kubelet Node addons-794116 status is now: NodeHasSufficientPID
Normal RegisteredNode 12m node-controller Node addons-794116 event: Registered Node addons-794116 in Controller
==> dmesg <==
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff 5e 8f 5b 64 25 1f 08 06
[ +2.281823] IPv4: martian source 10.244.0.1 from 10.244.0.18, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 76 1f ae b5 60 38 08 06
[ +6.162619] IPv4: martian source 10.244.0.1 from 10.244.0.19, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff 62 f1 62 c3 18 7a 08 06
[ +0.008560] IPv4: martian source 10.244.0.1 from 10.244.0.20, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff d2 eb b7 c2 dd d9 08 06
[ +0.126699] IPv4: martian source 10.244.0.1 from 10.244.0.21, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 5e 02 0d a3 5a 1a 08 06
[ +11.211566] IPv4: martian source 10.244.0.1 from 10.244.0.22, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff 0e 1a 90 a4 23 bb 08 06
[ +1.073370] IPv4: martian source 10.244.0.1 from 10.244.0.23, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 16 80 ea d7 0e 8b 08 06
[Sep13 23:29] IPv4: martian source 10.244.0.1 from 10.244.0.24, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff da d1 02 1f 8c ac 08 06
[ +0.270156] IPv4: martian source 10.244.0.1 from 10.244.0.25, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff aa 20 d5 81 d0 16 08 06
[Sep13 23:30] IPv4: martian source 10.244.0.1 from 10.244.0.26, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 8a 82 85 14 e3 87 08 06
[ +0.000509] IPv4: martian source 10.244.0.26 from 10.244.0.3, on dev eth0
[ +0.000004] ll header: 00000000: ff ff ff ff ff ff a2 39 80 4f cf 28 08 06
[Sep13 23:39] IPv4: martian source 10.244.0.1 from 10.244.0.29, on dev eth0
[ +0.000009] ll header: 00000000: ff ff ff ff ff ff f6 e1 11 b4 8c c0 08 06
[Sep13 23:40] IPv4: martian source 10.244.0.37 from 10.244.0.22, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 0e 1a 90 a4 23 bb 08 06
==> etcd [da914588a192] <==
{"level":"info","ts":"2024-09-13T23:27:28.277607Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-794116 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-09-13T23:27:28.277679Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-13T23:27:28.277659Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-13T23:27:28.277757Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-13T23:27:28.277836Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-09-13T23:27:28.277850Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-09-13T23:27:28.278455Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-13T23:27:28.278575Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-13T23:27:28.278597Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-13T23:27:28.278840Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-13T23:27:28.278916Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-13T23:27:28.279929Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-09-13T23:27:28.279934Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-09-13T23:27:41.046381Z","caller":"traceutil/trace.go:171","msg":"trace[1155656943] transaction","detail":"{read_only:false; response_revision:436; number_of_response:1; }","duration":"182.689028ms","start":"2024-09-13T23:27:40.863674Z","end":"2024-09-13T23:27:41.046363Z","steps":["trace[1155656943] 'process raft request' (duration: 178.340864ms)"],"step_count":1}
{"level":"info","ts":"2024-09-13T23:27:41.047087Z","caller":"traceutil/trace.go:171","msg":"trace[1316566703] transaction","detail":"{read_only:false; response_revision:437; number_of_response:1; }","duration":"100.372436ms","start":"2024-09-13T23:27:40.946701Z","end":"2024-09-13T23:27:41.047073Z","steps":["trace[1316566703] 'process raft request' (duration: 100.082934ms)"],"step_count":1}
{"level":"info","ts":"2024-09-13T23:27:45.043820Z","caller":"traceutil/trace.go:171","msg":"trace[1300249400] transaction","detail":"{read_only:false; response_revision:611; number_of_response:1; }","duration":"101.704839ms","start":"2024-09-13T23:27:44.942094Z","end":"2024-09-13T23:27:45.043799Z","steps":["trace[1300249400] 'process raft request' (duration: 100.949509ms)"],"step_count":1}
{"level":"info","ts":"2024-09-13T23:27:45.045874Z","caller":"traceutil/trace.go:171","msg":"trace[723066149] linearizableReadLoop","detail":"{readStateIndex:624; appliedIndex:621; }","duration":"100.042114ms","start":"2024-09-13T23:27:44.945817Z","end":"2024-09-13T23:27:45.045859Z","steps":["trace[723066149] 'read index received' (duration: 97.353862ms)","trace[723066149] 'applied index is now lower than readState.Index' (duration: 2.687588ms)"],"step_count":2}
{"level":"info","ts":"2024-09-13T23:27:45.045962Z","caller":"traceutil/trace.go:171","msg":"trace[893760601] transaction","detail":"{read_only:false; response_revision:613; number_of_response:1; }","duration":"100.264032ms","start":"2024-09-13T23:27:44.945688Z","end":"2024-09-13T23:27:45.045952Z","steps":["trace[893760601] 'process raft request' (duration: 100.110617ms)"],"step_count":1}
{"level":"warn","ts":"2024-09-13T23:27:45.046166Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"100.327695ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/pods/kube-system/coredns-7c65d6cfc9-qq29j\" ","response":"range_response_count:1 size:5103"}
{"level":"info","ts":"2024-09-13T23:27:45.046217Z","caller":"traceutil/trace.go:171","msg":"trace[1621282902] range","detail":"{range_begin:/registry/pods/kube-system/coredns-7c65d6cfc9-qq29j; range_end:; response_count:1; response_revision:614; }","duration":"100.393573ms","start":"2024-09-13T23:27:44.945813Z","end":"2024-09-13T23:27:45.046207Z","steps":["trace[1621282902] 'agreement among raft nodes before linearized reading' (duration: 100.24951ms)"],"step_count":1}
{"level":"info","ts":"2024-09-13T23:27:45.046279Z","caller":"traceutil/trace.go:171","msg":"trace[1092276014] transaction","detail":"{read_only:false; response_revision:612; number_of_response:1; }","duration":"103.96721ms","start":"2024-09-13T23:27:44.942303Z","end":"2024-09-13T23:27:45.046270Z","steps":["trace[1092276014] 'process raft request' (duration: 103.419124ms)"],"step_count":1}
{"level":"info","ts":"2024-09-13T23:37:28.869572Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1918}
{"level":"info","ts":"2024-09-13T23:37:28.892844Z","caller":"mvcc/kvstore_compaction.go:69","msg":"finished scheduled compaction","compact-revision":1918,"took":"22.698441ms","hash":3347508936,"current-db-size-bytes":9199616,"current-db-size":"9.2 MB","current-db-size-in-use-bytes":5066752,"current-db-size-in-use":"5.1 MB"}
{"level":"info","ts":"2024-09-13T23:37:28.892887Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":3347508936,"revision":1918,"compact-revision":-1}
{"level":"info","ts":"2024-09-13T23:39:33.998937Z","caller":"traceutil/trace.go:171","msg":"trace[53261662] transaction","detail":"{read_only:false; response_revision:2736; number_of_response:1; }","duration":"119.823514ms","start":"2024-09-13T23:39:33.879089Z","end":"2024-09-13T23:39:33.998913Z","steps":["trace[53261662] 'process raft request' (duration: 59.70237ms)","trace[53261662] 'compare' (duration: 60.003418ms)"],"step_count":2}
==> gcp-auth [be0509575f77] <==
2024/09/13 23:31:05 Ready to write response ...
2024/09/13 23:39:12 Ready to marshal response ...
2024/09/13 23:39:12 Ready to write response ...
2024/09/13 23:39:18 Ready to marshal response ...
2024/09/13 23:39:18 Ready to write response ...
2024/09/13 23:39:18 Ready to marshal response ...
2024/09/13 23:39:18 Ready to write response ...
2024/09/13 23:39:18 Ready to marshal response ...
2024/09/13 23:39:18 Ready to write response ...
2024/09/13 23:39:20 Ready to marshal response ...
2024/09/13 23:39:20 Ready to write response ...
2024/09/13 23:39:28 Ready to marshal response ...
2024/09/13 23:39:28 Ready to write response ...
2024/09/13 23:39:29 Ready to marshal response ...
2024/09/13 23:39:29 Ready to write response ...
2024/09/13 23:39:29 Ready to marshal response ...
2024/09/13 23:39:29 Ready to write response ...
2024/09/13 23:39:29 Ready to marshal response ...
2024/09/13 23:39:29 Ready to write response ...
2024/09/13 23:39:38 Ready to marshal response ...
2024/09/13 23:39:38 Ready to write response ...
2024/09/13 23:39:54 Ready to marshal response ...
2024/09/13 23:39:54 Ready to write response ...
2024/09/13 23:40:05 Ready to marshal response ...
2024/09/13 23:40:05 Ready to write response ...
==> kernel <==
23:40:19 up 22 min, 0 users, load average: 0.83, 0.43, 0.30
Linux addons-794116 5.15.0-1068-gcp #76~20.04.1-Ubuntu SMP Tue Aug 20 15:52:45 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kube-apiserver [a1fd5e27686b] <==
W0913 23:30:57.654773 1 cacher.go:171] Terminating all watchers from cacher jobs.batch.volcano.sh
W0913 23:30:57.767507 1 cacher.go:171] Terminating all watchers from cacher jobflows.flow.volcano.sh
W0913 23:30:58.148023 1 cacher.go:171] Terminating all watchers from cacher jobtemplates.flow.volcano.sh
I0913 23:39:29.281041 1 controller.go:615] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
E0913 23:39:29.344238 1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"
E0913 23:39:29.351687 1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"
E0913 23:39:29.358348 1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"
I0913 23:39:29.458227 1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs={"IPv4":"10.100.204.59"}
E0913 23:39:44.358317 1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"
I0913 23:39:54.077763 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0913 23:39:54.077823 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0913 23:39:54.142224 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0913 23:39:54.142280 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0913 23:39:54.157915 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0913 23:39:54.157967 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0913 23:39:54.167786 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0913 23:39:54.167822 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0913 23:39:54.629605 1 controller.go:615] quota admission added evaluator for: ingresses.networking.k8s.io
I0913 23:39:54.794846 1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.96.145.216"}
W0913 23:39:55.142894 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
W0913 23:39:55.168834 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
W0913 23:39:55.176683 1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
I0913 23:39:58.493275 1 handler.go:286] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
W0913 23:39:59.551305 1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io
I0913 23:40:05.295583 1 alloc.go:330] "allocated clusterIPs" service="default/hello-world-app" clusterIPs={"IPv4":"10.104.152.25"}
==> kube-controller-manager [d610571bfc7b] <==
E0913 23:40:05.342061 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0913 23:40:06.818431 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="ingress-nginx/ingress-nginx-admission-create" delay="0s"
I0913 23:40:06.819863 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-bc57996ff" duration="9.562µs"
I0913 23:40:06.822146 1 job_controller.go:568] "enqueueing job" logger="job-controller" key="ingress-nginx/ingress-nginx-admission-patch" delay="0s"
I0913 23:40:07.271802 1 shared_informer.go:313] Waiting for caches to sync for resource quota
I0913 23:40:07.271839 1 shared_informer.go:320] Caches are synced for resource quota
W0913 23:40:07.435694 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0913 23:40:07.435742 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0913 23:40:07.453972 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-794116"
I0913 23:40:07.576868 1 shared_informer.go:313] Waiting for caches to sync for garbage collector
I0913 23:40:07.576907 1 shared_informer.go:320] Caches are synced for garbage collector
I0913 23:40:08.379499 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-world-app-55bf9c44b4" duration="4.786231ms"
I0913 23:40:08.379585 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/hello-world-app-55bf9c44b4" duration="49.198µs"
I0913 23:40:08.604408 1 namespace_controller.go:187] "Namespace has been deleted" logger="namespace-controller" namespace="gadget"
W0913 23:40:13.101506 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0913 23:40:13.101577 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0913 23:40:13.271839 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0913 23:40:13.271892 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0913 23:40:15.286626 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0913 23:40:15.286668 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0913 23:40:16.765663 1 namespace_controller.go:187] "Namespace has been deleted" logger="namespace-controller" namespace="local-path-storage"
I0913 23:40:16.985050 1 namespace_controller.go:187] "Namespace has been deleted" logger="namespace-controller" namespace="ingress-nginx"
W0913 23:40:17.129400 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0913 23:40:17.129437 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0913 23:40:18.611989 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/registry-66c9cd494c" duration="12.753µs"
==> kube-proxy [0c4bc70da4b0] <==
I0913 23:27:41.358155 1 server_linux.go:66] "Using iptables proxy"
I0913 23:27:41.855130 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0913 23:27:41.855205 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0913 23:27:42.255086 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0913 23:27:42.255153 1 server_linux.go:169] "Using iptables Proxier"
I0913 23:27:42.265039 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0913 23:27:42.265443 1 server.go:483] "Version info" version="v1.31.1"
I0913 23:27:42.265468 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0913 23:27:42.342393 1 config.go:199] "Starting service config controller"
I0913 23:27:42.342416 1 shared_informer.go:313] Waiting for caches to sync for service config
I0913 23:27:42.342447 1 config.go:105] "Starting endpoint slice config controller"
I0913 23:27:42.342455 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0913 23:27:42.351832 1 config.go:328] "Starting node config controller"
I0913 23:27:42.351861 1 shared_informer.go:313] Waiting for caches to sync for node config
I0913 23:27:42.443075 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0913 23:27:42.443137 1 shared_informer.go:320] Caches are synced for service config
I0913 23:27:42.452413 1 shared_informer.go:320] Caches are synced for node config
==> kube-scheduler [f486296d84ea] <==
W0913 23:27:30.064113 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0913 23:27:30.064218 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0913 23:27:30.064295 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
W0913 23:27:30.064320 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0913 23:27:30.064321 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0913 23:27:30.064341 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0913 23:27:30.064376 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
E0913 23:27:30.064342 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0913 23:27:30.967057 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0913 23:27:30.967099 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0913 23:27:30.998407 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
E0913 23:27:30.998445 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csistoragecapacities\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0913 23:27:31.002846 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0913 23:27:31.002901 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0913 23:27:31.089987 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0913 23:27:31.090024 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0913 23:27:31.115530 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0913 23:27:31.115577 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0913 23:27:31.148843 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0913 23:27:31.148890 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0913 23:27:31.237187 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0913 23:27:31.237241 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0913 23:27:31.363664 1 reflector.go:561] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
E0913 23:27:31.363704 1 reflector.go:158] "Unhandled Error" err="runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"
I0913 23:27:34.460724 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 13 23:40:10 addons-794116 kubelet[2449]: I0913 23:40:10.389606 2449 scope.go:117] "RemoveContainer" containerID="0cb2f67069b12047697724e26706d23584334c148f854c2a67e0a66751b00909"
Sep 13 23:40:10 addons-794116 kubelet[2449]: I0913 23:40:10.403671 2449 scope.go:117] "RemoveContainer" containerID="0cb2f67069b12047697724e26706d23584334c148f854c2a67e0a66751b00909"
Sep 13 23:40:10 addons-794116 kubelet[2449]: E0913 23:40:10.404415 2449 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: 0cb2f67069b12047697724e26706d23584334c148f854c2a67e0a66751b00909" containerID="0cb2f67069b12047697724e26706d23584334c148f854c2a67e0a66751b00909"
Sep 13 23:40:10 addons-794116 kubelet[2449]: I0913 23:40:10.404468 2449 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"0cb2f67069b12047697724e26706d23584334c148f854c2a67e0a66751b00909"} err="failed to get container status \"0cb2f67069b12047697724e26706d23584334c148f854c2a67e0a66751b00909\": rpc error: code = Unknown desc = Error response from daemon: No such container: 0cb2f67069b12047697724e26706d23584334c148f854c2a67e0a66751b00909"
Sep 13 23:40:11 addons-794116 kubelet[2449]: E0913 23:40:11.252464 2449 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"busybox\" with ImagePullBackOff: \"Back-off pulling image \\\"gcr.io/k8s-minikube/busybox:1.28.4-glibc\\\"\"" pod="default/busybox" podUID="36d98053-723d-4edc-a338-f1d737f47cea"
Sep 13 23:40:18 addons-794116 kubelet[2449]: I0913 23:40:18.370707 2449 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrr96\" (UniqueName: \"kubernetes.io/projected/5c820258-f11d-4487-96d8-8e944543e1ba-kube-api-access-mrr96\") pod \"5c820258-f11d-4487-96d8-8e944543e1ba\" (UID: \"5c820258-f11d-4487-96d8-8e944543e1ba\") "
Sep 13 23:40:18 addons-794116 kubelet[2449]: I0913 23:40:18.370754 2449 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/5c820258-f11d-4487-96d8-8e944543e1ba-gcp-creds\") pod \"5c820258-f11d-4487-96d8-8e944543e1ba\" (UID: \"5c820258-f11d-4487-96d8-8e944543e1ba\") "
Sep 13 23:40:18 addons-794116 kubelet[2449]: I0913 23:40:18.370837 2449 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/5c820258-f11d-4487-96d8-8e944543e1ba-gcp-creds" (OuterVolumeSpecName: "gcp-creds") pod "5c820258-f11d-4487-96d8-8e944543e1ba" (UID: "5c820258-f11d-4487-96d8-8e944543e1ba"). InnerVolumeSpecName "gcp-creds". PluginName "kubernetes.io/host-path", VolumeGidValue ""
Sep 13 23:40:18 addons-794116 kubelet[2449]: I0913 23:40:18.372552 2449 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c820258-f11d-4487-96d8-8e944543e1ba-kube-api-access-mrr96" (OuterVolumeSpecName: "kube-api-access-mrr96") pod "5c820258-f11d-4487-96d8-8e944543e1ba" (UID: "5c820258-f11d-4487-96d8-8e944543e1ba"). InnerVolumeSpecName "kube-api-access-mrr96". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 13 23:40:18 addons-794116 kubelet[2449]: I0913 23:40:18.470937 2449 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-mrr96\" (UniqueName: \"kubernetes.io/projected/5c820258-f11d-4487-96d8-8e944543e1ba-kube-api-access-mrr96\") on node \"addons-794116\" DevicePath \"\""
Sep 13 23:40:18 addons-794116 kubelet[2449]: I0913 23:40:18.470973 2449 reconciler_common.go:288] "Volume detached for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/5c820258-f11d-4487-96d8-8e944543e1ba-gcp-creds\") on node \"addons-794116\" DevicePath \"\""
Sep 13 23:40:18 addons-794116 kubelet[2449]: I0913 23:40:18.973708 2449 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gp5x\" (UniqueName: \"kubernetes.io/projected/0f09071c-4485-4e48-a170-d531d56fd35c-kube-api-access-5gp5x\") pod \"0f09071c-4485-4e48-a170-d531d56fd35c\" (UID: \"0f09071c-4485-4e48-a170-d531d56fd35c\") "
Sep 13 23:40:18 addons-794116 kubelet[2449]: I0913 23:40:18.978151 2449 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f09071c-4485-4e48-a170-d531d56fd35c-kube-api-access-5gp5x" (OuterVolumeSpecName: "kube-api-access-5gp5x") pod "0f09071c-4485-4e48-a170-d531d56fd35c" (UID: "0f09071c-4485-4e48-a170-d531d56fd35c"). InnerVolumeSpecName "kube-api-access-5gp5x". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 13 23:40:19 addons-794116 kubelet[2449]: I0913 23:40:19.074418 2449 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfzt5\" (UniqueName: \"kubernetes.io/projected/f8ed4610-be7a-4b55-bcd6-dbb3920e9ff3-kube-api-access-zfzt5\") pod \"f8ed4610-be7a-4b55-bcd6-dbb3920e9ff3\" (UID: \"f8ed4610-be7a-4b55-bcd6-dbb3920e9ff3\") "
Sep 13 23:40:19 addons-794116 kubelet[2449]: I0913 23:40:19.074528 2449 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-5gp5x\" (UniqueName: \"kubernetes.io/projected/0f09071c-4485-4e48-a170-d531d56fd35c-kube-api-access-5gp5x\") on node \"addons-794116\" DevicePath \"\""
Sep 13 23:40:19 addons-794116 kubelet[2449]: I0913 23:40:19.076132 2449 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8ed4610-be7a-4b55-bcd6-dbb3920e9ff3-kube-api-access-zfzt5" (OuterVolumeSpecName: "kube-api-access-zfzt5") pod "f8ed4610-be7a-4b55-bcd6-dbb3920e9ff3" (UID: "f8ed4610-be7a-4b55-bcd6-dbb3920e9ff3"). InnerVolumeSpecName "kube-api-access-zfzt5". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 13 23:40:19 addons-794116 kubelet[2449]: I0913 23:40:19.175439 2449 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-zfzt5\" (UniqueName: \"kubernetes.io/projected/f8ed4610-be7a-4b55-bcd6-dbb3920e9ff3-kube-api-access-zfzt5\") on node \"addons-794116\" DevicePath \"\""
Sep 13 23:40:19 addons-794116 kubelet[2449]: I0913 23:40:19.490535 2449 scope.go:117] "RemoveContainer" containerID="56416f9da8cd1bb77c3edbfa3d1fea78f0f82f42f14f047a732517c2c86c45cb"
Sep 13 23:40:19 addons-794116 kubelet[2449]: I0913 23:40:19.509740 2449 scope.go:117] "RemoveContainer" containerID="56416f9da8cd1bb77c3edbfa3d1fea78f0f82f42f14f047a732517c2c86c45cb"
Sep 13 23:40:19 addons-794116 kubelet[2449]: E0913 23:40:19.510628 2449 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: 56416f9da8cd1bb77c3edbfa3d1fea78f0f82f42f14f047a732517c2c86c45cb" containerID="56416f9da8cd1bb77c3edbfa3d1fea78f0f82f42f14f047a732517c2c86c45cb"
Sep 13 23:40:19 addons-794116 kubelet[2449]: I0913 23:40:19.510671 2449 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"56416f9da8cd1bb77c3edbfa3d1fea78f0f82f42f14f047a732517c2c86c45cb"} err="failed to get container status \"56416f9da8cd1bb77c3edbfa3d1fea78f0f82f42f14f047a732517c2c86c45cb\": rpc error: code = Unknown desc = Error response from daemon: No such container: 56416f9da8cd1bb77c3edbfa3d1fea78f0f82f42f14f047a732517c2c86c45cb"
Sep 13 23:40:19 addons-794116 kubelet[2449]: I0913 23:40:19.510699 2449 scope.go:117] "RemoveContainer" containerID="8eff0fa59ec2bbd6a61e40dfd6f44066ceadc9694e098cb8097ba6deb04d6811"
Sep 13 23:40:19 addons-794116 kubelet[2449]: I0913 23:40:19.545102 2449 scope.go:117] "RemoveContainer" containerID="8eff0fa59ec2bbd6a61e40dfd6f44066ceadc9694e098cb8097ba6deb04d6811"
Sep 13 23:40:19 addons-794116 kubelet[2449]: E0913 23:40:19.546149 2449 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: 8eff0fa59ec2bbd6a61e40dfd6f44066ceadc9694e098cb8097ba6deb04d6811" containerID="8eff0fa59ec2bbd6a61e40dfd6f44066ceadc9694e098cb8097ba6deb04d6811"
Sep 13 23:40:19 addons-794116 kubelet[2449]: I0913 23:40:19.546189 2449 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"8eff0fa59ec2bbd6a61e40dfd6f44066ceadc9694e098cb8097ba6deb04d6811"} err="failed to get container status \"8eff0fa59ec2bbd6a61e40dfd6f44066ceadc9694e098cb8097ba6deb04d6811\": rpc error: code = Unknown desc = Error response from daemon: No such container: 8eff0fa59ec2bbd6a61e40dfd6f44066ceadc9694e098cb8097ba6deb04d6811"
==> storage-provisioner [7df3761985c4] <==
I0913 23:27:46.051049 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0913 23:27:46.149951 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0913 23:27:46.150002 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0913 23:27:46.160678 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0913 23:27:46.160843 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-794116_559bfd78-9809-45c1-b17f-a9ed8a04a4f1!
I0913 23:27:46.161834 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"f479bc33-23a8-47cf-bd88-dadc3e9aec02", APIVersion:"v1", ResourceVersion:"660", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-794116_559bfd78-9809-45c1-b17f-a9ed8a04a4f1 became leader
I0913 23:27:46.261585 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-794116_559bfd78-9809-45c1-b17f-a9ed8a04a4f1!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p addons-794116 -n addons-794116
helpers_test.go:261: (dbg) Run: kubectl --context addons-794116 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: busybox
helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Registry]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-794116 describe pod busybox
helpers_test.go:282: (dbg) kubectl --context addons-794116 describe pod busybox:
-- stdout --
Name: busybox
Namespace: default
Priority: 0
Service Account: default
Node: addons-794116/192.168.49.2
Start Time: Fri, 13 Sep 2024 23:31:05 +0000
Labels: integration-test=busybox
Annotations: <none>
Status: Pending
IP: 10.244.0.28
IPs:
IP: 10.244.0.28
Containers:
busybox:
Container ID:
Image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
Image ID:
Port: <none>
Host Port: <none>
Command:
sleep
3600
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-2bhh4 (ro)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
kube-api-access-2bhh4:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 9m15s default-scheduler Successfully assigned default/busybox to addons-794116
Normal Pulling 7m50s (x4 over 9m14s) kubelet Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
Warning Failed 7m50s (x4 over 9m14s) kubelet Failed to pull image "gcr.io/k8s-minikube/busybox:1.28.4-glibc": Error response from daemon: Head "https://gcr.io/v2/k8s-minikube/busybox/manifests/1.28.4-glibc": unauthorized: authentication failed
Warning Failed 7m50s (x4 over 9m14s) kubelet Error: ErrImagePull
Warning Failed 7m22s (x6 over 9m14s) kubelet Error: ImagePullBackOff
Normal BackOff 4m4s (x20 over 9m14s) kubelet Back-off pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
-- /stdout --
helpers_test.go:285: <<< TestAddons/parallel/Registry FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestAddons/parallel/Registry (72.56s)