=== RUN TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry
=== CONT TestAddons/parallel/Registry
addons_test.go:328: registry stabilized in 1.924175ms
addons_test.go:330: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-66c9cd494c-zwv8v" [a2abbccc-9f95-4a37-8198-40d424cdcb00] Running
addons_test.go:330: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.003951505s
addons_test.go:333: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-cf9vr" [c6fffe66-001f-45ee-9860-645249413bc6] Running
addons_test.go:333: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.002955232s
addons_test.go:338: (dbg) Run: kubectl --context addons-393052 delete po -l run=registry-test --now
addons_test.go:343: (dbg) Run: kubectl --context addons-393052 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:343: (dbg) Non-zero exit: kubectl --context addons-393052 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": exit status 1 (1m0.078371635s)
-- stdout --
pod "registry-test" deleted
-- /stdout --
** stderr **
error: timed out waiting for the condition
** /stderr **
addons_test.go:345: failed to hit registry.kube-system.svc.cluster.local. args "kubectl --context addons-393052 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c \"wget --spider -S http://registry.kube-system.svc.cluster.local\"" failed: exit status 1
addons_test.go:349: expected curl response be "HTTP/1.1 200", but got *pod "registry-test" deleted
*
addons_test.go:357: (dbg) Run: out/minikube-linux-amd64 -p addons-393052 ip
2024/09/27 17:09:48 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:386: (dbg) Run: out/minikube-linux-amd64 -p addons-393052 addons disable registry --alsologtostderr -v=1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/parallel/Registry]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-393052
helpers_test.go:235: (dbg) docker inspect addons-393052:
-- stdout --
[
{
"Id": "d5d2a9be003debcdf45a7fd97909ee6e48ef7d879f79679ba4f994a7485d62cc",
"Created": "2024-09-27T16:56:44.99803186Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 19940,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-27T16:56:45.136283674Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:fba5f082b59effd6acfcb1eed3d3f86a23bd3a65463877f8197a730d49f52a09",
"ResolvConfPath": "/var/lib/docker/containers/d5d2a9be003debcdf45a7fd97909ee6e48ef7d879f79679ba4f994a7485d62cc/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/d5d2a9be003debcdf45a7fd97909ee6e48ef7d879f79679ba4f994a7485d62cc/hostname",
"HostsPath": "/var/lib/docker/containers/d5d2a9be003debcdf45a7fd97909ee6e48ef7d879f79679ba4f994a7485d62cc/hosts",
"LogPath": "/var/lib/docker/containers/d5d2a9be003debcdf45a7fd97909ee6e48ef7d879f79679ba4f994a7485d62cc/d5d2a9be003debcdf45a7fd97909ee6e48ef7d879f79679ba4f994a7485d62cc-json.log",
"Name": "/addons-393052",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"addons-393052:/var",
"/lib/modules:/lib/modules:ro"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {
"max-size": "100m"
}
},
"NetworkMode": "addons-393052",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/647bd1ff72e872b238c16e5b34133057689ccdc550e6171dbd88848104f1735b-init/diff:/var/lib/docker/overlay2/07aafddbc91948fc974daae0282e6f765d5d278c360494fef86bc918a6f5c340/diff",
"MergedDir": "/var/lib/docker/overlay2/647bd1ff72e872b238c16e5b34133057689ccdc550e6171dbd88848104f1735b/merged",
"UpperDir": "/var/lib/docker/overlay2/647bd1ff72e872b238c16e5b34133057689ccdc550e6171dbd88848104f1735b/diff",
"WorkDir": "/var/lib/docker/overlay2/647bd1ff72e872b238c16e5b34133057689ccdc550e6171dbd88848104f1735b/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "volume",
"Name": "addons-393052",
"Source": "/var/lib/docker/volumes/addons-393052/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
}
],
"Config": {
"Hostname": "addons-393052",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-393052",
"name.minikube.sigs.k8s.io": "addons-393052",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "ef0aaecfccaec402fecc5e09209a1e3ffac1a1b59e99154c3f9931f652ef8d36",
"SandboxKey": "/var/run/docker/netns/ef0aaecfccae",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32768"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32769"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32772"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32770"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32771"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-393052": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "29b350c6cce9510e7a341cef59e1e5cd262b8e0fe65bf06d16edae0ed7d76cc3",
"EndpointID": "0401b811335a10383eee7c1ee6b2668204b5781c11c6da8b4b0713981f6998b0",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-393052",
"d5d2a9be003d"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-amd64 status --format={{.Host}} -p addons-393052 -n addons-393052
helpers_test.go:244: <<< TestAddons/parallel/Registry FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/parallel/Registry]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-amd64 -p addons-393052 logs -n 25
helpers_test.go:252: TestAddons/parallel/Registry logs:
-- stdout --
==> Audit <==
|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | --download-only -p | download-docker-229474 | jenkins | v1.34.0 | 27 Sep 24 16:56 UTC | |
| | download-docker-229474 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| delete | -p download-docker-229474 | download-docker-229474 | jenkins | v1.34.0 | 27 Sep 24 16:56 UTC | 27 Sep 24 16:56 UTC |
| start | --download-only -p | binary-mirror-269269 | jenkins | v1.34.0 | 27 Sep 24 16:56 UTC | |
| | binary-mirror-269269 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:36853 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| delete | -p binary-mirror-269269 | binary-mirror-269269 | jenkins | v1.34.0 | 27 Sep 24 16:56 UTC | 27 Sep 24 16:56 UTC |
| addons | enable dashboard -p | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 16:56 UTC | |
| | addons-393052 | | | | | |
| addons | disable dashboard -p | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 16:56 UTC | |
| | addons-393052 | | | | | |
| start | -p addons-393052 --wait=true | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 16:56 UTC | 27 Sep 24 16:59 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
| addons | addons-393052 addons disable | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 17:00 UTC | 27 Sep 24 17:00 UTC |
| | volcano --alsologtostderr -v=1 | | | | | |
| addons | enable headlamp | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 17:08 UTC | 27 Sep 24 17:08 UTC |
| | -p addons-393052 | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-393052 addons | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 17:08 UTC | 27 Sep 24 17:08 UTC |
| | disable metrics-server | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | disable nvidia-device-plugin | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 17:08 UTC | 27 Sep 24 17:08 UTC |
| | -p addons-393052 | | | | | |
| addons | addons-393052 addons disable | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 17:08 UTC | 27 Sep 24 17:08 UTC |
| | headlamp --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| addons | addons-393052 addons disable | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 17:08 UTC | 27 Sep 24 17:09 UTC |
| | yakd --alsologtostderr -v=1 | | | | | |
| addons | disable inspektor-gadget -p | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 17:08 UTC | 27 Sep 24 17:09 UTC |
| | addons-393052 | | | | | |
| ssh | addons-393052 ssh curl -s | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 17:09 UTC | 27 Sep 24 17:09 UTC |
| | http://127.0.0.1/ -H 'Host: | | | | | |
| | nginx.example.com' | | | | | |
| ip | addons-393052 ip | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 17:09 UTC | 27 Sep 24 17:09 UTC |
| addons | addons-393052 addons disable | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 17:09 UTC | 27 Sep 24 17:09 UTC |
| | ingress-dns --alsologtostderr | | | | | |
| | -v=1 | | | | | |
| addons | addons-393052 addons disable | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 17:09 UTC | 27 Sep 24 17:09 UTC |
| | ingress --alsologtostderr -v=1 | | | | | |
| ssh | addons-393052 ssh cat | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 17:09 UTC | 27 Sep 24 17:09 UTC |
| | /opt/local-path-provisioner/pvc-cc992d79-9229-48dc-815e-b7a98bf6633a_default_test-pvc/file1 | | | | | |
| addons | addons-393052 addons disable | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 17:09 UTC | |
| | storage-provisioner-rancher | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-393052 addons | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 17:09 UTC | 27 Sep 24 17:09 UTC |
| | disable csi-hostpath-driver | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-393052 addons | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 17:09 UTC | 27 Sep 24 17:09 UTC |
| | disable volumesnapshots | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | disable cloud-spanner -p | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 17:09 UTC | 27 Sep 24 17:09 UTC |
| | addons-393052 | | | | | |
| ip | addons-393052 ip | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 17:09 UTC | 27 Sep 24 17:09 UTC |
| addons | addons-393052 addons disable | addons-393052 | jenkins | v1.34.0 | 27 Sep 24 17:09 UTC | 27 Sep 24 17:09 UTC |
| | registry --alsologtostderr | | | | | |
| | -v=1 | | | | | |
|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/27 16:56:23
Running on machine: ubuntu-20-agent
Binary: Built with gc go1.23.0 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0927 16:56:23.041893 19184 out.go:345] Setting OutFile to fd 1 ...
I0927 16:56:23.042012 19184 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0927 16:56:23.042020 19184 out.go:358] Setting ErrFile to fd 2...
I0927 16:56:23.042024 19184 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0927 16:56:23.042197 19184 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19712-11000/.minikube/bin
I0927 16:56:23.042804 19184 out.go:352] Setting JSON to false
I0927 16:56:23.043601 19184 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent","uptime":2330,"bootTime":1727453853,"procs":171,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1069-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
I0927 16:56:23.043686 19184 start.go:139] virtualization: kvm guest
I0927 16:56:23.046247 19184 out.go:177] * [addons-393052] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)
I0927 16:56:23.047874 19184 out.go:177] - MINIKUBE_LOCATION=19712
I0927 16:56:23.047862 19184 notify.go:220] Checking for updates...
I0927 16:56:23.049415 19184 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0927 16:56:23.050953 19184 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19712-11000/kubeconfig
I0927 16:56:23.052242 19184 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19712-11000/.minikube
I0927 16:56:23.053400 19184 out.go:177] - MINIKUBE_BIN=out/minikube-linux-amd64
I0927 16:56:23.054505 19184 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0927 16:56:23.055901 19184 driver.go:394] Setting default libvirt URI to qemu:///system
I0927 16:56:23.077608 19184 docker.go:123] docker version: linux-27.3.1:Docker Engine - Community
I0927 16:56:23.077748 19184 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0927 16:56:23.120754 19184 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:30 OomKillDisable:true NGoroutines:45 SystemTime:2024-09-27 16:56:23.111265961 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1069-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647923200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridg
e-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I0927 16:56:23.120848 19184 docker.go:318] overlay module found
I0927 16:56:23.123846 19184 out.go:177] * Using the docker driver based on user configuration
I0927 16:56:23.125210 19184 start.go:297] selected driver: docker
I0927 16:56:23.125222 19184 start.go:901] validating driver "docker" against <nil>
I0927 16:56:23.125232 19184 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0927 16:56:23.125951 19184 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0927 16:56:23.168344 19184 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:30 OomKillDisable:true NGoroutines:45 SystemTime:2024-09-27 16:56:23.160302202 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1069-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x
86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647923200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent Labels:[] ExperimentalBuild:false ServerVersion:27.3.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridg
e-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.7] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
I0927 16:56:23.168510 19184 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0927 16:56:23.168741 19184 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0927 16:56:23.170744 19184 out.go:177] * Using Docker driver with root privileges
I0927 16:56:23.172022 19184 cni.go:84] Creating CNI manager for ""
I0927 16:56:23.172078 19184 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0927 16:56:23.172090 19184 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0927 16:56:23.172147 19184 start.go:340] cluster config:
{Name:addons-393052 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-393052 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock:
SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0927 16:56:23.173423 19184 out.go:177] * Starting "addons-393052" primary control-plane node in "addons-393052" cluster
I0927 16:56:23.174643 19184 cache.go:121] Beginning downloading kic base image for docker with docker
I0927 16:56:23.176098 19184 out.go:177] * Pulling base image v0.0.45-1727108449-19696 ...
I0927 16:56:23.177422 19184 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker
I0927 16:56:23.177454 19184 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19712-11000/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-amd64.tar.lz4
I0927 16:56:23.177464 19184 cache.go:56] Caching tarball of preloaded images
I0927 16:56:23.177479 19184 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local docker daemon
I0927 16:56:23.177543 19184 preload.go:172] Found /home/jenkins/minikube-integration/19712-11000/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0927 16:56:23.177557 19184 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker
I0927 16:56:23.177893 19184 profile.go:143] Saving config to /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/config.json ...
I0927 16:56:23.177916 19184 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/config.json: {Name:mkbd0ad00dfb1ae3fc1d82796007a185fb4418ca Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 16:56:23.193357 19184 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 to local cache
I0927 16:56:23.193481 19184 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local cache directory
I0927 16:56:23.193501 19184 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 in local cache directory, skipping pull
I0927 16:56:23.193520 19184 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 exists in cache, skipping pull
I0927 16:56:23.193530 19184 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 as a tarball
I0927 16:56:23.193534 19184 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 from local cache
I0927 16:56:35.524470 19184 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 from cached tarball
I0927 16:56:35.524503 19184 cache.go:194] Successfully downloaded all kic artifacts
I0927 16:56:35.524544 19184 start.go:360] acquireMachinesLock for addons-393052: {Name:mk76b81b630d238d72bd0c6329943de60470620a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0927 16:56:35.524647 19184 start.go:364] duration metric: took 80.309µs to acquireMachinesLock for "addons-393052"
I0927 16:56:35.524674 19184 start.go:93] Provisioning new machine with config: &{Name:addons-393052 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-393052 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cust
omQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0927 16:56:35.524769 19184 start.go:125] createHost starting for "" (driver="docker")
I0927 16:56:35.526715 19184 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0927 16:56:35.526949 19184 start.go:159] libmachine.API.Create for "addons-393052" (driver="docker")
I0927 16:56:35.526985 19184 client.go:168] LocalClient.Create starting
I0927 16:56:35.527074 19184 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19712-11000/.minikube/certs/ca.pem
I0927 16:56:35.789290 19184 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19712-11000/.minikube/certs/cert.pem
I0927 16:56:35.962922 19184 cli_runner.go:164] Run: docker network inspect addons-393052 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0927 16:56:35.978945 19184 cli_runner.go:211] docker network inspect addons-393052 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0927 16:56:35.979027 19184 network_create.go:284] running [docker network inspect addons-393052] to gather additional debugging logs...
I0927 16:56:35.979046 19184 cli_runner.go:164] Run: docker network inspect addons-393052
W0927 16:56:35.994441 19184 cli_runner.go:211] docker network inspect addons-393052 returned with exit code 1
I0927 16:56:35.994470 19184 network_create.go:287] error running [docker network inspect addons-393052]: docker network inspect addons-393052: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-393052 not found
I0927 16:56:35.994481 19184 network_create.go:289] output of [docker network inspect addons-393052]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-393052 not found
** /stderr **
I0927 16:56:35.994551 19184 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0927 16:56:36.011145 19184 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc001b0a780}
I0927 16:56:36.011190 19184 network_create.go:124] attempt to create docker network addons-393052 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0927 16:56:36.011232 19184 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-393052 addons-393052
I0927 16:56:36.071647 19184 network_create.go:108] docker network addons-393052 192.168.49.0/24 created
I0927 16:56:36.071672 19184 kic.go:121] calculated static IP "192.168.49.2" for the "addons-393052" container
I0927 16:56:36.071740 19184 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0927 16:56:36.086961 19184 cli_runner.go:164] Run: docker volume create addons-393052 --label name.minikube.sigs.k8s.io=addons-393052 --label created_by.minikube.sigs.k8s.io=true
I0927 16:56:36.104067 19184 oci.go:103] Successfully created a docker volume addons-393052
I0927 16:56:36.104138 19184 cli_runner.go:164] Run: docker run --rm --name addons-393052-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-393052 --entrypoint /usr/bin/test -v addons-393052:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -d /var/lib
I0927 16:56:41.040677 19184 cli_runner.go:217] Completed: docker run --rm --name addons-393052-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-393052 --entrypoint /usr/bin/test -v addons-393052:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -d /var/lib: (4.936497694s)
I0927 16:56:41.040703 19184 oci.go:107] Successfully prepared a docker volume addons-393052
I0927 16:56:41.040728 19184 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker
I0927 16:56:41.040746 19184 kic.go:194] Starting extracting preloaded images to volume ...
I0927 16:56:41.040811 19184 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19712-11000/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v addons-393052:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -I lz4 -xf /preloaded.tar -C /extractDir
I0927 16:56:44.939125 19184 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19712-11000/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-amd64.tar.lz4:/preloaded.tar:ro -v addons-393052:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 -I lz4 -xf /preloaded.tar -C /extractDir: (3.898270232s)
I0927 16:56:44.939164 19184 kic.go:203] duration metric: took 3.898415134s to extract preloaded images to volume ...
W0927 16:56:44.939291 19184 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0927 16:56:44.939451 19184 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0927 16:56:44.983685 19184 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-393052 --name addons-393052 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-393052 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-393052 --network addons-393052 --ip 192.168.49.2 --volume addons-393052:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21
I0927 16:56:45.309682 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Running}}
I0927 16:56:45.327236 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:56:45.345304 19184 cli_runner.go:164] Run: docker exec addons-393052 stat /var/lib/dpkg/alternatives/iptables
I0927 16:56:45.388869 19184 oci.go:144] the created container "addons-393052" has a running status.
I0927 16:56:45.388904 19184 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa...
I0927 16:56:45.458588 19184 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0927 16:56:45.478126 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:56:45.494695 19184 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0927 16:56:45.494720 19184 kic_runner.go:114] Args: [docker exec --privileged addons-393052 chown docker:docker /home/docker/.ssh/authorized_keys]
I0927 16:56:45.535613 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:56:45.556753 19184 machine.go:93] provisionDockerMachine start ...
I0927 16:56:45.556831 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:56:45.574233 19184 main.go:141] libmachine: Using SSH client type: native
I0927 16:56:45.574444 19184 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0927 16:56:45.574463 19184 main.go:141] libmachine: About to run SSH command:
hostname
I0927 16:56:45.575178 19184 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:43602->127.0.0.1:32768: read: connection reset by peer
I0927 16:56:48.687163 19184 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-393052
I0927 16:56:48.687190 19184 ubuntu.go:169] provisioning hostname "addons-393052"
I0927 16:56:48.687255 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:56:48.703939 19184 main.go:141] libmachine: Using SSH client type: native
I0927 16:56:48.704122 19184 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0927 16:56:48.704136 19184 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-393052 && echo "addons-393052" | sudo tee /etc/hostname
I0927 16:56:48.827036 19184 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-393052
I0927 16:56:48.827106 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:56:48.845174 19184 main.go:141] libmachine: Using SSH client type: native
I0927 16:56:48.845351 19184 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0927 16:56:48.845373 19184 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-393052' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-393052/g' /etc/hosts;
else
echo '127.0.1.1 addons-393052' | sudo tee -a /etc/hosts;
fi
fi
I0927 16:56:48.955712 19184 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0927 16:56:48.955739 19184 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19712-11000/.minikube CaCertPath:/home/jenkins/minikube-integration/19712-11000/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19712-11000/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19712-11000/.minikube}
I0927 16:56:48.955777 19184 ubuntu.go:177] setting up certificates
I0927 16:56:48.955789 19184 provision.go:84] configureAuth start
I0927 16:56:48.955860 19184 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-393052
I0927 16:56:48.972915 19184 provision.go:143] copyHostCerts
I0927 16:56:48.972982 19184 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19712-11000/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19712-11000/.minikube/ca.pem (1082 bytes)
I0927 16:56:48.973086 19184 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19712-11000/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19712-11000/.minikube/cert.pem (1123 bytes)
I0927 16:56:48.973146 19184 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19712-11000/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19712-11000/.minikube/key.pem (1675 bytes)
I0927 16:56:48.973192 19184 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19712-11000/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19712-11000/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19712-11000/.minikube/certs/ca-key.pem org=jenkins.addons-393052 san=[127.0.0.1 192.168.49.2 addons-393052 localhost minikube]
I0927 16:56:49.122491 19184 provision.go:177] copyRemoteCerts
I0927 16:56:49.122544 19184 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0927 16:56:49.122576 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:56:49.139173 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:56:49.224133 19184 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-11000/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0927 16:56:49.245283 19184 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-11000/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0927 16:56:49.266888 19184 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-11000/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0927 16:56:49.288183 19184 provision.go:87] duration metric: took 332.383022ms to configureAuth
I0927 16:56:49.288206 19184 ubuntu.go:193] setting minikube options for container-runtime
I0927 16:56:49.288378 19184 config.go:182] Loaded profile config "addons-393052": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.1
I0927 16:56:49.288425 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:56:49.306475 19184 main.go:141] libmachine: Using SSH client type: native
I0927 16:56:49.306645 19184 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0927 16:56:49.306658 19184 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0927 16:56:49.419927 19184 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0927 16:56:49.419947 19184 ubuntu.go:71] root file system type: overlay
I0927 16:56:49.420083 19184 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I0927 16:56:49.420145 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:56:49.436581 19184 main.go:141] libmachine: Using SSH client type: native
I0927 16:56:49.436755 19184 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0927 16:56:49.436811 19184 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0927 16:56:49.558038 19184 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0927 16:56:49.558103 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:56:49.575079 19184 main.go:141] libmachine: Using SSH client type: native
I0927 16:56:49.575259 19184 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x864a40] 0x867720 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0927 16:56:49.575283 19184 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0927 16:56:50.242733 19184 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2024-09-20 11:39:29.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2024-09-27 16:56:49.552734551 +0000
@@ -1,46 +1,49 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
-Wants=network-online.target containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
+Wants=network-online.target
Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutStartSec=0
-RestartSec=2
-Restart=always
+Restart=on-failure
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
+LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0927 16:56:50.242781 19184 machine.go:96] duration metric: took 4.686005988s to provisionDockerMachine
I0927 16:56:50.242794 19184 client.go:171] duration metric: took 14.715798889s to LocalClient.Create
I0927 16:56:50.242816 19184 start.go:167] duration metric: took 14.715867705s to libmachine.API.Create "addons-393052"
I0927 16:56:50.242825 19184 start.go:293] postStartSetup for "addons-393052" (driver="docker")
I0927 16:56:50.242839 19184 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0927 16:56:50.242905 19184 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0927 16:56:50.242950 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:56:50.261237 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:56:50.348679 19184 ssh_runner.go:195] Run: cat /etc/os-release
I0927 16:56:50.351807 19184 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0927 16:56:50.351864 19184 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0927 16:56:50.351878 19184 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0927 16:56:50.351885 19184 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0927 16:56:50.351898 19184 filesync.go:126] Scanning /home/jenkins/minikube-integration/19712-11000/.minikube/addons for local assets ...
I0927 16:56:50.351954 19184 filesync.go:126] Scanning /home/jenkins/minikube-integration/19712-11000/.minikube/files for local assets ...
I0927 16:56:50.351976 19184 start.go:296] duration metric: took 109.144075ms for postStartSetup
I0927 16:56:50.352240 19184 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-393052
I0927 16:56:50.369532 19184 profile.go:143] Saving config to /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/config.json ...
I0927 16:56:50.369784 19184 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0927 16:56:50.369820 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:56:50.387042 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:56:50.468416 19184 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0927 16:56:50.472285 19184 start.go:128] duration metric: took 14.947499497s to createHost
I0927 16:56:50.472310 19184 start.go:83] releasing machines lock for "addons-393052", held for 14.947650151s
I0927 16:56:50.472358 19184 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-393052
I0927 16:56:50.488074 19184 ssh_runner.go:195] Run: cat /version.json
I0927 16:56:50.488142 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:56:50.488172 19184 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0927 16:56:50.488231 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:56:50.505699 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:56:50.506192 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:56:50.653614 19184 ssh_runner.go:195] Run: systemctl --version
I0927 16:56:50.657569 19184 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0927 16:56:50.661330 19184 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0927 16:56:50.682205 19184 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0927 16:56:50.682264 19184 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0927 16:56:50.706829 19184 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0927 16:56:50.706852 19184 start.go:495] detecting cgroup driver to use...
I0927 16:56:50.706878 19184 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0927 16:56:50.707016 19184 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0927 16:56:50.721474 19184 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0927 16:56:50.729866 19184 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0927 16:56:50.738081 19184 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0927 16:56:50.738129 19184 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0927 16:56:50.746502 19184 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0927 16:56:50.754635 19184 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0927 16:56:50.762755 19184 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0927 16:56:50.771033 19184 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0927 16:56:50.778573 19184 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0927 16:56:50.787005 19184 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0927 16:56:50.795442 19184 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0927 16:56:50.803809 19184 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0927 16:56:50.811477 19184 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255
stdout:
stderr:
sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory
I0927 16:56:50.811536 19184 ssh_runner.go:195] Run: sudo modprobe br_netfilter
I0927 16:56:50.823746 19184 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0927 16:56:50.831598 19184 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0927 16:56:50.906850 19184 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0927 16:56:50.994507 19184 start.go:495] detecting cgroup driver to use...
I0927 16:56:50.994624 19184 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0927 16:56:50.994702 19184 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0927 16:56:51.005818 19184 cruntime.go:279] skipping containerd shutdown because we are bound to it
I0927 16:56:51.005871 19184 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0927 16:56:51.016524 19184 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0927 16:56:51.031985 19184 ssh_runner.go:195] Run: which cri-dockerd
I0927 16:56:51.035419 19184 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0927 16:56:51.044130 19184 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)
I0927 16:56:51.061379 19184 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0927 16:56:51.161104 19184 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0927 16:56:51.251878 19184 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0927 16:56:51.252039 19184 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0927 16:56:51.268670 19184 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0927 16:56:51.347572 19184 ssh_runner.go:195] Run: sudo systemctl restart docker
I0927 16:56:51.604760 19184 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
I0927 16:56:51.615620 19184 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0927 16:56:51.626003 19184 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I0927 16:56:51.694128 19184 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0927 16:56:51.758882 19184 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0927 16:56:51.835240 19184 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I0927 16:56:51.848127 19184 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0927 16:56:51.858380 19184 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0927 16:56:51.930642 19184 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
I0927 16:56:51.988443 19184 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock
I0927 16:56:51.988536 19184 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I0927 16:56:51.991887 19184 start.go:563] Will wait 60s for crictl version
I0927 16:56:51.991941 19184 ssh_runner.go:195] Run: which crictl
I0927 16:56:51.994920 19184 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0927 16:56:52.026459 19184 start.go:579] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 27.3.1
RuntimeApiVersion: v1
I0927 16:56:52.026526 19184 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0927 16:56:52.050506 19184 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0927 16:56:52.076494 19184 out.go:235] * Preparing Kubernetes v1.31.1 on Docker 27.3.1 ...
I0927 16:56:52.076580 19184 cli_runner.go:164] Run: docker network inspect addons-393052 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0927 16:56:52.092356 19184 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0927 16:56:52.095636 19184 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0927 16:56:52.105384 19184 kubeadm.go:883] updating cluster {Name:addons-393052 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-393052 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuF
irmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0927 16:56:52.105516 19184 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker
I0927 16:56:52.105564 19184 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0927 16:56:52.123112 19184 docker.go:685] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.31.1
registry.k8s.io/kube-scheduler:v1.31.1
registry.k8s.io/kube-controller-manager:v1.31.1
registry.k8s.io/kube-proxy:v1.31.1
registry.k8s.io/coredns/coredns:v1.11.3
registry.k8s.io/etcd:3.5.15-0
registry.k8s.io/pause:3.10
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0927 16:56:52.123136 19184 docker.go:615] Images already preloaded, skipping extraction
I0927 16:56:52.123191 19184 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0927 16:56:52.141495 19184 docker.go:685] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.31.1
registry.k8s.io/kube-controller-manager:v1.31.1
registry.k8s.io/kube-scheduler:v1.31.1
registry.k8s.io/kube-proxy:v1.31.1
registry.k8s.io/coredns/coredns:v1.11.3
registry.k8s.io/etcd:3.5.15-0
registry.k8s.io/pause:3.10
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0927 16:56:52.141517 19184 cache_images.go:84] Images are preloaded, skipping loading
I0927 16:56:52.141526 19184 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.1 docker true true} ...
I0927 16:56:52.141616 19184 kubeadm.go:946] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-393052 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:addons-393052 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0927 16:56:52.141675 19184 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0927 16:56:52.183092 19184 cni.go:84] Creating CNI manager for ""
I0927 16:56:52.183185 19184 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0927 16:56:52.183213 19184 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0927 16:56:52.183236 19184 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-393052 NodeName:addons-393052 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuber
netes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0927 16:56:52.183394 19184 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/cri-dockerd.sock
name: "addons-393052"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0927 16:56:52.183447 19184 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I0927 16:56:52.191367 19184 binaries.go:44] Found k8s binaries, skipping transfer
I0927 16:56:52.191430 19184 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0927 16:56:52.198956 19184 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (312 bytes)
I0927 16:56:52.214729 19184 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0927 16:56:52.230357 19184 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2155 bytes)
I0927 16:56:52.246408 19184 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0927 16:56:52.249491 19184 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0927 16:56:52.259165 19184 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0927 16:56:52.331983 19184 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0927 16:56:52.344550 19184 certs.go:68] Setting up /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052 for IP: 192.168.49.2
I0927 16:56:52.344576 19184 certs.go:194] generating shared ca certs ...
I0927 16:56:52.344598 19184 certs.go:226] acquiring lock for ca certs: {Name:mkd25fe85444030cbf67ced728971fd02eb485dc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 16:56:52.344733 19184 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19712-11000/.minikube/ca.key
I0927 16:56:52.571141 19184 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19712-11000/.minikube/ca.crt ...
I0927 16:56:52.571175 19184 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-11000/.minikube/ca.crt: {Name:mkcb22492198b5cad830e9ee5611a2f70b6b93d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 16:56:52.571354 19184 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19712-11000/.minikube/ca.key ...
I0927 16:56:52.571368 19184 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-11000/.minikube/ca.key: {Name:mk1265316919f7c1fb39689d179eb43baad065f1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 16:56:52.571448 19184 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19712-11000/.minikube/proxy-client-ca.key
I0927 16:56:52.847405 19184 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19712-11000/.minikube/proxy-client-ca.crt ...
I0927 16:56:52.847434 19184 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-11000/.minikube/proxy-client-ca.crt: {Name:mk1e2d1750f18ff3124df8961c3fb9ad29110ae8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 16:56:52.847595 19184 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19712-11000/.minikube/proxy-client-ca.key ...
I0927 16:56:52.847606 19184 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-11000/.minikube/proxy-client-ca.key: {Name:mkf96dc17706b23890963f994375368646d2a5c7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 16:56:52.847671 19184 certs.go:256] generating profile certs ...
I0927 16:56:52.847720 19184 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/client.key
I0927 16:56:52.847741 19184 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/client.crt with IP's: []
I0927 16:56:52.906945 19184 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/client.crt ...
I0927 16:56:52.906975 19184 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/client.crt: {Name:mk741acd7673595c354ab90664e34dbc738b6931 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 16:56:52.907128 19184 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/client.key ...
I0927 16:56:52.907138 19184 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/client.key: {Name:mk90ed6a0348fe77105422fd687ce12a79cb36a5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 16:56:52.907215 19184 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/apiserver.key.3ccfd323
I0927 16:56:52.907242 19184 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/apiserver.crt.3ccfd323 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0927 16:56:53.112191 19184 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/apiserver.crt.3ccfd323 ...
I0927 16:56:53.112220 19184 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/apiserver.crt.3ccfd323: {Name:mk282fcefbb8a343ff90431b321a2d87b93f0098 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 16:56:53.112385 19184 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/apiserver.key.3ccfd323 ...
I0927 16:56:53.112397 19184 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/apiserver.key.3ccfd323: {Name:mk704f833ac9cc29768857026bc41b3ac258099d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 16:56:53.112471 19184 certs.go:381] copying /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/apiserver.crt.3ccfd323 -> /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/apiserver.crt
I0927 16:56:53.112558 19184 certs.go:385] copying /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/apiserver.key.3ccfd323 -> /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/apiserver.key
I0927 16:56:53.112607 19184 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/proxy-client.key
I0927 16:56:53.112625 19184 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/proxy-client.crt with IP's: []
I0927 16:56:53.363664 19184 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/proxy-client.crt ...
I0927 16:56:53.363702 19184 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/proxy-client.crt: {Name:mk280f3360e5a1c3e4e5287e9768126f6aeca5e7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 16:56:53.363875 19184 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/proxy-client.key ...
I0927 16:56:53.363887 19184 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/proxy-client.key: {Name:mka8f1afe152ef96a017e493b2215a8ccfa6efa1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 16:56:53.364048 19184 certs.go:484] found cert: /home/jenkins/minikube-integration/19712-11000/.minikube/certs/ca-key.pem (1679 bytes)
I0927 16:56:53.364082 19184 certs.go:484] found cert: /home/jenkins/minikube-integration/19712-11000/.minikube/certs/ca.pem (1082 bytes)
I0927 16:56:53.364105 19184 certs.go:484] found cert: /home/jenkins/minikube-integration/19712-11000/.minikube/certs/cert.pem (1123 bytes)
I0927 16:56:53.364124 19184 certs.go:484] found cert: /home/jenkins/minikube-integration/19712-11000/.minikube/certs/key.pem (1675 bytes)
I0927 16:56:53.364729 19184 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-11000/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0927 16:56:53.387304 19184 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-11000/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0927 16:56:53.408714 19184 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-11000/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0927 16:56:53.430008 19184 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-11000/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0927 16:56:53.450894 19184 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0927 16:56:53.472116 19184 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
I0927 16:56:53.492993 19184 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0927 16:56:53.513688 19184 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-11000/.minikube/profiles/addons-393052/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)
I0927 16:56:53.535264 19184 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19712-11000/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0927 16:56:53.557241 19184 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0927 16:56:53.573450 19184 ssh_runner.go:195] Run: openssl version
I0927 16:56:53.578919 19184 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0927 16:56:53.587651 19184 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0927 16:56:53.590962 19184 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 27 16:56 /usr/share/ca-certificates/minikubeCA.pem
I0927 16:56:53.591020 19184 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0927 16:56:53.597268 19184 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0927 16:56:53.605768 19184 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0927 16:56:53.608957 19184 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0927 16:56:53.609001 19184 kubeadm.go:392] StartCluster: {Name:addons-393052 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1727108449-19696@sha256:c662152d8855bc4c62a3b5786a68adf99e04794e7f8f374a3859703004ef1d21 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-393052 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirm
warePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0927 16:56:53.609105 19184 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0927 16:56:53.625602 19184 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0927 16:56:53.633598 19184 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0927 16:56:53.641160 19184 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0927 16:56:53.641206 19184 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0927 16:56:53.648777 19184 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0927 16:56:53.648794 19184 kubeadm.go:157] found existing configuration files:
I0927 16:56:53.648832 19184 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0927 16:56:53.656376 19184 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0927 16:56:53.656434 19184 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0927 16:56:53.663638 19184 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0927 16:56:53.670775 19184 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0927 16:56:53.670831 19184 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0927 16:56:53.678054 19184 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0927 16:56:53.685553 19184 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0927 16:56:53.685597 19184 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0927 16:56:53.692954 19184 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0927 16:56:53.700561 19184 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0927 16:56:53.700612 19184 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0927 16:56:53.708378 19184 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0927 16:56:53.745244 19184 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1
I0927 16:56:53.745315 19184 kubeadm.go:310] [preflight] Running pre-flight checks
I0927 16:56:53.764370 19184 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0927 16:56:53.764448 19184 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1069-gcp[0m
I0927 16:56:53.764516 19184 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0927 16:56:53.764594 19184 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0927 16:56:53.764666 19184 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0927 16:56:53.764755 19184 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0927 16:56:53.764841 19184 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0927 16:56:53.764912 19184 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0927 16:56:53.764985 19184 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0927 16:56:53.765029 19184 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0927 16:56:53.765072 19184 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0927 16:56:53.765122 19184 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0927 16:56:53.814416 19184 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0927 16:56:53.814549 19184 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0927 16:56:53.814650 19184 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0927 16:56:53.824272 19184 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0927 16:56:53.827744 19184 out.go:235] - Generating certificates and keys ...
I0927 16:56:53.827882 19184 kubeadm.go:310] [certs] Using existing ca certificate authority
I0927 16:56:53.827975 19184 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0927 16:56:53.876477 19184 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0927 16:56:53.986886 19184 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0927 16:56:54.068207 19184 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0927 16:56:54.167150 19184 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0927 16:56:54.372866 19184 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0927 16:56:54.373139 19184 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-393052 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0927 16:56:54.524859 19184 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0927 16:56:54.524987 19184 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-393052 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0927 16:56:54.641105 19184 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0927 16:56:54.769201 19184 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0927 16:56:54.826534 19184 kubeadm.go:310] [certs] Generating "sa" key and public key
I0927 16:56:54.826614 19184 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0927 16:56:55.129792 19184 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0927 16:56:55.324701 19184 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0927 16:56:55.644773 19184 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0927 16:56:55.819100 19184 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0927 16:56:55.966705 19184 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0927 16:56:55.967184 19184 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0927 16:56:55.970751 19184 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0927 16:56:55.973159 19184 out.go:235] - Booting up control plane ...
I0927 16:56:55.973262 19184 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0927 16:56:55.973347 19184 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0927 16:56:55.973434 19184 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0927 16:56:55.981959 19184 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0927 16:56:55.986928 19184 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0927 16:56:55.986998 19184 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0927 16:56:56.068998 19184 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0927 16:56:56.069106 19184 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0927 16:56:57.070284 19184 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.001306231s
I0927 16:56:57.070412 19184 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0927 16:57:01.572390 19184 kubeadm.go:310] [api-check] The API server is healthy after 4.5021015s
I0927 16:57:01.583302 19184 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0927 16:57:01.595007 19184 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0927 16:57:01.612241 19184 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0927 16:57:01.612467 19184 kubeadm.go:310] [mark-control-plane] Marking the node addons-393052 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0927 16:57:01.619602 19184 kubeadm.go:310] [bootstrap-token] Using token: d7xb9t.h50rej78m8xehro2
I0927 16:57:01.620983 19184 out.go:235] - Configuring RBAC rules ...
I0927 16:57:01.621121 19184 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0927 16:57:01.624327 19184 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0927 16:57:01.629349 19184 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0927 16:57:01.631739 19184 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0927 16:57:01.634030 19184 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0927 16:57:01.637229 19184 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0927 16:57:01.979248 19184 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0927 16:57:02.395946 19184 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0927 16:57:02.979106 19184 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0927 16:57:02.980324 19184 kubeadm.go:310]
I0927 16:57:02.980434 19184 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0927 16:57:02.980452 19184 kubeadm.go:310]
I0927 16:57:02.980608 19184 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0927 16:57:02.980629 19184 kubeadm.go:310]
I0927 16:57:02.980652 19184 kubeadm.go:310] mkdir -p $HOME/.kube
I0927 16:57:02.980731 19184 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0927 16:57:02.980798 19184 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0927 16:57:02.980811 19184 kubeadm.go:310]
I0927 16:57:02.980883 19184 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0927 16:57:02.980896 19184 kubeadm.go:310]
I0927 16:57:02.980961 19184 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0927 16:57:02.980974 19184 kubeadm.go:310]
I0927 16:57:02.981058 19184 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0927 16:57:02.981157 19184 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0927 16:57:02.981255 19184 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0927 16:57:02.981265 19184 kubeadm.go:310]
I0927 16:57:02.981369 19184 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0927 16:57:02.981473 19184 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0927 16:57:02.981487 19184 kubeadm.go:310]
I0927 16:57:02.981605 19184 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token d7xb9t.h50rej78m8xehro2 \
I0927 16:57:02.981744 19184 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:a9a8e80ffcda2bf426564b2745740303b3b235efa524a72a22fa76d38bf67b20 \
I0927 16:57:02.981780 19184 kubeadm.go:310] --control-plane
I0927 16:57:02.981786 19184 kubeadm.go:310]
I0927 16:57:02.981894 19184 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0927 16:57:02.981905 19184 kubeadm.go:310]
I0927 16:57:02.982017 19184 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token d7xb9t.h50rej78m8xehro2 \
I0927 16:57:02.982135 19184 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:a9a8e80ffcda2bf426564b2745740303b3b235efa524a72a22fa76d38bf67b20
I0927 16:57:02.985632 19184 kubeadm.go:310] W0927 16:56:53.742656 1930 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0927 16:57:02.986034 19184 kubeadm.go:310] W0927 16:56:53.743285 1930 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0927 16:57:02.986309 19184 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1069-gcp\n", err: exit status 1
I0927 16:57:02.986411 19184 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0927 16:57:02.986459 19184 cni.go:84] Creating CNI manager for ""
I0927 16:57:02.986481 19184 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0927 16:57:02.988523 19184 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0927 16:57:02.989936 19184 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0927 16:57:02.998343 19184 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
I0927 16:57:03.015727 19184 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0927 16:57:03.015868 19184 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-393052 minikube.k8s.io/updated_at=2024_09_27T16_57_03_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=d0bb8598e36db8db200944ab6842cd553a7bd60c minikube.k8s.io/name=addons-393052 minikube.k8s.io/primary=true
I0927 16:57:03.015877 19184 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 16:57:03.082378 19184 ops.go:34] apiserver oom_adj: -16
I0927 16:57:03.082455 19184 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 16:57:03.582722 19184 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 16:57:04.082711 19184 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 16:57:04.582742 19184 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 16:57:05.083508 19184 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 16:57:05.582517 19184 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 16:57:06.082546 19184 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 16:57:06.582601 19184 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 16:57:07.082927 19184 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 16:57:07.583200 19184 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0927 16:57:07.668080 19184 kubeadm.go:1113] duration metric: took 4.652271388s to wait for elevateKubeSystemPrivileges
I0927 16:57:07.668110 19184 kubeadm.go:394] duration metric: took 14.059110934s to StartCluster
I0927 16:57:07.668131 19184 settings.go:142] acquiring lock: {Name:mkc0314a2dd35aa6c5a0e7084cda267c179ed285 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 16:57:07.668252 19184 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19712-11000/kubeconfig
I0927 16:57:07.668695 19184 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19712-11000/kubeconfig: {Name:mkfa8457d11960c7d13127b721ec2fe44d5a2e53 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0927 16:57:07.668926 19184 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0927 16:57:07.668952 19184 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0927 16:57:07.669007 19184 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0927 16:57:07.669119 19184 addons.go:69] Setting yakd=true in profile "addons-393052"
I0927 16:57:07.669142 19184 addons.go:234] Setting addon yakd=true in "addons-393052"
I0927 16:57:07.669137 19184 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-393052"
I0927 16:57:07.669144 19184 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-393052"
I0927 16:57:07.669161 19184 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-393052"
I0927 16:57:07.669171 19184 host.go:66] Checking if "addons-393052" exists ...
I0927 16:57:07.669184 19184 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-393052"
I0927 16:57:07.669195 19184 config.go:182] Loaded profile config "addons-393052": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.1
I0927 16:57:07.669205 19184 addons.go:69] Setting gcp-auth=true in profile "addons-393052"
I0927 16:57:07.669217 19184 mustload.go:65] Loading cluster: addons-393052
I0927 16:57:07.669198 19184 host.go:66] Checking if "addons-393052" exists ...
I0927 16:57:07.669340 19184 config.go:182] Loaded profile config "addons-393052": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.1
I0927 16:57:07.669507 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:57:07.669516 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:57:07.669637 19184 addons.go:69] Setting default-storageclass=true in profile "addons-393052"
I0927 16:57:07.669655 19184 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-393052"
I0927 16:57:07.669682 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:57:07.669696 19184 addons.go:69] Setting volcano=true in profile "addons-393052"
I0927 16:57:07.669715 19184 addons.go:234] Setting addon volcano=true in "addons-393052"
I0927 16:57:07.669738 19184 host.go:66] Checking if "addons-393052" exists ...
I0927 16:57:07.669861 19184 addons.go:69] Setting ingress-dns=true in profile "addons-393052"
I0927 16:57:07.669882 19184 addons.go:234] Setting addon ingress-dns=true in "addons-393052"
I0927 16:57:07.669906 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:57:07.669918 19184 host.go:66] Checking if "addons-393052" exists ...
I0927 16:57:07.669935 19184 addons.go:69] Setting ingress=true in profile "addons-393052"
I0927 16:57:07.669956 19184 addons.go:234] Setting addon ingress=true in "addons-393052"
I0927 16:57:07.669988 19184 host.go:66] Checking if "addons-393052" exists ...
I0927 16:57:07.670142 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:57:07.670221 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:57:07.670390 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:57:07.670491 19184 addons.go:69] Setting volumesnapshots=true in profile "addons-393052"
I0927 16:57:07.670523 19184 addons.go:234] Setting addon volumesnapshots=true in "addons-393052"
I0927 16:57:07.670559 19184 host.go:66] Checking if "addons-393052" exists ...
I0927 16:57:07.670589 19184 addons.go:69] Setting inspektor-gadget=true in profile "addons-393052"
I0927 16:57:07.669686 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:57:07.670813 19184 addons.go:69] Setting metrics-server=true in profile "addons-393052"
I0927 16:57:07.670857 19184 addons.go:234] Setting addon metrics-server=true in "addons-393052"
I0927 16:57:07.670894 19184 host.go:66] Checking if "addons-393052" exists ...
I0927 16:57:07.671025 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:57:07.671430 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:57:07.671493 19184 addons.go:69] Setting registry=true in profile "addons-393052"
I0927 16:57:07.671517 19184 addons.go:234] Setting addon registry=true in "addons-393052"
I0927 16:57:07.671553 19184 host.go:66] Checking if "addons-393052" exists ...
I0927 16:57:07.671869 19184 addons.go:69] Setting storage-provisioner=true in profile "addons-393052"
I0927 16:57:07.671895 19184 addons.go:234] Setting addon storage-provisioner=true in "addons-393052"
I0927 16:57:07.671920 19184 host.go:66] Checking if "addons-393052" exists ...
I0927 16:57:07.672214 19184 addons.go:69] Setting cloud-spanner=true in profile "addons-393052"
I0927 16:57:07.672238 19184 addons.go:234] Setting addon cloud-spanner=true in "addons-393052"
I0927 16:57:07.672270 19184 host.go:66] Checking if "addons-393052" exists ...
I0927 16:57:07.672717 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:57:07.673139 19184 out.go:177] * Verifying Kubernetes components...
I0927 16:57:07.673347 19184 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-393052"
I0927 16:57:07.673407 19184 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-393052"
I0927 16:57:07.673444 19184 host.go:66] Checking if "addons-393052" exists ...
I0927 16:57:07.674105 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:57:07.671433 19184 addons.go:234] Setting addon inspektor-gadget=true in "addons-393052"
I0927 16:57:07.676561 19184 host.go:66] Checking if "addons-393052" exists ...
I0927 16:57:07.677186 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:57:07.679923 19184 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0927 16:57:07.684522 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:57:07.685212 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:57:07.701732 19184 host.go:66] Checking if "addons-393052" exists ...
I0927 16:57:07.711070 19184 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-393052"
I0927 16:57:07.711105 19184 host.go:66] Checking if "addons-393052" exists ...
I0927 16:57:07.711388 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:57:07.714433 19184 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0927 16:57:07.714975 19184 addons.go:234] Setting addon default-storageclass=true in "addons-393052"
I0927 16:57:07.715016 19184 host.go:66] Checking if "addons-393052" exists ...
I0927 16:57:07.715647 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:57:07.715892 19184 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.24
I0927 16:57:07.721319 19184 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0927 16:57:07.721344 19184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0927 16:57:07.721395 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:57:07.721576 19184 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0927 16:57:07.722041 19184 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0927 16:57:07.722061 19184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0927 16:57:07.722107 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:57:07.722718 19184 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0927 16:57:07.722833 19184 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0927 16:57:07.722848 19184 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0927 16:57:07.722905 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:57:07.725436 19184 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0927 16:57:07.726558 19184 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0927 16:57:07.727007 19184 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0927 16:57:07.727022 19184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0927 16:57:07.727068 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:57:07.729229 19184 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0927 16:57:07.730441 19184 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0927 16:57:07.732055 19184 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0927 16:57:07.732066 19184 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.10.0
I0927 16:57:07.734330 19184 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0927 16:57:07.734412 19184 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.10.0
I0927 16:57:07.736287 19184 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0927 16:57:07.736390 19184 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.10.0
I0927 16:57:07.738228 19184 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0927 16:57:07.739746 19184 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0927 16:57:07.739772 19184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (471825 bytes)
I0927 16:57:07.739843 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:57:07.743883 19184 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0927 16:57:07.743921 19184 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0927 16:57:07.743982 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:57:07.766135 19184 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0927 16:57:07.767544 19184 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0927 16:57:07.769261 19184 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0927 16:57:07.770966 19184 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0927 16:57:07.770988 19184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0927 16:57:07.771044 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:57:07.772014 19184 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0927 16:57:07.779663 19184 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0927 16:57:07.779806 19184 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0927 16:57:07.779821 19184 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0927 16:57:07.779901 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:57:07.783966 19184 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0927 16:57:07.783995 19184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0927 16:57:07.784052 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:57:07.784466 19184 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
I0927 16:57:07.784537 19184 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0927 16:57:07.786830 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:57:07.788524 19184 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0927 16:57:07.788545 19184 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0927 16:57:07.788604 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:57:07.788757 19184 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0927 16:57:07.789721 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:57:07.791520 19184 out.go:177] - Using image docker.io/registry:2.8.3
I0927 16:57:07.791530 19184 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0927 16:57:07.791562 19184 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0927 16:57:07.791623 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:57:07.791800 19184 out.go:177] - Using image docker.io/busybox:stable
I0927 16:57:07.793479 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:57:07.793544 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:57:07.795090 19184 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0927 16:57:07.795108 19184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0927 16:57:07.795160 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:57:07.798816 19184 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0927 16:57:07.800018 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:57:07.800319 19184 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0927 16:57:07.800334 19184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0927 16:57:07.800387 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:57:07.801573 19184 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0927 16:57:07.801589 19184 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0927 16:57:07.801636 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:57:07.819192 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:57:07.821702 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:57:07.830698 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:57:07.831016 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:57:07.831282 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:57:07.831799 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:57:07.841146 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:57:07.842916 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:57:07.849158 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
W0927 16:57:07.850394 19184 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0927 16:57:07.850420 19184 retry.go:31] will retry after 187.855138ms: ssh: handshake failed: EOF
I0927 16:57:08.125846 19184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0927 16:57:08.134373 19184 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0927 16:57:08.134509 19184 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0927 16:57:08.237514 19184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0927 16:57:08.244517 19184 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0927 16:57:08.244548 19184 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0927 16:57:08.324928 19184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0927 16:57:08.333271 19184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0927 16:57:08.334848 19184 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0927 16:57:08.334879 19184 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0927 16:57:08.344492 19184 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0927 16:57:08.344524 19184 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0927 16:57:08.346170 19184 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0927 16:57:08.346208 19184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0927 16:57:08.443145 19184 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0927 16:57:08.443236 19184 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0927 16:57:08.526944 19184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0927 16:57:08.536455 19184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0927 16:57:08.626388 19184 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0927 16:57:08.626497 19184 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0927 16:57:08.629808 19184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0927 16:57:08.630205 19184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0927 16:57:08.636819 19184 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0927 16:57:08.636903 19184 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0927 16:57:08.739734 19184 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0927 16:57:08.739817 19184 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0927 16:57:08.749225 19184 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0927 16:57:08.749307 19184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0927 16:57:08.831910 19184 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0927 16:57:08.832013 19184 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0927 16:57:08.835372 19184 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0927 16:57:08.835459 19184 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0927 16:57:08.926036 19184 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0927 16:57:08.926121 19184 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0927 16:57:09.027420 19184 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0927 16:57:09.027455 19184 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0927 16:57:09.142204 19184 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0927 16:57:09.142235 19184 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0927 16:57:09.142669 19184 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0927 16:57:09.142741 19184 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0927 16:57:09.237200 19184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0927 16:57:09.245091 19184 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0927 16:57:09.245172 19184 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0927 16:57:09.433565 19184 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0927 16:57:09.433723 19184 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0927 16:57:09.526484 19184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0927 16:57:09.532002 19184 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0927 16:57:09.532084 19184 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0927 16:57:09.633673 19184 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0927 16:57:09.633756 19184 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0927 16:57:09.634596 19184 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0927 16:57:09.634654 19184 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0927 16:57:09.640813 19184 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0927 16:57:09.640836 19184 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0927 16:57:10.040258 19184 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0927 16:57:10.040289 19184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0927 16:57:10.134364 19184 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0927 16:57:10.134460 19184 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0927 16:57:10.330073 19184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (2.204179863s)
I0927 16:57:10.330239 19184 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.195708368s)
I0927 16:57:10.331010 19184 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.196597864s)
I0927 16:57:10.331166 19184 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0927 16:57:10.341490 19184 node_ready.go:35] waiting up to 6m0s for node "addons-393052" to be "Ready" ...
I0927 16:57:10.346147 19184 node_ready.go:49] node "addons-393052" has status "Ready":"True"
I0927 16:57:10.346232 19184 node_ready.go:38] duration metric: took 4.65899ms for node "addons-393052" to be "Ready" ...
I0927 16:57:10.346259 19184 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0927 16:57:10.426183 19184 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0927 16:57:10.426277 19184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0927 16:57:10.438447 19184 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-2pllc" in "kube-system" namespace to be "Ready" ...
I0927 16:57:10.531692 19184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0927 16:57:10.533373 19184 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0927 16:57:10.533440 19184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0927 16:57:10.639151 19184 addons.go:431] installing /etc/kubernetes/addons/ig-configmap.yaml
I0927 16:57:10.639229 19184 ssh_runner.go:362] scp inspektor-gadget/ig-configmap.yaml --> /etc/kubernetes/addons/ig-configmap.yaml (754 bytes)
I0927 16:57:10.845281 19184 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-393052" context rescaled to 1 replicas
I0927 16:57:11.128376 19184 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0927 16:57:11.128402 19184 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0927 16:57:11.136837 19184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0927 16:57:11.337326 19184 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0927 16:57:11.337358 19184 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0927 16:57:11.544503 19184 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0927 16:57:11.544529 19184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0927 16:57:11.849805 19184 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0927 16:57:11.849871 19184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (8196 bytes)
I0927 16:57:11.930260 19184 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0927 16:57:11.930285 19184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0927 16:57:12.340820 19184 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0927 16:57:12.340851 19184 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0927 16:57:12.440122 19184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-configmap.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0927 16:57:12.444407 19184 pod_ready.go:103] pod "coredns-7c65d6cfc9-2pllc" in "kube-system" namespace has status "Ready":"False"
I0927 16:57:12.731850 19184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0927 16:57:13.445424 19184 pod_ready.go:93] pod "coredns-7c65d6cfc9-2pllc" in "kube-system" namespace has status "Ready":"True"
I0927 16:57:13.445453 19184 pod_ready.go:82] duration metric: took 3.006909859s for pod "coredns-7c65d6cfc9-2pllc" in "kube-system" namespace to be "Ready" ...
I0927 16:57:13.445468 19184 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-smbjf" in "kube-system" namespace to be "Ready" ...
I0927 16:57:13.533127 19184 pod_ready.go:93] pod "coredns-7c65d6cfc9-smbjf" in "kube-system" namespace has status "Ready":"True"
I0927 16:57:13.533214 19184 pod_ready.go:82] duration metric: took 87.717526ms for pod "coredns-7c65d6cfc9-smbjf" in "kube-system" namespace to be "Ready" ...
I0927 16:57:13.533241 19184 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-393052" in "kube-system" namespace to be "Ready" ...
I0927 16:57:13.545924 19184 pod_ready.go:93] pod "etcd-addons-393052" in "kube-system" namespace has status "Ready":"True"
I0927 16:57:13.546003 19184 pod_ready.go:82] duration metric: took 12.743144ms for pod "etcd-addons-393052" in "kube-system" namespace to be "Ready" ...
I0927 16:57:13.546027 19184 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-393052" in "kube-system" namespace to be "Ready" ...
I0927 16:57:14.733183 19184 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0927 16:57:14.733259 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:57:14.759551 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:57:15.526596 19184 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0927 16:57:15.627547 19184 pod_ready.go:103] pod "kube-apiserver-addons-393052" in "kube-system" namespace has status "Ready":"False"
I0927 16:57:15.834148 19184 addons.go:234] Setting addon gcp-auth=true in "addons-393052"
I0927 16:57:15.834272 19184 host.go:66] Checking if "addons-393052" exists ...
I0927 16:57:15.834995 19184 cli_runner.go:164] Run: docker container inspect addons-393052 --format={{.State.Status}}
I0927 16:57:15.857978 19184 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0927 16:57:15.858025 19184 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-393052
I0927 16:57:15.875220 19184 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19712-11000/.minikube/machines/addons-393052/id_rsa Username:docker}
I0927 16:57:16.631062 19184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (8.393504607s)
I0927 16:57:16.631300 19184 addons.go:475] Verifying addon ingress=true in "addons-393052"
I0927 16:57:16.631259 19184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (8.306234232s)
I0927 16:57:16.632993 19184 out.go:177] * Verifying ingress addon...
I0927 16:57:16.634911 19184 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0927 16:57:16.642360 19184 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0927 16:57:16.642388 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:17.052692 19184 pod_ready.go:93] pod "kube-apiserver-addons-393052" in "kube-system" namespace has status "Ready":"True"
I0927 16:57:17.052719 19184 pod_ready.go:82] duration metric: took 3.506530427s for pod "kube-apiserver-addons-393052" in "kube-system" namespace to be "Ready" ...
I0927 16:57:17.052732 19184 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-393052" in "kube-system" namespace to be "Ready" ...
I0927 16:57:17.135135 19184 pod_ready.go:93] pod "kube-controller-manager-addons-393052" in "kube-system" namespace has status "Ready":"True"
I0927 16:57:17.135164 19184 pod_ready.go:82] duration metric: took 82.422027ms for pod "kube-controller-manager-addons-393052" in "kube-system" namespace to be "Ready" ...
I0927 16:57:17.135178 19184 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-fs9gn" in "kube-system" namespace to be "Ready" ...
I0927 16:57:17.142029 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:17.143058 19184 pod_ready.go:93] pod "kube-proxy-fs9gn" in "kube-system" namespace has status "Ready":"True"
I0927 16:57:17.143083 19184 pod_ready.go:82] duration metric: took 7.896613ms for pod "kube-proxy-fs9gn" in "kube-system" namespace to be "Ready" ...
I0927 16:57:17.143096 19184 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-393052" in "kube-system" namespace to be "Ready" ...
I0927 16:57:17.232231 19184 pod_ready.go:93] pod "kube-scheduler-addons-393052" in "kube-system" namespace has status "Ready":"True"
I0927 16:57:17.232259 19184 pod_ready.go:82] duration metric: took 89.154295ms for pod "kube-scheduler-addons-393052" in "kube-system" namespace to be "Ready" ...
I0927 16:57:17.232268 19184 pod_ready.go:39] duration metric: took 6.885983274s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0927 16:57:17.232291 19184 api_server.go:52] waiting for apiserver process to appear ...
I0927 16:57:17.232346 19184 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0927 16:57:17.639532 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:18.139683 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:18.640990 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:19.140110 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:19.735723 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:19.738222 19184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (11.404912382s)
I0927 16:57:19.738385 19184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (11.211355169s)
I0927 16:57:19.738683 19184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (11.202133176s)
I0927 16:57:19.738743 19184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (11.108858128s)
I0927 16:57:19.738923 19184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (11.108657841s)
I0927 16:57:19.739021 19184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (10.501730311s)
I0927 16:57:19.739066 19184 addons.go:475] Verifying addon registry=true in "addons-393052"
I0927 16:57:19.739302 19184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (10.212717311s)
I0927 16:57:19.739472 19184 addons.go:475] Verifying addon metrics-server=true in "addons-393052"
I0927 16:57:19.739556 19184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (9.207746189s)
W0927 16:57:19.739590 19184 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0927 16:57:19.739605 19184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (8.602734227s)
I0927 16:57:19.739611 19184 retry.go:31] will retry after 253.531784ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0927 16:57:19.739717 19184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-configmap.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (7.299505286s)
I0927 16:57:19.741712 19184 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-393052 service yakd-dashboard -n yakd-dashboard
I0927 16:57:19.741845 19184 out.go:177] * Verifying registry addon...
I0927 16:57:19.745080 19184 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0927 16:57:19.829020 19184 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0927 16:57:19.829046 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
W0927 16:57:19.829649 19184 out.go:270] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class local-path as non-default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]
I0927 16:57:19.993664 19184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0927 16:57:20.139755 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:20.249306 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:20.639905 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:20.748822 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:21.027958 19184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (8.29605502s)
I0927 16:57:21.028004 19184 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-393052"
I0927 16:57:21.028080 19184 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (5.170074792s)
I0927 16:57:21.028227 19184 ssh_runner.go:235] Completed: sudo pgrep -xnf kube-apiserver.*minikube.*: (3.795862172s)
I0927 16:57:21.028271 19184 api_server.go:72] duration metric: took 13.359270427s to wait for apiserver process to appear ...
I0927 16:57:21.028283 19184 api_server.go:88] waiting for apiserver healthz status ...
I0927 16:57:21.028306 19184 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0927 16:57:21.029742 19184 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0927 16:57:21.029859 19184 out.go:177] * Verifying csi-hostpath-driver addon...
I0927 16:57:21.031201 19184 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0927 16:57:21.032133 19184 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0927 16:57:21.032895 19184 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0927 16:57:21.033138 19184 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0927 16:57:21.033155 19184 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0927 16:57:21.033767 19184 api_server.go:141] control plane version: v1.31.1
I0927 16:57:21.033793 19184 api_server.go:131] duration metric: took 5.502498ms to wait for apiserver health ...
I0927 16:57:21.033803 19184 system_pods.go:43] waiting for kube-system pods to appear ...
I0927 16:57:21.038097 19184 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0927 16:57:21.038122 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:21.044592 19184 system_pods.go:59] 18 kube-system pods found
I0927 16:57:21.044633 19184 system_pods.go:61] "coredns-7c65d6cfc9-2pllc" [31a38dc3-c69a-4166-ba23-cd1906b032ba] Running
I0927 16:57:21.044643 19184 system_pods.go:61] "coredns-7c65d6cfc9-smbjf" [c8cb0003-29ec-470e-b417-f09950906702] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
I0927 16:57:21.044655 19184 system_pods.go:61] "csi-hostpath-attacher-0" [f7b8c38e-d1ca-45f9-9809-be45e7a843a5] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0927 16:57:21.044660 19184 system_pods.go:61] "csi-hostpath-resizer-0" [f83c3d29-d2c3-41d6-941c-271e02cb975f] Pending
I0927 16:57:21.044670 19184 system_pods.go:61] "csi-hostpathplugin-m9qj5" [d61fcb0c-3bd8-4d8f-bedf-829272da6773] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0927 16:57:21.044676 19184 system_pods.go:61] "etcd-addons-393052" [898d5ec8-06fa-496c-9ffd-33acc773e9d0] Running
I0927 16:57:21.044682 19184 system_pods.go:61] "kube-apiserver-addons-393052" [cb3a0080-b936-4c84-a15e-b6bcd8e2b7a3] Running
I0927 16:57:21.044688 19184 system_pods.go:61] "kube-controller-manager-addons-393052" [679e582b-b940-400c-9018-35cc52ee1cae] Running
I0927 16:57:21.044703 19184 system_pods.go:61] "kube-ingress-dns-minikube" [b45e64cb-7255-49b7-9a95-805c787f8bdd] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I0927 16:57:21.044709 19184 system_pods.go:61] "kube-proxy-fs9gn" [495174d9-13f1-40a9-9ec8-47e309f38d80] Running
I0927 16:57:21.044716 19184 system_pods.go:61] "kube-scheduler-addons-393052" [869db9a7-44ce-483d-a094-106b96b1e0de] Running
I0927 16:57:21.044724 19184 system_pods.go:61] "metrics-server-84c5f94fbc-vccps" [1e0b8e4f-fed1-4898-8e4f-a4225ff47189] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0927 16:57:21.044739 19184 system_pods.go:61] "nvidia-device-plugin-daemonset-f5t54" [b23a243e-32fe-4cd7-979d-e8f6bd767c6c] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0927 16:57:21.044748 19184 system_pods.go:61] "registry-66c9cd494c-zwv8v" [a2abbccc-9f95-4a37-8198-40d424cdcb00] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0927 16:57:21.044757 19184 system_pods.go:61] "registry-proxy-cf9vr" [c6fffe66-001f-45ee-9860-645249413bc6] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0927 16:57:21.044769 19184 system_pods.go:61] "snapshot-controller-56fcc65765-q787g" [9b6290d7-08a7-4a75-bff3-81884fb4ded7] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0927 16:57:21.044778 19184 system_pods.go:61] "snapshot-controller-56fcc65765-zkcfw" [6766b482-0155-4a4d-ac01-c6355ab29672] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0927 16:57:21.044788 19184 system_pods.go:61] "storage-provisioner" [a16d1409-216e-4eb8-b8d6-01cdbf3369f1] Running
I0927 16:57:21.044798 19184 system_pods.go:74] duration metric: took 10.987068ms to wait for pod list to return data ...
I0927 16:57:21.044811 19184 default_sa.go:34] waiting for default service account to be created ...
I0927 16:57:21.051482 19184 default_sa.go:45] found service account: "default"
I0927 16:57:21.051526 19184 default_sa.go:55] duration metric: took 6.689124ms for default service account to be created ...
I0927 16:57:21.051564 19184 system_pods.go:116] waiting for k8s-apps to be running ...
I0927 16:57:21.131533 19184 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0927 16:57:21.131557 19184 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0927 16:57:21.134035 19184 system_pods.go:86] 18 kube-system pods found
I0927 16:57:21.134072 19184 system_pods.go:89] "coredns-7c65d6cfc9-2pllc" [31a38dc3-c69a-4166-ba23-cd1906b032ba] Running
I0927 16:57:21.134085 19184 system_pods.go:89] "coredns-7c65d6cfc9-smbjf" [c8cb0003-29ec-470e-b417-f09950906702] Succeeded / Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
I0927 16:57:21.134098 19184 system_pods.go:89] "csi-hostpath-attacher-0" [f7b8c38e-d1ca-45f9-9809-be45e7a843a5] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0927 16:57:21.134105 19184 system_pods.go:89] "csi-hostpath-resizer-0" [f83c3d29-d2c3-41d6-941c-271e02cb975f] Pending
I0927 16:57:21.134119 19184 system_pods.go:89] "csi-hostpathplugin-m9qj5" [d61fcb0c-3bd8-4d8f-bedf-829272da6773] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0927 16:57:21.134124 19184 system_pods.go:89] "etcd-addons-393052" [898d5ec8-06fa-496c-9ffd-33acc773e9d0] Running
I0927 16:57:21.134131 19184 system_pods.go:89] "kube-apiserver-addons-393052" [cb3a0080-b936-4c84-a15e-b6bcd8e2b7a3] Running
I0927 16:57:21.134137 19184 system_pods.go:89] "kube-controller-manager-addons-393052" [679e582b-b940-400c-9018-35cc52ee1cae] Running
I0927 16:57:21.134151 19184 system_pods.go:89] "kube-ingress-dns-minikube" [b45e64cb-7255-49b7-9a95-805c787f8bdd] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I0927 16:57:21.134156 19184 system_pods.go:89] "kube-proxy-fs9gn" [495174d9-13f1-40a9-9ec8-47e309f38d80] Running
I0927 16:57:21.134164 19184 system_pods.go:89] "kube-scheduler-addons-393052" [869db9a7-44ce-483d-a094-106b96b1e0de] Running
I0927 16:57:21.134172 19184 system_pods.go:89] "metrics-server-84c5f94fbc-vccps" [1e0b8e4f-fed1-4898-8e4f-a4225ff47189] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0927 16:57:21.134183 19184 system_pods.go:89] "nvidia-device-plugin-daemonset-f5t54" [b23a243e-32fe-4cd7-979d-e8f6bd767c6c] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
I0927 16:57:21.134192 19184 system_pods.go:89] "registry-66c9cd494c-zwv8v" [a2abbccc-9f95-4a37-8198-40d424cdcb00] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
I0927 16:57:21.134208 19184 system_pods.go:89] "registry-proxy-cf9vr" [c6fffe66-001f-45ee-9860-645249413bc6] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
I0927 16:57:21.134216 19184 system_pods.go:89] "snapshot-controller-56fcc65765-q787g" [9b6290d7-08a7-4a75-bff3-81884fb4ded7] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0927 16:57:21.134228 19184 system_pods.go:89] "snapshot-controller-56fcc65765-zkcfw" [6766b482-0155-4a4d-ac01-c6355ab29672] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0927 16:57:21.134234 19184 system_pods.go:89] "storage-provisioner" [a16d1409-216e-4eb8-b8d6-01cdbf3369f1] Running
I0927 16:57:21.134244 19184 system_pods.go:126] duration metric: took 82.668631ms to wait for k8s-apps to be running ...
I0927 16:57:21.134257 19184 system_svc.go:44] waiting for kubelet service to be running ....
I0927 16:57:21.134307 19184 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0927 16:57:21.141614 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:21.154630 19184 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0927 16:57:21.154713 19184 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0927 16:57:21.240929 19184 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0927 16:57:21.250557 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:21.537580 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:21.640492 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:21.749503 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:22.037921 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:22.141114 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:22.239862 19184 ssh_runner.go:235] Completed: sudo systemctl is-active --quiet service kubelet: (1.105505696s)
I0927 16:57:22.239892 19184 system_svc.go:56] duration metric: took 1.105633608s WaitForService to wait for kubelet
I0927 16:57:22.239906 19184 kubeadm.go:582] duration metric: took 14.570922098s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0927 16:57:22.239922 19184 node_conditions.go:102] verifying NodePressure condition ...
I0927 16:57:22.240088 19184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.246075464s)
I0927 16:57:22.242956 19184 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
I0927 16:57:22.242992 19184 node_conditions.go:123] node cpu capacity is 8
I0927 16:57:22.243007 19184 node_conditions.go:105] duration metric: took 3.071939ms to run NodePressure ...
I0927 16:57:22.243033 19184 start.go:241] waiting for startup goroutines ...
I0927 16:57:22.249205 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:22.536536 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:22.553912 19184 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.312888237s)
I0927 16:57:22.555408 19184 addons.go:475] Verifying addon gcp-auth=true in "addons-393052"
I0927 16:57:22.556925 19184 out.go:177] * Verifying gcp-auth addon...
I0927 16:57:22.559005 19184 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0927 16:57:22.635977 19184 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0927 16:57:22.640613 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:22.749169 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:23.037495 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:23.138609 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:23.249246 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:23.536803 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:23.651613 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:23.752231 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:24.036405 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:24.139366 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:24.248551 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:24.538736 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:24.638935 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:24.748291 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:25.036755 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:25.139149 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:25.248564 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:25.536312 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:25.638441 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:25.748464 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:26.035760 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:26.139089 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:26.248081 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:26.537158 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:26.639593 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:26.748540 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:27.036576 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:27.139402 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:27.248781 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:27.536716 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:27.640020 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:27.749203 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:28.036912 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:28.138484 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:28.248932 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:28.536778 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:28.639631 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:28.749073 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:29.036789 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:29.139577 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:29.249315 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:29.536814 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:29.664366 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:29.748620 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:30.036420 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:30.141899 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:30.248671 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:30.536224 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:30.638817 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:30.748067 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:31.036697 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:31.138260 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:31.250380 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:31.537592 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:31.639103 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:31.748464 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:32.036618 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:32.164115 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:32.248669 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:32.536098 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:32.638382 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:32.748908 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:33.037313 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:33.139133 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:33.248325 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:33.536980 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:33.638532 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:33.748989 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:34.036799 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:34.139960 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:34.249090 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:34.536940 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:34.639200 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:34.749361 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:35.036752 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:35.139802 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:35.249145 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:35.536979 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:35.639105 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:35.749403 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:36.037261 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:36.139748 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:36.248978 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:36.536743 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:36.639530 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:36.750099 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:37.037060 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:37.139471 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:37.248633 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:37.537737 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:37.667994 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:37.748720 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:38.035963 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:38.139475 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:38.248743 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:38.536465 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:38.638839 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:38.749362 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:39.036090 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:39.138904 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:39.248210 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:39.536340 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:39.639165 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:39.748774 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:40.036690 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:40.139811 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:40.249636 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:40.538643 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:40.638889 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:40.748984 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:41.036338 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:41.139021 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:41.248255 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:41.536783 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:41.638357 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:41.748973 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:42.036819 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:42.141878 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:42.249448 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:42.536769 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:42.639241 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:42.748743 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:43.036171 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:43.138840 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:43.248271 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:43.536730 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:43.638223 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:43.748423 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:44.036830 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:44.138852 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:44.248063 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:44.536238 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:44.639011 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:44.748244 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:45.036178 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:45.139498 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:45.248926 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:45.536383 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:45.639484 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:45.748961 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:46.036213 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:46.139688 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:46.249215 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:46.536873 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:46.638655 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:46.749151 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:47.036727 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:47.139503 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:47.248940 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:47.536377 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:47.639149 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:47.748743 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:48.036383 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:48.138916 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:48.249870 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0927 16:57:48.536826 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:48.638873 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:48.749375 19184 kapi.go:107] duration metric: took 29.004293606s to wait for kubernetes.io/minikube-addons=registry ...
I0927 16:57:49.037029 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:49.138564 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:49.536715 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:49.638164 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:50.036693 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:50.137837 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:50.536870 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:50.639096 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:51.036933 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:51.138749 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:51.536897 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:51.638951 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:52.036474 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:52.139365 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:52.537306 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:52.639117 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:53.036861 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:53.138627 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:53.536712 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:53.639289 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:54.037342 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:54.138278 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:54.537262 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:54.638734 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:55.036245 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:55.139389 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:55.537107 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:55.639174 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:56.036896 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:56.139207 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:56.536495 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:56.639982 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:57.035954 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:57.139063 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:57.541788 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:57.639138 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:58.129516 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:58.139094 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:58.537213 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:58.641815 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:59.037342 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:59.139368 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:57:59.536905 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:57:59.640340 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:00.035667 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:00.139118 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:00.536568 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:00.640124 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:01.036308 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:01.139068 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:01.537026 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:01.642721 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:02.037555 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:02.139429 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:02.537289 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:02.639398 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:03.087479 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:03.138800 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:03.536203 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:03.638978 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:04.036258 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:04.139087 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:04.537123 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:04.639412 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:05.036656 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:05.139620 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:05.536407 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:05.638904 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:06.036172 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:06.139062 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:06.536330 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:06.638939 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:07.036533 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:07.139587 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:07.536845 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:07.639378 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:08.037054 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:08.139151 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:08.537052 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:08.639154 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:09.036454 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:09.139477 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:09.537234 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:09.639346 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:10.036792 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:10.138796 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:10.536919 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:10.638664 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:11.036786 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:11.139480 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:11.549277 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:11.651150 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:12.037089 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:12.138591 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:12.537608 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:12.638616 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:13.037277 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:13.139078 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:13.536165 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:13.639473 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:14.036739 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:14.139484 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:14.560720 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:14.663016 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:15.036767 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:15.139710 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:15.537105 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0927 16:58:15.731086 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:16.035956 19184 kapi.go:107] duration metric: took 55.003821665s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0927 16:58:16.138390 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:16.638095 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:17.138354 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:17.638549 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:18.139015 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:18.640496 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:19.138989 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:19.639180 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:20.138897 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:20.638569 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:21.140194 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:21.639674 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:22.139520 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:22.639212 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:23.139492 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:23.639740 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:24.138902 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:24.638804 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:25.139069 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:25.639308 19184 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0927 16:58:26.233509 19184 kapi.go:107] duration metric: took 1m9.598597044s to wait for app.kubernetes.io/name=ingress-nginx ...
I0927 16:58:45.062018 19184 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0927 16:58:45.062039 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:45.562830 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:46.062650 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:46.562955 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:47.061956 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:47.561905 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:48.063676 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:48.563138 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:49.062484 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:49.562425 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:50.062649 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:50.562658 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:51.061640 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:51.562489 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:52.062562 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:52.562553 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:53.062837 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:53.563090 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:54.062225 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:54.562424 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:55.062489 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:55.562192 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:56.062042 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:56.562065 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:57.062673 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:57.562580 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:58.062570 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:58.562748 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:59.062778 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:58:59.562764 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:00.062838 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:00.562840 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:01.062609 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:01.562944 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:02.062582 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:02.565030 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:03.062301 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:03.561992 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:04.062251 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:04.562659 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:05.062844 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:05.562049 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:06.061970 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:06.561693 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:07.062873 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:07.561806 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:08.061925 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:08.562583 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:09.063106 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:09.561993 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:10.062207 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:10.562378 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:11.062670 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:11.562744 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:12.062573 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:12.562734 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:13.061739 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:13.562698 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:14.062962 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:14.561707 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:15.062648 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:15.562510 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:16.062455 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:16.562640 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:17.062781 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:17.562325 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:18.062302 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:18.561976 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:19.062998 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:19.561707 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:20.063015 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:20.562075 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:21.062272 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:21.562427 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:22.062267 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:22.562201 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:23.062832 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:23.563688 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:24.062357 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:24.562256 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:25.062353 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:25.562717 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:26.062490 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:26.563093 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:27.062105 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:27.563025 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:28.062464 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:28.562233 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:29.062439 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:29.562721 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:30.062868 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:30.562003 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:31.062974 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:31.562377 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:32.062466 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:32.562870 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:33.062513 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:33.562452 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:34.062982 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:34.561812 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:35.063107 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:35.562345 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:36.062006 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:36.561671 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:37.062875 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:37.561643 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:38.062046 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:38.562271 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:39.062606 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:39.562536 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:40.062828 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:40.562096 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:41.062296 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:41.562789 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:42.062883 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:42.562366 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:43.063129 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:43.562011 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:44.062298 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:44.562117 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:45.062286 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:45.562517 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:46.062406 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:46.562242 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:47.062210 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:47.562507 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:48.061815 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:48.562792 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:49.062971 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:49.561895 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:50.063496 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:50.562392 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:51.062774 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:51.563038 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:52.061777 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:52.563495 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:53.063047 19184 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0927 16:59:53.562515 19184 kapi.go:107] duration metric: took 2m31.003507979s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0927 16:59:53.564330 19184 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-393052 cluster.
I0927 16:59:53.566077 19184 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0927 16:59:53.567934 19184 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0927 16:59:53.569672 19184 out.go:177] * Enabled addons: cloud-spanner, storage-provisioner, volcano, ingress-dns, nvidia-device-plugin, metrics-server, inspektor-gadget, yakd, storage-provisioner-rancher, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
I0927 16:59:53.571225 19184 addons.go:510] duration metric: took 2m45.902218432s for enable addons: enabled=[cloud-spanner storage-provisioner volcano ingress-dns nvidia-device-plugin metrics-server inspektor-gadget yakd storage-provisioner-rancher volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
I0927 16:59:53.571281 19184 start.go:246] waiting for cluster config update ...
I0927 16:59:53.571310 19184 start.go:255] writing updated cluster config ...
I0927 16:59:53.571581 19184 ssh_runner.go:195] Run: rm -f paused
I0927 16:59:53.622141 19184 start.go:600] kubectl: 1.31.1, cluster: 1.31.1 (minor skew: 0)
I0927 16:59:53.624029 19184 out.go:177] * Done! kubectl is now configured to use "addons-393052" cluster and "default" namespace by default
==> Docker <==
Sep 27 17:09:22 addons-393052 cri-dockerd[1609]: time="2024-09-27T17:09:22Z" level=error msg="error getting RW layer size for container ID 'ce3e0961f92df05bd817d7bc81cb28fc7d4148e54a8d89ed866d641ebc2a4d74': Error response from daemon: No such container: ce3e0961f92df05bd817d7bc81cb28fc7d4148e54a8d89ed866d641ebc2a4d74"
Sep 27 17:09:22 addons-393052 cri-dockerd[1609]: time="2024-09-27T17:09:22Z" level=error msg="Set backoffDuration to : 1m0s for container ID 'ce3e0961f92df05bd817d7bc81cb28fc7d4148e54a8d89ed866d641ebc2a4d74'"
Sep 27 17:09:22 addons-393052 cri-dockerd[1609]: time="2024-09-27T17:09:22Z" level=error msg="error getting RW layer size for container ID '72e0c551e2a6e951c35f65e2629e823ff202ba559a871a110e2c0b19a5f4dda9': Error response from daemon: No such container: 72e0c551e2a6e951c35f65e2629e823ff202ba559a871a110e2c0b19a5f4dda9"
Sep 27 17:09:22 addons-393052 cri-dockerd[1609]: time="2024-09-27T17:09:22Z" level=error msg="Set backoffDuration to : 1m0s for container ID '72e0c551e2a6e951c35f65e2629e823ff202ba559a871a110e2c0b19a5f4dda9'"
Sep 27 17:09:22 addons-393052 cri-dockerd[1609]: time="2024-09-27T17:09:22Z" level=error msg="error getting RW layer size for container ID '519348d67970a3498daa3b59a817a4124cf4be0a30759d4e6372091653f8e7cf': Error response from daemon: No such container: 519348d67970a3498daa3b59a817a4124cf4be0a30759d4e6372091653f8e7cf"
Sep 27 17:09:22 addons-393052 cri-dockerd[1609]: time="2024-09-27T17:09:22Z" level=error msg="Set backoffDuration to : 1m0s for container ID '519348d67970a3498daa3b59a817a4124cf4be0a30759d4e6372091653f8e7cf'"
Sep 27 17:09:24 addons-393052 dockerd[1344]: time="2024-09-27T17:09:24.941066244Z" level=info msg="ignoring event" container=69ece29ed7af1f1975645ae848bb7525d30fdab6fca97adf88faf5b98046a500 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 27 17:09:24 addons-393052 dockerd[1344]: time="2024-09-27T17:09:24.941508520Z" level=info msg="ignoring event" container=93decf959e3b76a9c26627938cf4718c9552c13ac92e02afc19a0b4471be236e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 27 17:09:25 addons-393052 dockerd[1344]: time="2024-09-27T17:09:25.115674612Z" level=info msg="ignoring event" container=101e0d80e45eaa383021fb9975714ca097e2659afc25ba00e690a7651217ee1e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 27 17:09:25 addons-393052 dockerd[1344]: time="2024-09-27T17:09:25.158814580Z" level=info msg="ignoring event" container=29959fc87088ce57f59e397ad1a0be2d76e6698e74e320f493e6e8aef7fe0123 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 27 17:09:26 addons-393052 dockerd[1344]: time="2024-09-27T17:09:26.743578604Z" level=info msg="ignoring event" container=90da953139646e35d84d932709018f04273fca12e7ae0a57b6e957543225da87 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 27 17:09:26 addons-393052 dockerd[1344]: time="2024-09-27T17:09:26.878652667Z" level=info msg="ignoring event" container=fb19a5fae819f3713f7652a1e8c8ed24122902196b12960078adddb46f7fde78 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 27 17:09:32 addons-393052 dockerd[1344]: time="2024-09-27T17:09:32.368839126Z" level=info msg="Attempting next endpoint for pull after error: Head \"https://gcr.io/v2/k8s-minikube/busybox/manifests/latest\": unauthorized: authentication failed" spanID=ec506c0f2092fd3f traceID=b9697c7c1f3cd8eae9eebc643358eeaf
Sep 27 17:09:32 addons-393052 dockerd[1344]: time="2024-09-27T17:09:32.371135754Z" level=error msg="Handler for POST /v1.43/images/create returned error: Head \"https://gcr.io/v2/k8s-minikube/busybox/manifests/latest\": unauthorized: authentication failed" spanID=ec506c0f2092fd3f traceID=b9697c7c1f3cd8eae9eebc643358eeaf
Sep 27 17:09:32 addons-393052 cri-dockerd[1609]: time="2024-09-27T17:09:32Z" level=error msg="error getting RW layer size for container ID '90da953139646e35d84d932709018f04273fca12e7ae0a57b6e957543225da87': Error response from daemon: No such container: 90da953139646e35d84d932709018f04273fca12e7ae0a57b6e957543225da87"
Sep 27 17:09:32 addons-393052 cri-dockerd[1609]: time="2024-09-27T17:09:32Z" level=error msg="Set backoffDuration to : 1m0s for container ID '90da953139646e35d84d932709018f04273fca12e7ae0a57b6e957543225da87'"
Sep 27 17:09:46 addons-393052 dockerd[1344]: time="2024-09-27T17:09:46.638715981Z" level=info msg="Container failed to exit within 30s of signal 15 - using the force" container=c6114842bb9eb3db024e6f85fa983e680a2bed97c4637ad13c35ad7c576bb71a spanID=6a7c6c8574830076 traceID=e988cc06e797bfa276daceba2b2de587
Sep 27 17:09:46 addons-393052 dockerd[1344]: time="2024-09-27T17:09:46.660997957Z" level=info msg="ignoring event" container=c6114842bb9eb3db024e6f85fa983e680a2bed97c4637ad13c35ad7c576bb71a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 27 17:09:46 addons-393052 dockerd[1344]: time="2024-09-27T17:09:46.788627666Z" level=info msg="ignoring event" container=598b3917890204cec64e1aa77f3408d69fd0708c8b2546b73eea61995d7ca39f module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 27 17:09:49 addons-393052 dockerd[1344]: time="2024-09-27T17:09:49.055950193Z" level=info msg="ignoring event" container=91d2a8dba98c3df6cc4712f2bef8029f8c83847db033390f5df303b85f4b4199 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 27 17:09:49 addons-393052 dockerd[1344]: time="2024-09-27T17:09:49.136491449Z" level=info msg="ignoring event" container=342b2733fd26d8707f29c513fdf40b744a0f1ae1e7cf3ffd1ba7485a81e7d45b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 27 17:09:49 addons-393052 dockerd[1344]: time="2024-09-27T17:09:49.190489749Z" level=info msg="ignoring event" container=f45968b2d02f7fcd0da3eccd9d29fe947b9f5a14b0ae563b7d3bbc13322c7dc6 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 27 17:09:49 addons-393052 cri-dockerd[1609]: time="2024-09-27T17:09:49Z" level=info msg="Failed to read pod IP from plugin/docker: networkPlugin cni failed on the status hook for pod \"registry-proxy-cf9vr_kube-system\": unexpected command output Device \"eth0\" does not exist.\n with error: exit status 1"
Sep 27 17:09:49 addons-393052 dockerd[1344]: time="2024-09-27T17:09:49.288000731Z" level=info msg="ignoring event" container=c4089cead8be201d3e2d774057c6600df66d2568d55f0d7fc1ca4a1dddfb134b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 27 17:09:49 addons-393052 dockerd[1344]: time="2024-09-27T17:09:49.403261359Z" level=info msg="ignoring event" container=3fda06aede0b46bf947277d57ccc98192f550ec54b931b83488c5f2f65b585cf module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
f3538ff923f82 a416a98b71e22 33 seconds ago Exited helper-pod 0 17b86ec4146e8 helper-pod-delete-pvc-cc992d79-9229-48dc-815e-b7a98bf6633a
ee87bd227804c kicbase/echo-server@sha256:127ac38a2bb9537b7f252addff209ea6801edcac8a92c8b1104dacd66a583ed6 35 seconds ago Running hello-world-app 0 10edbd02a7330 hello-world-app-55bf9c44b4-x8wjr
4a511954341a2 busybox@sha256:c230832bd3b0be59a6c47ed64294f9ce71e91b327957920b6929a0caa8353140 37 seconds ago Exited busybox 0 e39f26fbd6f4b test-local-path
b17a8608d4003 nginx@sha256:a5127daff3d6f4606be3100a252419bfa84fd6ee5cd74d0feaca1a5068f97dcf 45 seconds ago Running nginx 0 43a65b5b32e5c nginx
47d53e37ec7bf gcr.io/k8s-minikube/gcp-auth-webhook@sha256:e6c5b3bc32072ea370d34c27836efd11b3519d25bd444c2a8efc339cff0e20fb 9 minutes ago Running gcp-auth 0 a8cfd940d0c8a gcp-auth-89d5ffd79-qp4qs
aa5e5ceb5c47e ce263a8653f9c 11 minutes ago Exited patch 1 f26c7788c7a0e ingress-nginx-admission-patch-vhjg5
7002251e6f76b registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a320a50cc91bd15fd2d6fa6de58bd98c1bd64b9a6f926ce23a600d87043455a3 11 minutes ago Exited create 0 b54fb94c99e76 ingress-nginx-admission-create-bcm94
342b2733fd26d gcr.io/k8s-minikube/kube-registry-proxy@sha256:b3fa0b2df8737fdb85ad5918a7e2652527463e357afff83a5e5bb966bcedc367 12 minutes ago Exited registry-proxy 0 c4089cead8be2 registry-proxy-cf9vr
783779b671a4c 6e38f40d628db 12 minutes ago Running storage-provisioner 0 994419f5d346e storage-provisioner
97c540f12f145 c69fa2e9cbf5f 12 minutes ago Running coredns 0 f8f3586a24f9c coredns-7c65d6cfc9-2pllc
2ff7b813ff0c7 60c005f310ff3 12 minutes ago Running kube-proxy 0 930ab502192ed kube-proxy-fs9gn
7c6cf29430b07 175ffd71cce3d 12 minutes ago Running kube-controller-manager 0 fe83f070b929a kube-controller-manager-addons-393052
6ca02db753a14 9aa1fad941575 12 minutes ago Running kube-scheduler 0 51a67bff8621c kube-scheduler-addons-393052
32e524c80312c 2e96e5913fc06 12 minutes ago Running etcd 0 f95ac3d87654c etcd-addons-393052
8f4723a6a0289 6bab7719df100 12 minutes ago Running kube-apiserver 0 fba0501039e47 kube-apiserver-addons-393052
==> coredns [97c540f12f14] <==
[INFO] 10.244.0.6:37957 - 47983 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000084231s
[INFO] 10.244.0.6:55787 - 55796 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000103443s
[INFO] 10.244.0.6:55787 - 49865 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000111324s
[INFO] 10.244.0.6:42194 - 16721 "A IN registry.kube-system.svc.cluster.local.europe-west1-b.c.k8s-minikube.internal. udp 95 false 512" NXDOMAIN qr,rd,ra 95 0.00557203s
[INFO] 10.244.0.6:42194 - 59477 "AAAA IN registry.kube-system.svc.cluster.local.europe-west1-b.c.k8s-minikube.internal. udp 95 false 512" NXDOMAIN qr,rd,ra 95 0.015169552s
[INFO] 10.244.0.6:58110 - 31067 "A IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 80 false 512" NXDOMAIN qr,rd,ra 80 0.00578708s
[INFO] 10.244.0.6:58110 - 16222 "AAAA IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 80 false 512" NXDOMAIN qr,rd,ra 80 0.005821147s
[INFO] 10.244.0.6:54101 - 8224 "AAAA IN registry.kube-system.svc.cluster.local.google.internal. udp 72 false 512" NXDOMAIN qr,rd,ra 72 0.004553998s
[INFO] 10.244.0.6:54101 - 34085 "A IN registry.kube-system.svc.cluster.local.google.internal. udp 72 false 512" NXDOMAIN qr,rd,ra 72 0.007810302s
[INFO] 10.244.0.6:55758 - 60775 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000081597s
[INFO] 10.244.0.6:55758 - 64098 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000125633s
[INFO] 10.244.0.25:60826 - 40330 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000284383s
[INFO] 10.244.0.25:43903 - 53131 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000373676s
[INFO] 10.244.0.25:44982 - 29691 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000137853s
[INFO] 10.244.0.25:42193 - 23660 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000127464s
[INFO] 10.244.0.25:59553 - 13661 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000148985s
[INFO] 10.244.0.25:40546 - 22460 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000185457s
[INFO] 10.244.0.25:45269 - 51940 "AAAA IN storage.googleapis.com.europe-west1-b.c.k8s-minikube.internal. udp 90 false 1232" NXDOMAIN qr,rd,ra 79 0.007819436s
[INFO] 10.244.0.25:41351 - 17596 "A IN storage.googleapis.com.europe-west1-b.c.k8s-minikube.internal. udp 90 false 1232" NXDOMAIN qr,rd,ra 79 0.019590362s
[INFO] 10.244.0.25:56449 - 40231 "AAAA IN storage.googleapis.com.c.k8s-minikube.internal. udp 75 false 1232" NXDOMAIN qr,rd,ra 64 0.007552049s
[INFO] 10.244.0.25:41646 - 5879 "A IN storage.googleapis.com.c.k8s-minikube.internal. udp 75 false 1232" NXDOMAIN qr,rd,ra 64 0.010362641s
[INFO] 10.244.0.25:52636 - 16386 "A IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 56 0.005956758s
[INFO] 10.244.0.25:53653 - 10420 "AAAA IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 56 0.005993302s
[INFO] 10.244.0.25:39398 - 49603 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 140 0.001874088s
[INFO] 10.244.0.25:43953 - 58843 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 116 0.002876604s
==> describe nodes <==
Name: addons-393052
Roles: control-plane
Labels: beta.kubernetes.io/arch=amd64
beta.kubernetes.io/os=linux
kubernetes.io/arch=amd64
kubernetes.io/hostname=addons-393052
kubernetes.io/os=linux
minikube.k8s.io/commit=d0bb8598e36db8db200944ab6842cd553a7bd60c
minikube.k8s.io/name=addons-393052
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_27T16_57_03_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-393052
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Fri, 27 Sep 2024 16:56:59 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-393052
AcquireTime: <unset>
RenewTime: Fri, 27 Sep 2024 17:09:49 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Fri, 27 Sep 2024 17:09:37 +0000 Fri, 27 Sep 2024 16:56:58 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Fri, 27 Sep 2024 17:09:37 +0000 Fri, 27 Sep 2024 16:56:58 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Fri, 27 Sep 2024 17:09:37 +0000 Fri, 27 Sep 2024 16:56:58 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Fri, 27 Sep 2024 17:09:37 +0000 Fri, 27 Sep 2024 16:56:59 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-393052
Capacity:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32859300Ki
pods: 110
Allocatable:
cpu: 8
ephemeral-storage: 304681132Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: 32859300Ki
pods: 110
System Info:
Machine ID: 893d65f92a5545f0a1879ad7d6c0050e
System UUID: d51b6008-d8a7-4e90-ae57-414d55d89d7f
Boot ID: d796e8e3-3631-4921-b1b3-1be59ed34d92
Kernel Version: 5.15.0-1069-gcp
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: amd64
Container Runtime Version: docker://27.3.1
Kubelet Version: v1.31.1
Kube-Proxy Version: v1.31.1
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (12 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 9m14s
default hello-world-app-55bf9c44b4-x8wjr 0 (0%) 0 (0%) 0 (0%) 0 (0%) 39s
default nginx 0 (0%) 0 (0%) 0 (0%) 0 (0%) 50s
default registry-test 0 (0%) 0 (0%) 0 (0%) 0 (0%) 62s
gcp-auth gcp-auth-89d5ffd79-qp4qs 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
kube-system coredns-7c65d6cfc9-2pllc 100m (1%) 0 (0%) 70Mi (0%) 170Mi (0%) 12m
kube-system etcd-addons-393052 100m (1%) 0 (0%) 100Mi (0%) 0 (0%) 12m
kube-system kube-apiserver-addons-393052 250m (3%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-controller-manager-addons-393052 200m (2%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-proxy-fs9gn 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-scheduler-addons-393052 100m (1%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 750m (9%) 0 (0%)
memory 170Mi (0%) 170Mi (0%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 12m kube-proxy
Normal NodeHasSufficientMemory 12m (x8 over 12m) kubelet Node addons-393052 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 12m (x7 over 12m) kubelet Node addons-393052 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 12m (x7 over 12m) kubelet Node addons-393052 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 12m kubelet Updated Node Allocatable limit across pods
Normal Starting 12m kubelet Starting kubelet.
Warning CgroupV1 12m kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 12m kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 12m kubelet Node addons-393052 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 12m kubelet Node addons-393052 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 12m kubelet Node addons-393052 status is now: NodeHasSufficientPID
Normal RegisteredNode 12m node-controller Node addons-393052 event: Registered Node addons-393052 in Controller
==> dmesg <==
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff e6 02 58 eb 32 6b 08 06
[ +2.148428] IPv4: martian source 10.244.0.1 from 10.244.0.16, on dev eth0
[ +0.000007] ll header: 00000000: ff ff ff ff ff ff ce 5e fe b3 41 46 08 06
[ +2.534558] IPv4: martian source 10.244.0.1 from 10.244.0.17, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff d2 62 e2 05 4d 6c 08 06
[ +5.206146] IPv4: martian source 10.244.0.1 from 10.244.0.20, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 5e 1e 0f a5 cb 45 08 06
[ +0.404038] IPv4: martian source 10.244.0.1 from 10.244.0.18, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 82 70 bf 89 ef b2 08 06
[ +0.140512] IPv4: martian source 10.244.0.1 from 10.244.0.19, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff ee 4e 7d a1 b0 ee 08 06
[ +12.054665] IPv4: martian source 10.244.0.1 from 10.244.0.21, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 9e c4 9c 55 09 9c 08 06
[ +1.067379] IPv4: martian source 10.244.0.1 from 10.244.0.22, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff 52 7d b5 62 1c ab 08 06
[Sep27 16:59] IPv4: martian source 10.244.0.1 from 10.244.0.23, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff ba 78 a0 91 2b 49 08 06
[ +0.056258] IPv4: martian source 10.244.0.1 from 10.244.0.24, on dev eth0
[ +0.000006] ll header: 00000000: ff ff ff ff ff ff fe 9d ae 94 83 a7 08 06
[ +26.945604] IPv4: martian source 10.244.0.1 from 10.244.0.25, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 3e e1 e3 f2 1f 66 08 06
[ +0.000405] IPv4: martian source 10.244.0.25 from 10.244.0.3, on dev eth0
[ +0.000005] ll header: 00000000: ff ff ff ff ff ff 96 49 03 22 01 91 08 06
[Sep27 17:09] IPv4: martian source 10.244.0.32 from 10.244.0.21, on dev eth0
[ +0.000008] ll header: 00000000: ff ff ff ff ff ff 9e c4 9c 55 09 9c 08 06
==> etcd [32e524c80312] <==
{"level":"info","ts":"2024-09-27T16:56:58.537516Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-09-27T16:56:58.537539Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-09-27T16:56:58.537562Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-09-27T16:56:58.537575Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-27T16:56:58.537588Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-09-27T16:56:58.537601Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-27T16:56:58.538672Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-393052 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-09-27T16:56:58.538704Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-27T16:56:58.538721Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-27T16:56:58.538866Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-09-27T16:56:58.538890Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-09-27T16:56:58.538908Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-27T16:56:58.539580Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-27T16:56:58.539742Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-27T16:56:58.539778Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-27T16:56:58.539869Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-27T16:56:58.539869Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-27T16:56:58.540938Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-09-27T16:56:58.540998Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-09-27T16:57:10.733111Z","caller":"traceutil/trace.go:171","msg":"trace[1242585742] transaction","detail":"{read_only:false; response_revision:439; number_of_response:1; }","duration":"100.685066ms","start":"2024-09-27T16:57:10.632412Z","end":"2024-09-27T16:57:10.733097Z","steps":["trace[1242585742] 'compare' (duration: 86.586576ms)"],"step_count":1}
{"level":"info","ts":"2024-09-27T16:57:10.733371Z","caller":"traceutil/trace.go:171","msg":"trace[345707985] transaction","detail":"{read_only:false; response_revision:440; number_of_response:1; }","duration":"100.79666ms","start":"2024-09-27T16:57:10.632562Z","end":"2024-09-27T16:57:10.733359Z","steps":["trace[345707985] 'process raft request' (duration: 100.251005ms)"],"step_count":1}
{"level":"info","ts":"2024-09-27T16:57:23.649091Z","caller":"traceutil/trace.go:171","msg":"trace[1863905615] transaction","detail":"{read_only:false; response_revision:974; number_of_response:1; }","duration":"112.056281ms","start":"2024-09-27T16:57:23.537014Z","end":"2024-09-27T16:57:23.649070Z","steps":["trace[1863905615] 'process raft request' (duration: 111.946672ms)"],"step_count":1}
{"level":"info","ts":"2024-09-27T17:06:58.559219Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1845}
{"level":"info","ts":"2024-09-27T17:06:58.583867Z","caller":"mvcc/kvstore_compaction.go:69","msg":"finished scheduled compaction","compact-revision":1845,"took":"24.084832ms","hash":1144207730,"current-db-size-bytes":8867840,"current-db-size":"8.9 MB","current-db-size-in-use-bytes":4755456,"current-db-size-in-use":"4.8 MB"}
{"level":"info","ts":"2024-09-27T17:06:58.583916Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":1144207730,"revision":1845,"compact-revision":-1}
==> gcp-auth [47d53e37ec7b] <==
2024/09/27 17:00:36 Ready to write response ...
2024/09/27 17:00:36 Ready to marshal response ...
2024/09/27 17:00:36 Ready to write response ...
2024/09/27 17:08:38 Ready to marshal response ...
2024/09/27 17:08:38 Ready to write response ...
2024/09/27 17:08:39 Ready to marshal response ...
2024/09/27 17:08:39 Ready to write response ...
2024/09/27 17:08:39 Ready to marshal response ...
2024/09/27 17:08:39 Ready to write response ...
2024/09/27 17:08:39 Ready to marshal response ...
2024/09/27 17:08:39 Ready to write response ...
2024/09/27 17:08:48 Ready to marshal response ...
2024/09/27 17:08:48 Ready to write response ...
2024/09/27 17:09:00 Ready to marshal response ...
2024/09/27 17:09:00 Ready to write response ...
2024/09/27 17:09:05 Ready to marshal response ...
2024/09/27 17:09:05 Ready to write response ...
2024/09/27 17:09:05 Ready to marshal response ...
2024/09/27 17:09:05 Ready to write response ...
2024/09/27 17:09:09 Ready to marshal response ...
2024/09/27 17:09:09 Ready to write response ...
2024/09/27 17:09:11 Ready to marshal response ...
2024/09/27 17:09:11 Ready to write response ...
2024/09/27 17:09:15 Ready to marshal response ...
2024/09/27 17:09:15 Ready to write response ...
==> kernel <==
17:09:50 up 52 min, 0 users, load average: 1.12, 0.62, 0.38
Linux addons-393052 5.15.0-1069-gcp #77~20.04.1-Ubuntu SMP Sun Sep 1 19:39:16 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kube-apiserver [8f4723a6a028] <==
W0927 17:00:27.357907 1 cacher.go:171] Terminating all watchers from cacher jobs.batch.volcano.sh
W0927 17:00:27.744450 1 cacher.go:171] Terminating all watchers from cacher jobflows.flow.volcano.sh
W0927 17:00:28.033688 1 cacher.go:171] Terminating all watchers from cacher jobtemplates.flow.volcano.sh
I0927 17:08:39.006966 1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs={"IPv4":"10.97.233.170"}
I0927 17:08:51.464064 1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Nothing (removed from the queue).
I0927 17:08:51.729976 1 controller.go:615] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
I0927 17:09:00.095389 1 handler.go:286] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
I0927 17:09:00.348897 1 controller.go:615] quota admission added evaluator for: ingresses.networking.k8s.io
I0927 17:09:00.533292 1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.98.128.181"}
W0927 17:09:01.135986 1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io
I0927 17:09:12.037429 1 alloc.go:330] "allocated clusterIPs" service="default/hello-world-app" clusterIPs={"IPv4":"10.102.88.205"}
I0927 17:09:24.776406 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0927 17:09:24.776460 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0927 17:09:24.789012 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0927 17:09:24.789067 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0927 17:09:24.791799 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0927 17:09:24.791885 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0927 17:09:24.800771 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0927 17:09:24.800820 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0927 17:09:24.833416 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0927 17:09:24.833459 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
W0927 17:09:25.792374 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
W0927 17:09:25.834334 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
W0927 17:09:25.842159 1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
E0927 17:09:32.007514 1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"
==> kube-controller-manager [7c6cf29430b0] <==
E0927 17:09:32.038994 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0927 17:09:33.234279 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0927 17:09:33.234318 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0927 17:09:33.673893 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0927 17:09:33.673933 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0927 17:09:35.105999 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0927 17:09:35.106043 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0927 17:09:36.019734 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0927 17:09:36.019776 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0927 17:09:37.129085 1 shared_informer.go:313] Waiting for caches to sync for resource quota
I0927 17:09:37.129136 1 shared_informer.go:320] Caches are synced for resource quota
I0927 17:09:37.324360 1 shared_informer.go:313] Waiting for caches to sync for garbage collector
I0927 17:09:37.324398 1 shared_informer.go:320] Caches are synced for garbage collector
I0927 17:09:37.973403 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-393052"
W0927 17:09:39.972121 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0927 17:09:39.972161 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0927 17:09:42.652784 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0927 17:09:42.652825 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0927 17:09:44.429084 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0927 17:09:44.429128 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0927 17:09:44.845352 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0927 17:09:44.845399 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0927 17:09:46.486199 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0927 17:09:46.486240 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0927 17:09:49.019326 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/registry-66c9cd494c" duration="5.655µs"
==> kube-proxy [2ff7b813ff0c] <==
I0927 16:57:07.663693 1 server_linux.go:66] "Using iptables proxy"
I0927 16:57:07.834500 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0927 16:57:07.834578 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0927 16:57:08.124120 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0927 16:57:08.124203 1 server_linux.go:169] "Using iptables Proxier"
I0927 16:57:08.132649 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0927 16:57:08.133133 1 server.go:483] "Version info" version="v1.31.1"
I0927 16:57:08.133166 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0927 16:57:08.134599 1 config.go:199] "Starting service config controller"
I0927 16:57:08.136598 1 shared_informer.go:313] Waiting for caches to sync for service config
I0927 16:57:08.134829 1 config.go:105] "Starting endpoint slice config controller"
I0927 16:57:08.136629 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0927 16:57:08.135486 1 config.go:328] "Starting node config controller"
I0927 16:57:08.136640 1 shared_informer.go:313] Waiting for caches to sync for node config
I0927 16:57:08.237655 1 shared_informer.go:320] Caches are synced for node config
I0927 16:57:08.237715 1 shared_informer.go:320] Caches are synced for service config
I0927 16:57:08.237753 1 shared_informer.go:320] Caches are synced for endpoint slice config
==> kube-scheduler [6ca02db753a1] <==
W0927 16:56:59.843660 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0927 16:56:59.844600 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0927 16:56:59.843744 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0927 16:56:59.844647 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0927 16:56:59.843765 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0927 16:56:59.844719 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0927 16:56:59.844114 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0927 16:56:59.844744 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0927 16:56:59.844901 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0927 16:56:59.844924 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0927 16:57:00.652306 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
E0927 16:57:00.652348 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0927 16:57:00.708740 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0927 16:57:00.708789 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0927 16:57:00.780314 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0927 16:57:00.780354 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0927 16:57:00.809747 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
E0927 16:57:00.809783 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User \"system:kube-scheduler\" cannot list resource \"namespaces\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0927 16:57:00.815164 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
E0927 16:57:00.815203 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicationcontrollers\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0927 16:57:00.877170 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0927 16:57:00.877206 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0927 16:57:00.912403 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0927 16:57:00.912446 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
I0927 16:57:01.438615 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 27 17:09:46 addons-393052 kubelet[2447]: I0927 17:09:46.953518 2447 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5386c6b-5f15-44cb-b4e3-8d3201b1abf5-config-volume\") pod \"a5386c6b-5f15-44cb-b4e3-8d3201b1abf5\" (UID: \"a5386c6b-5f15-44cb-b4e3-8d3201b1abf5\") "
Sep 27 17:09:46 addons-393052 kubelet[2447]: I0927 17:09:46.953572 2447 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdcw9\" (UniqueName: \"kubernetes.io/projected/a5386c6b-5f15-44cb-b4e3-8d3201b1abf5-kube-api-access-qdcw9\") pod \"a5386c6b-5f15-44cb-b4e3-8d3201b1abf5\" (UID: \"a5386c6b-5f15-44cb-b4e3-8d3201b1abf5\") "
Sep 27 17:09:46 addons-393052 kubelet[2447]: I0927 17:09:46.954024 2447 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5386c6b-5f15-44cb-b4e3-8d3201b1abf5-config-volume" (OuterVolumeSpecName: "config-volume") pod "a5386c6b-5f15-44cb-b4e3-8d3201b1abf5" (UID: "a5386c6b-5f15-44cb-b4e3-8d3201b1abf5"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/configmap", VolumeGidValue ""
Sep 27 17:09:46 addons-393052 kubelet[2447]: I0927 17:09:46.955668 2447 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5386c6b-5f15-44cb-b4e3-8d3201b1abf5-kube-api-access-qdcw9" (OuterVolumeSpecName: "kube-api-access-qdcw9") pod "a5386c6b-5f15-44cb-b4e3-8d3201b1abf5" (UID: "a5386c6b-5f15-44cb-b4e3-8d3201b1abf5"). InnerVolumeSpecName "kube-api-access-qdcw9". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 27 17:09:47 addons-393052 kubelet[2447]: I0927 17:09:47.054109 2447 reconciler_common.go:288] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a5386c6b-5f15-44cb-b4e3-8d3201b1abf5-config-volume\") on node \"addons-393052\" DevicePath \"\""
Sep 27 17:09:47 addons-393052 kubelet[2447]: I0927 17:09:47.054147 2447 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-qdcw9\" (UniqueName: \"kubernetes.io/projected/a5386c6b-5f15-44cb-b4e3-8d3201b1abf5-kube-api-access-qdcw9\") on node \"addons-393052\" DevicePath \"\""
Sep 27 17:09:47 addons-393052 kubelet[2447]: I0927 17:09:47.158001 2447 scope.go:117] "RemoveContainer" containerID="c6114842bb9eb3db024e6f85fa983e680a2bed97c4637ad13c35ad7c576bb71a"
Sep 27 17:09:47 addons-393052 kubelet[2447]: I0927 17:09:47.172057 2447 scope.go:117] "RemoveContainer" containerID="c6114842bb9eb3db024e6f85fa983e680a2bed97c4637ad13c35ad7c576bb71a"
Sep 27 17:09:47 addons-393052 kubelet[2447]: E0927 17:09:47.172760 2447 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: c6114842bb9eb3db024e6f85fa983e680a2bed97c4637ad13c35ad7c576bb71a" containerID="c6114842bb9eb3db024e6f85fa983e680a2bed97c4637ad13c35ad7c576bb71a"
Sep 27 17:09:47 addons-393052 kubelet[2447]: I0927 17:09:47.172804 2447 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"c6114842bb9eb3db024e6f85fa983e680a2bed97c4637ad13c35ad7c576bb71a"} err="failed to get container status \"c6114842bb9eb3db024e6f85fa983e680a2bed97c4637ad13c35ad7c576bb71a\": rpc error: code = Unknown desc = Error response from daemon: No such container: c6114842bb9eb3db024e6f85fa983e680a2bed97c4637ad13c35ad7c576bb71a"
Sep 27 17:09:48 addons-393052 kubelet[2447]: E0927 17:09:48.250350 2447 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"registry-test\" with ImagePullBackOff: \"Back-off pulling image \\\"gcr.io/k8s-minikube/busybox\\\"\"" pod="default/registry-test" podUID="a80c82cd-062b-4949-be24-1278338d230e"
Sep 27 17:09:48 addons-393052 kubelet[2447]: I0927 17:09:48.257242 2447 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5386c6b-5f15-44cb-b4e3-8d3201b1abf5" path="/var/lib/kubelet/pods/a5386c6b-5f15-44cb-b4e3-8d3201b1abf5/volumes"
Sep 27 17:09:49 addons-393052 kubelet[2447]: I0927 17:09:49.231128 2447 scope.go:117] "RemoveContainer" containerID="91d2a8dba98c3df6cc4712f2bef8029f8c83847db033390f5df303b85f4b4199"
Sep 27 17:09:49 addons-393052 kubelet[2447]: I0927 17:09:49.367631 2447 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7n9hf\" (UniqueName: \"kubernetes.io/projected/a2abbccc-9f95-4a37-8198-40d424cdcb00-kube-api-access-7n9hf\") pod \"a2abbccc-9f95-4a37-8198-40d424cdcb00\" (UID: \"a2abbccc-9f95-4a37-8198-40d424cdcb00\") "
Sep 27 17:09:49 addons-393052 kubelet[2447]: I0927 17:09:49.367706 2447 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbkhp\" (UniqueName: \"kubernetes.io/projected/c6fffe66-001f-45ee-9860-645249413bc6-kube-api-access-nbkhp\") pod \"c6fffe66-001f-45ee-9860-645249413bc6\" (UID: \"c6fffe66-001f-45ee-9860-645249413bc6\") "
Sep 27 17:09:49 addons-393052 kubelet[2447]: I0927 17:09:49.369806 2447 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6fffe66-001f-45ee-9860-645249413bc6-kube-api-access-nbkhp" (OuterVolumeSpecName: "kube-api-access-nbkhp") pod "c6fffe66-001f-45ee-9860-645249413bc6" (UID: "c6fffe66-001f-45ee-9860-645249413bc6"). InnerVolumeSpecName "kube-api-access-nbkhp". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 27 17:09:49 addons-393052 kubelet[2447]: I0927 17:09:49.369929 2447 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2abbccc-9f95-4a37-8198-40d424cdcb00-kube-api-access-7n9hf" (OuterVolumeSpecName: "kube-api-access-7n9hf") pod "a2abbccc-9f95-4a37-8198-40d424cdcb00" (UID: "a2abbccc-9f95-4a37-8198-40d424cdcb00"). InnerVolumeSpecName "kube-api-access-7n9hf". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 27 17:09:49 addons-393052 kubelet[2447]: I0927 17:09:49.468881 2447 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-7n9hf\" (UniqueName: \"kubernetes.io/projected/a2abbccc-9f95-4a37-8198-40d424cdcb00-kube-api-access-7n9hf\") on node \"addons-393052\" DevicePath \"\""
Sep 27 17:09:49 addons-393052 kubelet[2447]: I0927 17:09:49.468926 2447 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-nbkhp\" (UniqueName: \"kubernetes.io/projected/c6fffe66-001f-45ee-9860-645249413bc6-kube-api-access-nbkhp\") on node \"addons-393052\" DevicePath \"\""
Sep 27 17:09:49 addons-393052 kubelet[2447]: I0927 17:09:49.569112 2447 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs75p\" (UniqueName: \"kubernetes.io/projected/a80c82cd-062b-4949-be24-1278338d230e-kube-api-access-xs75p\") pod \"a80c82cd-062b-4949-be24-1278338d230e\" (UID: \"a80c82cd-062b-4949-be24-1278338d230e\") "
Sep 27 17:09:49 addons-393052 kubelet[2447]: I0927 17:09:49.569182 2447 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/a80c82cd-062b-4949-be24-1278338d230e-gcp-creds\") pod \"a80c82cd-062b-4949-be24-1278338d230e\" (UID: \"a80c82cd-062b-4949-be24-1278338d230e\") "
Sep 27 17:09:49 addons-393052 kubelet[2447]: I0927 17:09:49.569260 2447 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a80c82cd-062b-4949-be24-1278338d230e-gcp-creds" (OuterVolumeSpecName: "gcp-creds") pod "a80c82cd-062b-4949-be24-1278338d230e" (UID: "a80c82cd-062b-4949-be24-1278338d230e"). InnerVolumeSpecName "gcp-creds". PluginName "kubernetes.io/host-path", VolumeGidValue ""
Sep 27 17:09:49 addons-393052 kubelet[2447]: I0927 17:09:49.571132 2447 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a80c82cd-062b-4949-be24-1278338d230e-kube-api-access-xs75p" (OuterVolumeSpecName: "kube-api-access-xs75p") pod "a80c82cd-062b-4949-be24-1278338d230e" (UID: "a80c82cd-062b-4949-be24-1278338d230e"). InnerVolumeSpecName "kube-api-access-xs75p". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 27 17:09:49 addons-393052 kubelet[2447]: I0927 17:09:49.669781 2447 reconciler_common.go:288] "Volume detached for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/a80c82cd-062b-4949-be24-1278338d230e-gcp-creds\") on node \"addons-393052\" DevicePath \"\""
Sep 27 17:09:49 addons-393052 kubelet[2447]: I0927 17:09:49.669820 2447 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-xs75p\" (UniqueName: \"kubernetes.io/projected/a80c82cd-062b-4949-be24-1278338d230e-kube-api-access-xs75p\") on node \"addons-393052\" DevicePath \"\""
==> storage-provisioner [783779b671a4] <==
I0927 16:57:15.728067 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0927 16:57:15.738047 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0927 16:57:15.738120 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0927 16:57:15.824378 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0927 16:57:15.824586 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-393052_6654f9a2-2973-4da9-b0ff-91f9d5a80b29!
I0927 16:57:15.825900 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"05f36fab-27f5-42f8-aa33-9498d870561f", APIVersion:"v1", ResourceVersion:"626", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-393052_6654f9a2-2973-4da9-b0ff-91f9d5a80b29 became leader
I0927 16:57:15.934899 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-393052_6654f9a2-2973-4da9-b0ff-91f9d5a80b29!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-amd64 status --format={{.APIServer}} -p addons-393052 -n addons-393052
helpers_test.go:261: (dbg) Run: kubectl --context addons-393052 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: busybox
helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Registry]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-393052 describe pod busybox
helpers_test.go:282: (dbg) kubectl --context addons-393052 describe pod busybox:
-- stdout --
Name: busybox
Namespace: default
Priority: 0
Service Account: default
Node: addons-393052/192.168.49.2
Start Time: Fri, 27 Sep 2024 17:00:36 +0000
Labels: integration-test=busybox
Annotations: <none>
Status: Pending
IP: 10.244.0.28
IPs:
IP: 10.244.0.28
Containers:
busybox:
Container ID:
Image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
Image ID:
Port: <none>
Host Port: <none>
Command:
sleep
3600
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-sdrx2 (ro)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
kube-api-access-sdrx2:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 9m14s default-scheduler Successfully assigned default/busybox to addons-393052
Normal SandboxChanged 9m13s kubelet Pod sandbox changed, it will be killed and re-created.
Warning Failed 7m54s (x6 over 9m13s) kubelet Error: ImagePullBackOff
Normal Pulling 7m41s (x4 over 9m14s) kubelet Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
Warning Failed 7m41s (x4 over 9m14s) kubelet Failed to pull image "gcr.io/k8s-minikube/busybox:1.28.4-glibc": Error response from daemon: Head "https://gcr.io/v2/k8s-minikube/busybox/manifests/1.28.4-glibc": unauthorized: authentication failed
Warning Failed 7m41s (x4 over 9m14s) kubelet Error: ErrImagePull
Normal BackOff 4m13s (x21 over 9m13s) kubelet Back-off pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
-- /stdout --
helpers_test.go:285: <<< TestAddons/parallel/Registry FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestAddons/parallel/Registry (72.45s)