=== RUN TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry
=== CONT TestAddons/parallel/Registry
addons_test.go:332: registry stabilized in 3.114446ms
addons_test.go:334: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-66c9cd494c-696bs" [7aa69fd1-c981-411c-bdd9-00cacd8b1736] Running
addons_test.go:334: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.003713001s
addons_test.go:337: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-sgv4q" [a5a96a3a-0fec-4005-b778-df5a7261b085] Running
addons_test.go:337: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.004181314s
addons_test.go:342: (dbg) Run: kubectl --context addons-467916 delete po -l run=registry-test --now
addons_test.go:347: (dbg) Run: kubectl --context addons-467916 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:347: (dbg) Non-zero exit: kubectl --context addons-467916 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": exit status 1 (1m0.114966046s)
-- stdout --
pod "registry-test" deleted
-- /stdout --
** stderr **
error: timed out waiting for the condition
** /stderr **
addons_test.go:349: failed to hit registry.kube-system.svc.cluster.local. args "kubectl --context addons-467916 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c \"wget --spider -S http://registry.kube-system.svc.cluster.local\"" failed: exit status 1
addons_test.go:353: expected curl response be "HTTP/1.1 200", but got *pod "registry-test" deleted
*
addons_test.go:361: (dbg) Run: out/minikube-linux-arm64 -p addons-467916 ip
2024/09/13 23:40:17 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:390: (dbg) Run: out/minikube-linux-arm64 -p addons-467916 addons disable registry --alsologtostderr -v=1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/parallel/Registry]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-467916
helpers_test.go:235: (dbg) docker inspect addons-467916:
-- stdout --
[
{
"Id": "3e46c205fd9fdf9936595f6805f92ef284ae2b2eb199ae5ba7bc069101ccb7ee",
"Created": "2024-09-13T23:27:04.116129171Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 8789,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-13T23:27:04.30290694Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:fe3365929e6ce54b4c06f0bc3d1500dff08f535844ef4978f2c45cd67c542134",
"ResolvConfPath": "/var/lib/docker/containers/3e46c205fd9fdf9936595f6805f92ef284ae2b2eb199ae5ba7bc069101ccb7ee/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/3e46c205fd9fdf9936595f6805f92ef284ae2b2eb199ae5ba7bc069101ccb7ee/hostname",
"HostsPath": "/var/lib/docker/containers/3e46c205fd9fdf9936595f6805f92ef284ae2b2eb199ae5ba7bc069101ccb7ee/hosts",
"LogPath": "/var/lib/docker/containers/3e46c205fd9fdf9936595f6805f92ef284ae2b2eb199ae5ba7bc069101ccb7ee/3e46c205fd9fdf9936595f6805f92ef284ae2b2eb199ae5ba7bc069101ccb7ee-json.log",
"Name": "/addons-467916",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/lib/modules:/lib/modules:ro",
"addons-467916:/var"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-467916",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/47ee68dcf8229ccc0c2a9065adf5a1c7211d5ae7bae61b2ec57b78a1d00ef3cd-init/diff:/var/lib/docker/overlay2/3914b9ea48552f1ad87d259f6b4331a4fff9b014ba19c452962370626d811e7e/diff",
"MergedDir": "/var/lib/docker/overlay2/47ee68dcf8229ccc0c2a9065adf5a1c7211d5ae7bae61b2ec57b78a1d00ef3cd/merged",
"UpperDir": "/var/lib/docker/overlay2/47ee68dcf8229ccc0c2a9065adf5a1c7211d5ae7bae61b2ec57b78a1d00ef3cd/diff",
"WorkDir": "/var/lib/docker/overlay2/47ee68dcf8229ccc0c2a9065adf5a1c7211d5ae7bae61b2ec57b78a1d00ef3cd/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "addons-467916",
"Source": "/var/lib/docker/volumes/addons-467916/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "addons-467916",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-467916",
"name.minikube.sigs.k8s.io": "addons-467916",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "d668f685b149ec02541db5d470038ced85653ac9194d9fce6a340eea8781e419",
"SandboxKey": "/var/run/docker/netns/d668f685b149",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32768"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32769"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32772"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32770"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "32771"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-467916": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "1afd9de1c82fe6aec8833cf8738e974d4695724c6955f908d7f7be812ec356b6",
"EndpointID": "d97d337eb2d7924858814dabd7febf98883653e3928a467469f8513eca34baf7",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-467916",
"3e46c205fd9f"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-467916 -n addons-467916
helpers_test.go:244: <<< TestAddons/parallel/Registry FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/parallel/Registry]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-467916 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-467916 logs -n 25: (1.263189832s)
helpers_test.go:252: TestAddons/parallel/Registry logs:
-- stdout --
==> Audit <==
|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-385391 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | |
| | -p download-only-385391 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=docker | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | 13 Sep 24 23:26 UTC |
| delete | -p download-only-385391 | download-only-385391 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | 13 Sep 24 23:26 UTC |
| start | -o=json --download-only | download-only-915155 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | |
| | -p download-only-915155 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| | --container-runtime=docker | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | 13 Sep 24 23:26 UTC |
| delete | -p download-only-915155 | download-only-915155 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | 13 Sep 24 23:26 UTC |
| delete | -p download-only-385391 | download-only-385391 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | 13 Sep 24 23:26 UTC |
| delete | -p download-only-915155 | download-only-915155 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | 13 Sep 24 23:26 UTC |
| start | --download-only -p | download-docker-757156 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | |
| | download-docker-757156 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| delete | -p download-docker-757156 | download-docker-757156 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | 13 Sep 24 23:26 UTC |
| start | --download-only -p | binary-mirror-598186 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | |
| | binary-mirror-598186 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:36811 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| delete | -p binary-mirror-598186 | binary-mirror-598186 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | 13 Sep 24 23:26 UTC |
| addons | disable dashboard -p | addons-467916 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | |
| | addons-467916 | | | | | |
| addons | enable dashboard -p | addons-467916 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | |
| | addons-467916 | | | | | |
| start | -p addons-467916 --wait=true | addons-467916 | jenkins | v1.34.0 | 13 Sep 24 23:26 UTC | 13 Sep 24 23:30 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
| addons | addons-467916 addons disable | addons-467916 | jenkins | v1.34.0 | 13 Sep 24 23:30 UTC | 13 Sep 24 23:31 UTC |
| | volcano --alsologtostderr -v=1 | | | | | |
| addons | addons-467916 addons disable | addons-467916 | jenkins | v1.34.0 | 13 Sep 24 23:39 UTC | 13 Sep 24 23:39 UTC |
| | yakd --alsologtostderr -v=1 | | | | | |
| addons | disable nvidia-device-plugin | addons-467916 | jenkins | v1.34.0 | 13 Sep 24 23:39 UTC | 13 Sep 24 23:39 UTC |
| | -p addons-467916 | | | | | |
| ssh | addons-467916 ssh cat | addons-467916 | jenkins | v1.34.0 | 13 Sep 24 23:39 UTC | 13 Sep 24 23:39 UTC |
| | /opt/local-path-provisioner/pvc-57a7b523-7db8-4825-ad64-698dbbbd6c68_default_test-pvc/file1 | | | | | |
| addons | addons-467916 addons disable | addons-467916 | jenkins | v1.34.0 | 13 Sep 24 23:39 UTC | |
| | storage-provisioner-rancher | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| ip | addons-467916 ip | addons-467916 | jenkins | v1.34.0 | 13 Sep 24 23:40 UTC | 13 Sep 24 23:40 UTC |
| addons | addons-467916 addons disable | addons-467916 | jenkins | v1.34.0 | 13 Sep 24 23:40 UTC | 13 Sep 24 23:40 UTC |
| | registry --alsologtostderr | | | | | |
| | -v=1 | | | | | |
|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/13 23:26:39
Running on machine: ip-172-31-30-239
Binary: Built with gc go1.23.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0913 23:26:39.577701 8290 out.go:345] Setting OutFile to fd 1 ...
I0913 23:26:39.577894 8290 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0913 23:26:39.577912 8290 out.go:358] Setting ErrFile to fd 2...
I0913 23:26:39.577937 8290 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0913 23:26:39.578310 8290 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19640-2224/.minikube/bin
I0913 23:26:39.578910 8290 out.go:352] Setting JSON to false
I0913 23:26:39.579742 8290 start.go:129] hostinfo: {"hostname":"ip-172-31-30-239","uptime":547,"bootTime":1726269452,"procs":146,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1069-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"92f46a7d-c249-4c12-924a-77f64874c910"}
I0913 23:26:39.579843 8290 start.go:139] virtualization:
I0913 23:26:39.583146 8290 out.go:177] * [addons-467916] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0913 23:26:39.586117 8290 out.go:177] - MINIKUBE_LOCATION=19640
I0913 23:26:39.586169 8290 notify.go:220] Checking for updates...
I0913 23:26:39.591437 8290 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0913 23:26:39.593791 8290 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19640-2224/kubeconfig
I0913 23:26:39.596783 8290 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19640-2224/.minikube
I0913 23:26:39.599059 8290 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0913 23:26:39.601531 8290 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0913 23:26:39.604094 8290 driver.go:394] Setting default libvirt URI to qemu:///system
I0913 23:26:39.635910 8290 docker.go:123] docker version: linux-27.2.1:Docker Engine - Community
I0913 23:26:39.636048 8290 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0913 23:26:39.695645 8290 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-13 23:26:39.686432056 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1069-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214827008 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.2.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0913 23:26:39.695752 8290 docker.go:318] overlay module found
I0913 23:26:39.699557 8290 out.go:177] * Using the docker driver based on user configuration
I0913 23:26:39.701375 8290 start.go:297] selected driver: docker
I0913 23:26:39.701394 8290 start.go:901] validating driver "docker" against <nil>
I0913 23:26:39.701409 8290 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0913 23:26:39.702039 8290 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0913 23:26:39.755309 8290 info.go:266] docker info: {ID:6ZPO:QZND:VNGE:LUKL:4Y3K:XELL:AAX4:2GTK:E6LM:MPRN:3ZXR:TTMR Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-13 23:26:39.745739903 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1069-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aar
ch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214827008 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-30-239 Labels:[] ExperimentalBuild:false ServerVersion:27.2.1 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErro
rs:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.16.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.2]] Warnings:<nil>}}
I0913 23:26:39.755528 8290 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0913 23:26:39.755775 8290 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0913 23:26:39.757923 8290 out.go:177] * Using Docker driver with root privileges
I0913 23:26:39.760147 8290 cni.go:84] Creating CNI manager for ""
I0913 23:26:39.760227 8290 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0913 23:26:39.760242 8290 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0913 23:26:39.760410 8290 start.go:340] cluster config:
{Name:addons-467916 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-467916 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock:
SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0913 23:26:39.762534 8290 out.go:177] * Starting "addons-467916" primary control-plane node in "addons-467916" cluster
I0913 23:26:39.764555 8290 cache.go:121] Beginning downloading kic base image for docker with docker
I0913 23:26:39.766328 8290 out.go:177] * Pulling base image v0.0.45-1726243947-19640 ...
I0913 23:26:39.768386 8290 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker
I0913 23:26:39.768437 8290 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19640-2224/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4
I0913 23:26:39.768448 8290 cache.go:56] Caching tarball of preloaded images
I0913 23:26:39.768484 8290 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 in local docker daemon
I0913 23:26:39.768541 8290 preload.go:172] Found /home/jenkins/minikube-integration/19640-2224/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download
I0913 23:26:39.768552 8290 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker
I0913 23:26:39.768903 8290 profile.go:143] Saving config to /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/config.json ...
I0913 23:26:39.768931 8290 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/config.json: {Name:mk04149802514247e0a4c072b53e2179beee3eef Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:26:39.783909 8290 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 to local cache
I0913 23:26:39.784032 8290 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 in local cache directory
I0913 23:26:39.784056 8290 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 in local cache directory, skipping pull
I0913 23:26:39.784062 8290 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 exists in cache, skipping pull
I0913 23:26:39.784069 8290 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 as a tarball
I0913 23:26:39.784078 8290 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 from local cache
I0913 23:26:57.054717 8290 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 from cached tarball
I0913 23:26:57.054758 8290 cache.go:194] Successfully downloaded all kic artifacts
I0913 23:26:57.054788 8290 start.go:360] acquireMachinesLock for addons-467916: {Name:mk5ad12b981cfbd5c2639bc0eec7dbb61e9fe6ac Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0913 23:26:57.054927 8290 start.go:364] duration metric: took 106.387µs to acquireMachinesLock for "addons-467916"
I0913 23:26:57.054958 8290 start.go:93] Provisioning new machine with config: &{Name:addons-467916 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-467916 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cust
omQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0913 23:26:57.055043 8290 start.go:125] createHost starting for "" (driver="docker")
I0913 23:26:57.057453 8290 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0913 23:26:57.057702 8290 start.go:159] libmachine.API.Create for "addons-467916" (driver="docker")
I0913 23:26:57.057742 8290 client.go:168] LocalClient.Create starting
I0913 23:26:57.057886 8290 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19640-2224/.minikube/certs/ca.pem
I0913 23:26:57.273905 8290 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19640-2224/.minikube/certs/cert.pem
I0913 23:26:57.594714 8290 cli_runner.go:164] Run: docker network inspect addons-467916 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0913 23:26:57.610530 8290 cli_runner.go:211] docker network inspect addons-467916 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0913 23:26:57.610629 8290 network_create.go:284] running [docker network inspect addons-467916] to gather additional debugging logs...
I0913 23:26:57.610647 8290 cli_runner.go:164] Run: docker network inspect addons-467916
W0913 23:26:57.626440 8290 cli_runner.go:211] docker network inspect addons-467916 returned with exit code 1
I0913 23:26:57.626470 8290 network_create.go:287] error running [docker network inspect addons-467916]: docker network inspect addons-467916: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-467916 not found
I0913 23:26:57.626483 8290 network_create.go:289] output of [docker network inspect addons-467916]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-467916 not found
** /stderr **
I0913 23:26:57.626591 8290 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0913 23:26:57.642366 8290 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001ac60f0}
I0913 23:26:57.642419 8290 network_create.go:124] attempt to create docker network addons-467916 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0913 23:26:57.642493 8290 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-467916 addons-467916
I0913 23:26:57.716159 8290 network_create.go:108] docker network addons-467916 192.168.49.0/24 created
I0913 23:26:57.716201 8290 kic.go:121] calculated static IP "192.168.49.2" for the "addons-467916" container
I0913 23:26:57.716315 8290 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0913 23:26:57.731375 8290 cli_runner.go:164] Run: docker volume create addons-467916 --label name.minikube.sigs.k8s.io=addons-467916 --label created_by.minikube.sigs.k8s.io=true
I0913 23:26:57.748703 8290 oci.go:103] Successfully created a docker volume addons-467916
I0913 23:26:57.748792 8290 cli_runner.go:164] Run: docker run --rm --name addons-467916-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-467916 --entrypoint /usr/bin/test -v addons-467916:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 -d /var/lib
I0913 23:26:59.952003 8290 cli_runner.go:217] Completed: docker run --rm --name addons-467916-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-467916 --entrypoint /usr/bin/test -v addons-467916:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 -d /var/lib: (2.203166333s)
I0913 23:26:59.952030 8290 oci.go:107] Successfully prepared a docker volume addons-467916
I0913 23:26:59.952071 8290 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker
I0913 23:26:59.952090 8290 kic.go:194] Starting extracting preloaded images to volume ...
I0913 23:26:59.952153 8290 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19640-2224/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-467916:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 -I lz4 -xf /preloaded.tar -C /extractDir
I0913 23:27:04.033539 8290 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19640-2224/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-467916:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 -I lz4 -xf /preloaded.tar -C /extractDir: (4.081336528s)
I0913 23:27:04.033575 8290 kic.go:203] duration metric: took 4.081480519s to extract preloaded images to volume ...
W0913 23:27:04.033728 8290 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0913 23:27:04.033851 8290 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0913 23:27:04.101608 8290 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-467916 --name addons-467916 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-467916 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-467916 --network addons-467916 --ip 192.168.49.2 --volume addons-467916:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243
I0913 23:27:04.472068 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Running}}
I0913 23:27:04.492723 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:04.514098 8290 cli_runner.go:164] Run: docker exec addons-467916 stat /var/lib/dpkg/alternatives/iptables
I0913 23:27:04.588593 8290 oci.go:144] the created container "addons-467916" has a running status.
I0913 23:27:04.588623 8290 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa...
I0913 23:27:05.902224 8290 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0913 23:27:05.921213 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:05.936789 8290 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0913 23:27:05.936815 8290 kic_runner.go:114] Args: [docker exec --privileged addons-467916 chown docker:docker /home/docker/.ssh/authorized_keys]
I0913 23:27:05.991015 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:06.025942 8290 machine.go:93] provisionDockerMachine start ...
I0913 23:27:06.026044 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:06.043849 8290 main.go:141] libmachine: Using SSH client type: native
I0913 23:27:06.044129 8290 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x41abe0] 0x41d420 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0913 23:27:06.044148 8290 main.go:141] libmachine: About to run SSH command:
hostname
I0913 23:27:06.163944 8290 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-467916
I0913 23:27:06.163969 8290 ubuntu.go:169] provisioning hostname "addons-467916"
I0913 23:27:06.164031 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:06.181336 8290 main.go:141] libmachine: Using SSH client type: native
I0913 23:27:06.181582 8290 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x41abe0] 0x41d420 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0913 23:27:06.181600 8290 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-467916 && echo "addons-467916" | sudo tee /etc/hostname
I0913 23:27:06.315760 8290 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-467916
I0913 23:27:06.315839 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:06.333635 8290 main.go:141] libmachine: Using SSH client type: native
I0913 23:27:06.333889 8290 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x41abe0] 0x41d420 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0913 23:27:06.333912 8290 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-467916' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-467916/g' /etc/hosts;
else
echo '127.0.1.1 addons-467916' | sudo tee -a /etc/hosts;
fi
fi
I0913 23:27:06.452438 8290 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0913 23:27:06.452467 8290 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19640-2224/.minikube CaCertPath:/home/jenkins/minikube-integration/19640-2224/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19640-2224/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19640-2224/.minikube}
I0913 23:27:06.452498 8290 ubuntu.go:177] setting up certificates
I0913 23:27:06.452509 8290 provision.go:84] configureAuth start
I0913 23:27:06.452572 8290 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-467916
I0913 23:27:06.469718 8290 provision.go:143] copyHostCerts
I0913 23:27:06.469801 8290 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19640-2224/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19640-2224/.minikube/key.pem (1679 bytes)
I0913 23:27:06.469928 8290 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19640-2224/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19640-2224/.minikube/ca.pem (1082 bytes)
I0913 23:27:06.469993 8290 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19640-2224/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19640-2224/.minikube/cert.pem (1123 bytes)
I0913 23:27:06.470045 8290 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19640-2224/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19640-2224/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19640-2224/.minikube/certs/ca-key.pem org=jenkins.addons-467916 san=[127.0.0.1 192.168.49.2 addons-467916 localhost minikube]
I0913 23:27:07.304409 8290 provision.go:177] copyRemoteCerts
I0913 23:27:07.304473 8290 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0913 23:27:07.304522 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:07.320622 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:07.408812 8290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-2224/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
I0913 23:27:07.432584 8290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-2224/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0913 23:27:07.456076 8290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-2224/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0913 23:27:07.479287 8290 provision.go:87] duration metric: took 1.026752193s to configureAuth
I0913 23:27:07.479309 8290 ubuntu.go:193] setting minikube options for container-runtime
I0913 23:27:07.479493 8290 config.go:182] Loaded profile config "addons-467916": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.1
I0913 23:27:07.479559 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:07.495849 8290 main.go:141] libmachine: Using SSH client type: native
I0913 23:27:07.496093 8290 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x41abe0] 0x41d420 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0913 23:27:07.496107 8290 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0913 23:27:07.616432 8290 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0913 23:27:07.616451 8290 ubuntu.go:71] root file system type: overlay
I0913 23:27:07.616571 8290 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I0913 23:27:07.616640 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:07.633127 8290 main.go:141] libmachine: Using SSH client type: native
I0913 23:27:07.633439 8290 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x41abe0] 0x41d420 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0913 23:27:07.633529 8290 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0913 23:27:07.763478 8290 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0913 23:27:07.763569 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:07.780828 8290 main.go:141] libmachine: Using SSH client type: native
I0913 23:27:07.781069 8290 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x41abe0] 0x41d420 <nil> [] 0s} 127.0.0.1 32768 <nil> <nil>}
I0913 23:27:07.781086 8290 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0913 23:27:08.537114 8290 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2024-09-06 12:06:36.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2024-09-13 23:27:07.756597931 +0000
@@ -1,46 +1,49 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
-Wants=network-online.target containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
+Wants=network-online.target
Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutStartSec=0
-RestartSec=2
-Restart=always
+Restart=on-failure
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
+LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0913 23:27:08.537151 8290 machine.go:96] duration metric: took 2.511184289s to provisionDockerMachine
I0913 23:27:08.537163 8290 client.go:171] duration metric: took 11.479410389s to LocalClient.Create
I0913 23:27:08.537175 8290 start.go:167] duration metric: took 11.479473552s to libmachine.API.Create "addons-467916"
I0913 23:27:08.537187 8290 start.go:293] postStartSetup for "addons-467916" (driver="docker")
I0913 23:27:08.537197 8290 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0913 23:27:08.537264 8290 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0913 23:27:08.537306 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:08.554478 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:08.645199 8290 ssh_runner.go:195] Run: cat /etc/os-release
I0913 23:27:08.648356 8290 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0913 23:27:08.648401 8290 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0913 23:27:08.648414 8290 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0913 23:27:08.648424 8290 info.go:137] Remote host: Ubuntu 22.04.4 LTS
I0913 23:27:08.648437 8290 filesync.go:126] Scanning /home/jenkins/minikube-integration/19640-2224/.minikube/addons for local assets ...
I0913 23:27:08.648503 8290 filesync.go:126] Scanning /home/jenkins/minikube-integration/19640-2224/.minikube/files for local assets ...
I0913 23:27:08.648527 8290 start.go:296] duration metric: took 111.334592ms for postStartSetup
I0913 23:27:08.648835 8290 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-467916
I0913 23:27:08.665794 8290 profile.go:143] Saving config to /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/config.json ...
I0913 23:27:08.666084 8290 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0913 23:27:08.666139 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:08.682974 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:08.768782 8290 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0913 23:27:08.773074 8290 start.go:128] duration metric: took 11.718015545s to createHost
I0913 23:27:08.773097 8290 start.go:83] releasing machines lock for "addons-467916", held for 11.718157s
I0913 23:27:08.773195 8290 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-467916
I0913 23:27:08.789224 8290 ssh_runner.go:195] Run: cat /version.json
I0913 23:27:08.789274 8290 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0913 23:27:08.789354 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:08.789280 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:08.806526 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:08.816743 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:08.899621 8290 ssh_runner.go:195] Run: systemctl --version
I0913 23:27:09.035483 8290 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0913 23:27:09.040040 8290 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0913 23:27:09.065645 8290 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0913 23:27:09.065783 8290 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0913 23:27:09.095765 8290 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0913 23:27:09.095791 8290 start.go:495] detecting cgroup driver to use...
I0913 23:27:09.095824 8290 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0913 23:27:09.095929 8290 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0913 23:27:09.112003 8290 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0913 23:27:09.122540 8290 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0913 23:27:09.132264 8290 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0913 23:27:09.132389 8290 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0913 23:27:09.142755 8290 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0913 23:27:09.153155 8290 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0913 23:27:09.163223 8290 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0913 23:27:09.173089 8290 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0913 23:27:09.182761 8290 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0913 23:27:09.192632 8290 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0913 23:27:09.202345 8290 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0913 23:27:09.212681 8290 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0913 23:27:09.221159 8290 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0913 23:27:09.229652 8290 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0913 23:27:09.309485 8290 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0913 23:27:09.408877 8290 start.go:495] detecting cgroup driver to use...
I0913 23:27:09.408923 8290 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0913 23:27:09.408977 8290 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0913 23:27:09.422917 8290 cruntime.go:279] skipping containerd shutdown because we are bound to it
I0913 23:27:09.422984 8290 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0913 23:27:09.435329 8290 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0913 23:27:09.454174 8290 ssh_runner.go:195] Run: which cri-dockerd
I0913 23:27:09.458214 8290 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0913 23:27:09.469169 8290 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)
I0913 23:27:09.490144 8290 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0913 23:27:09.597464 8290 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0913 23:27:09.689195 8290 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0913 23:27:09.689346 8290 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0913 23:27:09.709582 8290 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0913 23:27:09.807979 8290 ssh_runner.go:195] Run: sudo systemctl restart docker
I0913 23:27:10.115668 8290 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
I0913 23:27:10.128742 8290 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0913 23:27:10.141686 8290 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I0913 23:27:10.228646 8290 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0913 23:27:10.326328 8290 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0913 23:27:10.414181 8290 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I0913 23:27:10.429596 8290 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0913 23:27:10.441352 8290 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0913 23:27:10.531405 8290 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
I0913 23:27:10.609864 8290 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock
I0913 23:27:10.610051 8290 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I0913 23:27:10.615269 8290 start.go:563] Will wait 60s for crictl version
I0913 23:27:10.615445 8290 ssh_runner.go:195] Run: which crictl
I0913 23:27:10.619765 8290 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0913 23:27:10.657458 8290 start.go:579] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 27.2.1
RuntimeApiVersion: v1
I0913 23:27:10.657541 8290 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0913 23:27:10.681378 8290 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0913 23:27:10.707658 8290 out.go:235] * Preparing Kubernetes v1.31.1 on Docker 27.2.1 ...
I0913 23:27:10.707820 8290 cli_runner.go:164] Run: docker network inspect addons-467916 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0913 23:27:10.725569 8290 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0913 23:27:10.729528 8290 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0913 23:27:10.740560 8290 kubeadm.go:883] updating cluster {Name:addons-467916 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-467916 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuF
irmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0913 23:27:10.740676 8290 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker
I0913 23:27:10.740729 8290 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0913 23:27:10.759116 8290 docker.go:685] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.31.1
registry.k8s.io/kube-scheduler:v1.31.1
registry.k8s.io/kube-controller-manager:v1.31.1
registry.k8s.io/kube-proxy:v1.31.1
registry.k8s.io/coredns/coredns:v1.11.3
registry.k8s.io/etcd:3.5.15-0
registry.k8s.io/pause:3.10
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0913 23:27:10.759136 8290 docker.go:615] Images already preloaded, skipping extraction
I0913 23:27:10.759197 8290 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0913 23:27:10.776482 8290 docker.go:685] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.31.1
registry.k8s.io/kube-controller-manager:v1.31.1
registry.k8s.io/kube-scheduler:v1.31.1
registry.k8s.io/kube-proxy:v1.31.1
registry.k8s.io/coredns/coredns:v1.11.3
registry.k8s.io/etcd:3.5.15-0
registry.k8s.io/pause:3.10
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0913 23:27:10.776506 8290 cache_images.go:84] Images are preloaded, skipping loading
I0913 23:27:10.776515 8290 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.1 docker true true} ...
I0913 23:27:10.776610 8290 kubeadm.go:946] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-467916 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:addons-467916 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0913 23:27:10.776678 8290 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0913 23:27:10.821874 8290 cni.go:84] Creating CNI manager for ""
I0913 23:27:10.821898 8290 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0913 23:27:10.821908 8290 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0913 23:27:10.821927 8290 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-467916 NodeName:addons-467916 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuber
netes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0913 23:27:10.822074 8290 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/cri-dockerd.sock
name: "addons-467916"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0913 23:27:10.822145 8290 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I0913 23:27:10.831044 8290 binaries.go:44] Found k8s binaries, skipping transfer
I0913 23:27:10.831110 8290 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0913 23:27:10.839884 8290 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (312 bytes)
I0913 23:27:10.858089 8290 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0913 23:27:10.876064 8290 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2155 bytes)
I0913 23:27:10.895420 8290 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0913 23:27:10.898725 8290 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0913 23:27:10.909860 8290 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0913 23:27:11.002206 8290 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0913 23:27:11.018917 8290 certs.go:68] Setting up /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916 for IP: 192.168.49.2
I0913 23:27:11.018942 8290 certs.go:194] generating shared ca certs ...
I0913 23:27:11.018958 8290 certs.go:226] acquiring lock for ca certs: {Name:mke6c9de844bb9fc9b4944cb0ab16376aa09d478 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:11.019091 8290 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19640-2224/.minikube/ca.key
I0913 23:27:11.322382 8290 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19640-2224/.minikube/ca.crt ...
I0913 23:27:11.322414 8290 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-2224/.minikube/ca.crt: {Name:mk46c833877310472e94b4a49705826b23ed2b0a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:11.322616 8290 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19640-2224/.minikube/ca.key ...
I0913 23:27:11.322630 8290 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-2224/.minikube/ca.key: {Name:mk385278f95ba86b734588deabd10759857dd2d9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:11.322723 8290 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19640-2224/.minikube/proxy-client-ca.key
I0913 23:27:11.636113 8290 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19640-2224/.minikube/proxy-client-ca.crt ...
I0913 23:27:11.636144 8290 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-2224/.minikube/proxy-client-ca.crt: {Name:mkf7a697d6d5f4cfbfbd712ad76d0f10bc98cf0a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:11.636341 8290 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19640-2224/.minikube/proxy-client-ca.key ...
I0913 23:27:11.636355 8290 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-2224/.minikube/proxy-client-ca.key: {Name:mk29b2c582910936b929af0689dde79db4f28a5f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:11.636441 8290 certs.go:256] generating profile certs ...
I0913 23:27:11.636536 8290 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/client.key
I0913 23:27:11.636564 8290 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/client.crt with IP's: []
I0913 23:27:12.170490 8290 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/client.crt ...
I0913 23:27:12.170522 8290 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/client.crt: {Name:mka3cac971e055918c946fa5a3e7d77ada67330a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:12.170742 8290 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/client.key ...
I0913 23:27:12.170755 8290 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/client.key: {Name:mk15c3fa72a3141637a77c84cf468fba4621e57d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:12.170838 8290 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/apiserver.key.ee110447
I0913 23:27:12.170861 8290 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/apiserver.crt.ee110447 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0913 23:27:12.389799 8290 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/apiserver.crt.ee110447 ...
I0913 23:27:12.389829 8290 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/apiserver.crt.ee110447: {Name:mk4124a31d6970143e80a930c1148659c7179b2c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:12.390003 8290 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/apiserver.key.ee110447 ...
I0913 23:27:12.390018 8290 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/apiserver.key.ee110447: {Name:mk846e1c22a4e5922e9d08f5162d8f8865de342d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:12.390105 8290 certs.go:381] copying /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/apiserver.crt.ee110447 -> /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/apiserver.crt
I0913 23:27:12.390188 8290 certs.go:385] copying /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/apiserver.key.ee110447 -> /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/apiserver.key
I0913 23:27:12.390247 8290 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/proxy-client.key
I0913 23:27:12.390266 8290 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/proxy-client.crt with IP's: []
I0913 23:27:12.662509 8290 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/proxy-client.crt ...
I0913 23:27:12.662538 8290 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/proxy-client.crt: {Name:mkc0458b0b97db08c69fd3b979d0d6b6338ae757 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:12.662698 8290 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/proxy-client.key ...
I0913 23:27:12.662712 8290 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/proxy-client.key: {Name:mk8c38fbbd0735c6f51650a63095bfcbaab44887 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:12.662884 8290 certs.go:484] found cert: /home/jenkins/minikube-integration/19640-2224/.minikube/certs/ca-key.pem (1679 bytes)
I0913 23:27:12.662926 8290 certs.go:484] found cert: /home/jenkins/minikube-integration/19640-2224/.minikube/certs/ca.pem (1082 bytes)
I0913 23:27:12.662957 8290 certs.go:484] found cert: /home/jenkins/minikube-integration/19640-2224/.minikube/certs/cert.pem (1123 bytes)
I0913 23:27:12.662986 8290 certs.go:484] found cert: /home/jenkins/minikube-integration/19640-2224/.minikube/certs/key.pem (1679 bytes)
I0913 23:27:12.663574 8290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-2224/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0913 23:27:12.689111 8290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-2224/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)
I0913 23:27:12.712935 8290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-2224/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0913 23:27:12.737071 8290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-2224/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)
I0913 23:27:12.761156 8290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0913 23:27:12.785686 8290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0913 23:27:12.808516 8290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0913 23:27:12.831646 8290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-2224/.minikube/profiles/addons-467916/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0913 23:27:12.855623 8290 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19640-2224/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0913 23:27:12.879806 8290 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0913 23:27:12.897405 8290 ssh_runner.go:195] Run: openssl version
I0913 23:27:12.902743 8290 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0913 23:27:12.911980 8290 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0913 23:27:12.915298 8290 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 13 23:27 /usr/share/ca-certificates/minikubeCA.pem
I0913 23:27:12.915408 8290 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0913 23:27:12.922217 8290 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0913 23:27:12.931232 8290 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0913 23:27:12.934527 8290 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0913 23:27:12.934572 8290 kubeadm.go:392] StartCluster: {Name:addons-467916 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726243947-19640@sha256:bb1287c9c0ec51ba7d8272f0f8073d6e9758ad79ff87c787fdce1c3513743243 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-467916 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirm
warePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0913 23:27:12.934745 8290 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0913 23:27:12.952155 8290 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0913 23:27:12.961003 8290 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0913 23:27:12.969686 8290 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0913 23:27:12.969776 8290 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0913 23:27:12.978781 8290 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0913 23:27:12.978802 8290 kubeadm.go:157] found existing configuration files:
I0913 23:27:12.978853 8290 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0913 23:27:12.987480 8290 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0913 23:27:12.987558 8290 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0913 23:27:12.996140 8290 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0913 23:27:13.006914 8290 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0913 23:27:13.006985 8290 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0913 23:27:13.017016 8290 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0913 23:27:13.026980 8290 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0913 23:27:13.027098 8290 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0913 23:27:13.035693 8290 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0913 23:27:13.044581 8290 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0913 23:27:13.044696 8290 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0913 23:27:13.053396 8290 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0913 23:27:13.099172 8290 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1
I0913 23:27:13.099513 8290 kubeadm.go:310] [preflight] Running pre-flight checks
I0913 23:27:13.122115 8290 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0913 23:27:13.122189 8290 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1069-aws[0m
I0913 23:27:13.122232 8290 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0913 23:27:13.122285 8290 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0913 23:27:13.122338 8290 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0913 23:27:13.122387 8290 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0913 23:27:13.122439 8290 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0913 23:27:13.122492 8290 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0913 23:27:13.122543 8290 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0913 23:27:13.122592 8290 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0913 23:27:13.122643 8290 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0913 23:27:13.122693 8290 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0913 23:27:13.185441 8290 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0913 23:27:13.185552 8290 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0913 23:27:13.185682 8290 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0913 23:27:13.197089 8290 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0913 23:27:13.201743 8290 out.go:235] - Generating certificates and keys ...
I0913 23:27:13.201923 8290 kubeadm.go:310] [certs] Using existing ca certificate authority
I0913 23:27:13.202018 8290 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0913 23:27:14.524181 8290 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0913 23:27:14.832188 8290 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0913 23:27:15.428940 8290 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0913 23:27:16.231128 8290 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0913 23:27:16.576630 8290 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0913 23:27:16.576778 8290 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-467916 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0913 23:27:17.231345 8290 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0913 23:27:17.231508 8290 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-467916 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0913 23:27:18.063218 8290 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0913 23:27:18.508888 8290 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0913 23:27:18.817793 8290 kubeadm.go:310] [certs] Generating "sa" key and public key
I0913 23:27:18.818053 8290 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0913 23:27:19.383649 8290 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0913 23:27:20.631687 8290 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0913 23:27:21.014276 8290 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0913 23:27:22.516190 8290 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0913 23:27:22.706009 8290 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0913 23:27:22.706742 8290 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0913 23:27:22.709899 8290 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0913 23:27:22.712880 8290 out.go:235] - Booting up control plane ...
I0913 23:27:22.712989 8290 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0913 23:27:22.713065 8290 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0913 23:27:22.713537 8290 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0913 23:27:22.724149 8290 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0913 23:27:22.730590 8290 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0913 23:27:22.730643 8290 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0913 23:27:22.840871 8290 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0913 23:27:22.840990 8290 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0913 23:27:24.338586 8290 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.500799391s
I0913 23:27:24.338674 8290 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0913 23:27:30.839681 8290 kubeadm.go:310] [api-check] The API server is healthy after 6.501077284s
I0913 23:27:30.860677 8290 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0913 23:27:30.879205 8290 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0913 23:27:30.904955 8290 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0913 23:27:30.905344 8290 kubeadm.go:310] [mark-control-plane] Marking the node addons-467916 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0913 23:27:30.916650 8290 kubeadm.go:310] [bootstrap-token] Using token: ns0d5k.dszbfz5xhw6jyb83
I0913 23:27:30.918780 8290 out.go:235] - Configuring RBAC rules ...
I0913 23:27:30.918908 8290 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0913 23:27:30.926893 8290 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0913 23:27:30.936857 8290 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0913 23:27:30.941065 8290 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0913 23:27:30.945468 8290 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0913 23:27:30.949722 8290 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0913 23:27:31.247305 8290 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0913 23:27:31.674618 8290 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0913 23:27:32.246386 8290 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0913 23:27:32.247448 8290 kubeadm.go:310]
I0913 23:27:32.247522 8290 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0913 23:27:32.247536 8290 kubeadm.go:310]
I0913 23:27:32.247614 8290 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0913 23:27:32.247626 8290 kubeadm.go:310]
I0913 23:27:32.247651 8290 kubeadm.go:310] mkdir -p $HOME/.kube
I0913 23:27:32.247713 8290 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0913 23:27:32.247767 8290 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0913 23:27:32.247775 8290 kubeadm.go:310]
I0913 23:27:32.247830 8290 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0913 23:27:32.247838 8290 kubeadm.go:310]
I0913 23:27:32.247885 8290 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0913 23:27:32.247892 8290 kubeadm.go:310]
I0913 23:27:32.247944 8290 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0913 23:27:32.248021 8290 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0913 23:27:32.248091 8290 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0913 23:27:32.248100 8290 kubeadm.go:310]
I0913 23:27:32.248182 8290 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0913 23:27:32.248260 8290 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0913 23:27:32.248269 8290 kubeadm.go:310]
I0913 23:27:32.248375 8290 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token ns0d5k.dszbfz5xhw6jyb83 \
I0913 23:27:32.248480 8290 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:a02fafd37eb5697b39cc448a810e806b543dd44de2192168fd6cb8b8e596eb08 \
I0913 23:27:32.248504 8290 kubeadm.go:310] --control-plane
I0913 23:27:32.248512 8290 kubeadm.go:310]
I0913 23:27:32.248596 8290 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0913 23:27:32.248604 8290 kubeadm.go:310]
I0913 23:27:32.248684 8290 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token ns0d5k.dszbfz5xhw6jyb83 \
I0913 23:27:32.248788 8290 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:a02fafd37eb5697b39cc448a810e806b543dd44de2192168fd6cb8b8e596eb08
I0913 23:27:32.252582 8290 kubeadm.go:310] W0913 23:27:13.095124 1811 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0913 23:27:32.252879 8290 kubeadm.go:310] W0913 23:27:13.096608 1811 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0913 23:27:32.253091 8290 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1069-aws\n", err: exit status 1
I0913 23:27:32.253201 8290 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0913 23:27:32.253219 8290 cni.go:84] Creating CNI manager for ""
I0913 23:27:32.253237 8290 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0913 23:27:32.255979 8290 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0913 23:27:32.258118 8290 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0913 23:27:32.266923 8290 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
I0913 23:27:32.285436 8290 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0913 23:27:32.285561 8290 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:32.285634 8290 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-467916 minikube.k8s.io/updated_at=2024_09_13T23_27_32_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=7ca96ba7bd97af6e0063398921096f1cca785d18 minikube.k8s.io/name=addons-467916 minikube.k8s.io/primary=true
I0913 23:27:32.423604 8290 ops.go:34] apiserver oom_adj: -16
I0913 23:27:32.423690 8290 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:32.924386 8290 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:33.424531 8290 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:33.923837 8290 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:34.424469 8290 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:34.924539 8290 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:35.424556 8290 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:35.923963 8290 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0913 23:27:36.025741 8290 kubeadm.go:1113] duration metric: took 3.740225923s to wait for elevateKubeSystemPrivileges
I0913 23:27:36.025774 8290 kubeadm.go:394] duration metric: took 23.091206103s to StartCluster
I0913 23:27:36.025793 8290 settings.go:142] acquiring lock: {Name:mk4d87a2d88a9eb90d9feb46e3214fc54dd9b060 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:36.025931 8290 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19640-2224/kubeconfig
I0913 23:27:36.026373 8290 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19640-2224/kubeconfig: {Name:mk7508402d861ffa6f5702c641cc45695788b09a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0913 23:27:36.026612 8290 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0913 23:27:36.026718 8290 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0913 23:27:36.026983 8290 config.go:182] Loaded profile config "addons-467916": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.1
I0913 23:27:36.027030 8290 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0913 23:27:36.027107 8290 addons.go:69] Setting yakd=true in profile "addons-467916"
I0913 23:27:36.027124 8290 addons.go:234] Setting addon yakd=true in "addons-467916"
I0913 23:27:36.027151 8290 host.go:66] Checking if "addons-467916" exists ...
I0913 23:27:36.027719 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:36.028234 8290 addons.go:69] Setting cloud-spanner=true in profile "addons-467916"
I0913 23:27:36.028258 8290 addons.go:234] Setting addon cloud-spanner=true in "addons-467916"
I0913 23:27:36.028316 8290 host.go:66] Checking if "addons-467916" exists ...
I0913 23:27:36.028566 8290 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-467916"
I0913 23:27:36.028582 8290 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-467916"
I0913 23:27:36.028607 8290 host.go:66] Checking if "addons-467916" exists ...
I0913 23:27:36.028826 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:36.029039 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:36.031818 8290 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-467916"
I0913 23:27:36.031949 8290 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-467916"
I0913 23:27:36.032503 8290 host.go:66] Checking if "addons-467916" exists ...
I0913 23:27:36.035304 8290 addons.go:69] Setting default-storageclass=true in profile "addons-467916"
I0913 23:27:36.035401 8290 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-467916"
I0913 23:27:36.036141 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:36.032400 8290 addons.go:69] Setting registry=true in profile "addons-467916"
I0913 23:27:36.036695 8290 addons.go:234] Setting addon registry=true in "addons-467916"
I0913 23:27:36.036729 8290 host.go:66] Checking if "addons-467916" exists ...
I0913 23:27:36.036821 8290 addons.go:69] Setting gcp-auth=true in profile "addons-467916"
I0913 23:27:36.036846 8290 mustload.go:65] Loading cluster: addons-467916
I0913 23:27:36.037024 8290 config.go:182] Loaded profile config "addons-467916": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.1
I0913 23:27:36.037157 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:36.037326 8290 addons.go:69] Setting ingress=true in profile "addons-467916"
I0913 23:27:36.037345 8290 addons.go:234] Setting addon ingress=true in "addons-467916"
I0913 23:27:36.037376 8290 host.go:66] Checking if "addons-467916" exists ...
I0913 23:27:36.037791 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:36.032409 8290 addons.go:69] Setting storage-provisioner=true in profile "addons-467916"
I0913 23:27:36.046439 8290 addons.go:234] Setting addon storage-provisioner=true in "addons-467916"
I0913 23:27:36.046516 8290 host.go:66] Checking if "addons-467916" exists ...
I0913 23:27:36.046547 8290 out.go:177] * Verifying Kubernetes components...
I0913 23:27:36.047040 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:36.047945 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:36.056582 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:36.046439 8290 addons.go:69] Setting ingress-dns=true in profile "addons-467916"
I0913 23:27:36.062001 8290 addons.go:234] Setting addon ingress-dns=true in "addons-467916"
I0913 23:27:36.062071 8290 host.go:66] Checking if "addons-467916" exists ...
I0913 23:27:36.062588 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:36.032421 8290 addons.go:69] Setting volcano=true in profile "addons-467916"
I0913 23:27:36.072594 8290 addons.go:234] Setting addon volcano=true in "addons-467916"
I0913 23:27:36.072667 8290 host.go:66] Checking if "addons-467916" exists ...
I0913 23:27:36.073211 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:36.032424 8290 addons.go:69] Setting volumesnapshots=true in profile "addons-467916"
I0913 23:27:36.090107 8290 addons.go:234] Setting addon volumesnapshots=true in "addons-467916"
I0913 23:27:36.090166 8290 host.go:66] Checking if "addons-467916" exists ...
I0913 23:27:36.090683 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:36.046451 8290 addons.go:69] Setting inspektor-gadget=true in profile "addons-467916"
I0913 23:27:36.108663 8290 addons.go:234] Setting addon inspektor-gadget=true in "addons-467916"
I0913 23:27:36.108707 8290 host.go:66] Checking if "addons-467916" exists ...
I0913 23:27:36.109390 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:36.112637 8290 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0913 23:27:36.046456 8290 addons.go:69] Setting metrics-server=true in profile "addons-467916"
I0913 23:27:36.137545 8290 addons.go:234] Setting addon metrics-server=true in "addons-467916"
I0913 23:27:36.137586 8290 host.go:66] Checking if "addons-467916" exists ...
I0913 23:27:36.138062 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:36.032416 8290 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-467916"
I0913 23:27:36.162731 8290 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-467916"
I0913 23:27:36.163073 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:36.236258 8290 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0913 23:27:36.238882 8290 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0913 23:27:36.242083 8290 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0913 23:27:36.243856 8290 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0913 23:27:36.243996 8290 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0913 23:27:36.245953 8290 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.23
I0913 23:27:36.247866 8290 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0913 23:27:36.247885 8290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0913 23:27:36.247948 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:36.250347 8290 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0913 23:27:36.252733 8290 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0913 23:27:36.252794 8290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0913 23:27:36.252890 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:36.284262 8290 out.go:177] - Using image docker.io/registry:2.8.3
I0913 23:27:36.284443 8290 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0913 23:27:36.284458 8290 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0913 23:27:36.284543 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:36.285737 8290 host.go:66] Checking if "addons-467916" exists ...
I0913 23:27:36.308055 8290 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0913 23:27:36.308075 8290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0913 23:27:36.308137 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:36.335274 8290 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0913 23:27:36.335300 8290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0913 23:27:36.335354 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:36.339405 8290 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
I0913 23:27:36.340414 8290 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0913 23:27:36.344362 8290 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0913 23:27:36.344389 8290 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0913 23:27:36.344464 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:36.352248 8290 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0913 23:27:36.353565 8290 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0913 23:27:36.356429 8290 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0913 23:27:36.357213 8290 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0913 23:27:36.357293 8290 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0913 23:27:36.367203 8290 addons.go:234] Setting addon default-storageclass=true in "addons-467916"
I0913 23:27:36.397272 8290 host.go:66] Checking if "addons-467916" exists ...
I0913 23:27:36.397845 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:36.409319 8290 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0913 23:27:36.409745 8290 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0913 23:27:36.412538 8290 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0913 23:27:36.412556 8290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0913 23:27:36.412629 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:36.435411 8290 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0913 23:27:36.435486 8290 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0913 23:27:36.435599 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:36.383366 8290 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0913 23:27:36.452432 8290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0913 23:27:36.452462 8290 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0913 23:27:36.455463 8290 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0913 23:27:36.458214 8290 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0913 23:27:36.460476 8290 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0913 23:27:36.462734 8290 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0913 23:27:36.466483 8290 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0913 23:27:36.452508 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:36.473198 8290 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0913 23:27:36.473534 8290 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0913 23:27:36.473790 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:36.474671 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:36.476344 8290 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-467916"
I0913 23:27:36.476380 8290 host.go:66] Checking if "addons-467916" exists ...
I0913 23:27:36.476869 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:36.477116 8290 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0913 23:27:36.477126 8290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0913 23:27:36.477164 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:36.490447 8290 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0913 23:27:36.490470 8290 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0913 23:27:36.490544 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:36.490819 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:36.524524 8290 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0913 23:27:36.524546 8290 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0913 23:27:36.524620 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:36.525208 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:36.544968 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:36.570506 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:36.592515 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:36.596146 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:36.601719 8290 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0913 23:27:36.601740 8290 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0913 23:27:36.601812 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:36.640561 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:36.647304 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:36.673519 8290 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0913 23:27:36.684135 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:36.688726 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:36.689327 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:36.693474 8290 out.go:177] - Using image docker.io/busybox:stable
I0913 23:27:36.695038 8290 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0913 23:27:36.697461 8290 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0913 23:27:36.697483 8290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0913 23:27:36.697549 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:36.722990 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:37.195566 8290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0913 23:27:37.229982 8290 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0913 23:27:37.230064 8290 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0913 23:27:37.284506 8290 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0913 23:27:37.284584 8290 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0913 23:27:37.286844 8290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0913 23:27:37.297155 8290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0913 23:27:37.303921 8290 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0913 23:27:37.303998 8290 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0913 23:27:37.309922 8290 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0913 23:27:37.309998 8290 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0913 23:27:37.322799 8290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0913 23:27:37.406904 8290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0913 23:27:37.417585 8290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0913 23:27:37.474794 8290 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0913 23:27:37.474866 8290 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0913 23:27:37.483195 8290 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0913 23:27:37.483278 8290 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0913 23:27:37.547258 8290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0913 23:27:37.562665 8290 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0913 23:27:37.562756 8290 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0913 23:27:37.580409 8290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0913 23:27:37.629435 8290 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0913 23:27:37.629511 8290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0913 23:27:37.738742 8290 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0913 23:27:37.738823 8290 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0913 23:27:37.794670 8290 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0913 23:27:37.794741 8290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0913 23:27:37.988680 8290 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0913 23:27:37.988761 8290 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0913 23:27:38.029406 8290 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0913 23:27:38.029488 8290 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0913 23:27:38.124599 8290 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0913 23:27:38.124681 8290 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0913 23:27:38.173688 8290 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0913 23:27:38.173769 8290 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0913 23:27:38.237640 8290 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0913 23:27:38.237720 8290 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0913 23:27:38.260187 8290 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0913 23:27:38.260267 8290 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0913 23:27:38.270805 8290 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0913 23:27:38.270876 8290 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0913 23:27:38.297801 8290 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0913 23:27:38.297872 8290 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0913 23:27:38.302017 8290 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0913 23:27:38.302181 8290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0913 23:27:38.302308 8290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0913 23:27:38.379679 8290 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0913 23:27:38.379706 8290 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0913 23:27:38.406727 8290 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0913 23:27:38.406753 8290 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0913 23:27:38.431726 8290 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0913 23:27:38.431747 8290 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0913 23:27:38.442950 8290 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0913 23:27:38.443022 8290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0913 23:27:38.449401 8290 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0913 23:27:38.449478 8290 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0913 23:27:38.586357 8290 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0913 23:27:38.586429 8290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0913 23:27:38.610794 8290 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0913 23:27:38.610866 8290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0913 23:27:38.626914 8290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0913 23:27:38.700778 8290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0913 23:27:38.715851 8290 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0913 23:27:38.715923 8290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0913 23:27:38.727373 8290 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0913 23:27:38.727450 8290 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0913 23:27:38.794937 8290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0913 23:27:38.965800 8290 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0913 23:27:38.965879 8290 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0913 23:27:38.993702 8290 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0913 23:27:38.993780 8290 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0913 23:27:39.072109 8290 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0913 23:27:39.072182 8290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0913 23:27:39.272664 8290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0913 23:27:39.305655 8290 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.632100148s)
I0913 23:27:39.306490 8290 node_ready.go:35] waiting up to 6m0s for node "addons-467916" to be "Ready" ...
I0913 23:27:39.306749 8290 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.896977424s)
I0913 23:27:39.306787 8290 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0913 23:27:39.311285 8290 node_ready.go:49] node "addons-467916" has status "Ready":"True"
I0913 23:27:39.311361 8290 node_ready.go:38] duration metric: took 4.853325ms for node "addons-467916" to be "Ready" ...
I0913 23:27:39.311385 8290 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0913 23:27:39.324400 8290 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace to be "Ready" ...
I0913 23:27:39.324681 8290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0913 23:27:39.817551 8290 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-467916" context rescaled to 1 replicas
I0913 23:27:41.338073 8290 pod_ready.go:103] pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace has status "Ready":"False"
I0913 23:27:43.344439 8290 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0913 23:27:43.344546 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:43.370534 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:43.833625 8290 pod_ready.go:103] pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace has status "Ready":"False"
I0913 23:27:44.082573 8290 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0913 23:27:44.363869 8290 addons.go:234] Setting addon gcp-auth=true in "addons-467916"
I0913 23:27:44.363968 8290 host.go:66] Checking if "addons-467916" exists ...
I0913 23:27:44.364533 8290 cli_runner.go:164] Run: docker container inspect addons-467916 --format={{.State.Status}}
I0913 23:27:44.387876 8290 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0913 23:27:44.387927 8290 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-467916
I0913 23:27:44.409302 8290 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32768 SSHKeyPath:/home/jenkins/minikube-integration/19640-2224/.minikube/machines/addons-467916/id_rsa Username:docker}
I0913 23:27:46.334861 8290 pod_ready.go:103] pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace has status "Ready":"False"
I0913 23:27:46.823275 8290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (9.526043029s)
I0913 23:27:46.823229 8290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (9.536301642s)
I0913 23:27:46.824112 8290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (9.628470166s)
I0913 23:27:46.824178 8290 addons.go:475] Verifying addon ingress=true in "addons-467916"
I0913 23:27:46.827900 8290 out.go:177] * Verifying ingress addon...
I0913 23:27:46.831255 8290 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0913 23:27:46.843742 8290 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0913 23:27:46.843814 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:47.348006 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:47.900218 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:48.467560 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:48.505983 8290 pod_ready.go:103] pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace has status "Ready":"False"
I0913 23:27:48.856390 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:49.374547 8290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (12.051665892s)
I0913 23:27:49.374616 8290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (11.967650073s)
I0913 23:27:49.374677 8290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (11.957025849s)
I0913 23:27:49.374726 8290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (11.827391201s)
I0913 23:27:49.374773 8290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (11.79429732s)
I0913 23:27:49.374941 8290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (11.072591187s)
I0913 23:27:49.374960 8290 addons.go:475] Verifying addon registry=true in "addons-467916"
I0913 23:27:49.375242 8290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (10.748245963s)
I0913 23:27:49.375262 8290 addons.go:475] Verifying addon metrics-server=true in "addons-467916"
I0913 23:27:49.375306 8290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (10.674454104s)
I0913 23:27:49.375529 8290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (10.102781847s)
I0913 23:27:49.375439 8290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (10.580423515s)
W0913 23:27:49.375731 8290 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0913 23:27:49.375751 8290 retry.go:31] will retry after 158.990789ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0913 23:27:49.379120 8290 out.go:177] * Verifying registry addon...
I0913 23:27:49.379237 8290 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-467916 service yakd-dashboard -n yakd-dashboard
I0913 23:27:49.382960 8290 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0913 23:27:49.396746 8290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (10.072023753s)
I0913 23:27:49.396781 8290 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-467916"
I0913 23:27:49.397157 8290 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (5.009258116s)
I0913 23:27:49.399241 8290 out.go:177] * Verifying csi-hostpath-driver addon...
I0913 23:27:49.399376 8290 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0913 23:27:49.402518 8290 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0913 23:27:49.405441 8290 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0913 23:27:49.407877 8290 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0913 23:27:49.407904 8290 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0913 23:27:49.428464 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:49.470518 8290 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0913 23:27:49.470592 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:49.476704 8290 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0913 23:27:49.476776 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:49.483778 8290 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0913 23:27:49.483849 8290 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0913 23:27:49.535717 8290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0913 23:27:49.574193 8290 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0913 23:27:49.574222 8290 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0913 23:27:49.750965 8290 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0913 23:27:49.849721 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:49.887746 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:49.908028 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:50.335516 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:50.435430 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:50.437309 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:50.832924 8290 pod_ready.go:103] pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace has status "Ready":"False"
I0913 23:27:50.839540 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:50.938826 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:50.940218 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:51.335753 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:51.437972 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:51.439832 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:51.770629 8290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.2348147s)
I0913 23:27:51.770759 8290 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (2.019768615s)
I0913 23:27:51.774345 8290 addons.go:475] Verifying addon gcp-auth=true in "addons-467916"
I0913 23:27:51.777556 8290 out.go:177] * Verifying gcp-auth addon...
I0913 23:27:51.781726 8290 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0913 23:27:51.784851 8290 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0913 23:27:51.886813 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:51.887776 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:51.907754 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:52.335477 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:52.386857 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:52.407732 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:52.835088 8290 pod_ready.go:103] pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace has status "Ready":"False"
I0913 23:27:52.836645 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:52.886557 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:52.907462 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:53.336781 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:53.387889 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:53.408102 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:53.835378 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:53.887338 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:53.907594 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:54.386777 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:54.389003 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:54.487569 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:54.835411 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:54.886928 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:54.907976 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:55.331070 8290 pod_ready.go:103] pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace has status "Ready":"False"
I0913 23:27:55.336206 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:55.387102 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:55.408895 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:55.836263 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:55.887517 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:55.908812 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:56.335686 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:56.387070 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:56.407872 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:56.835897 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:56.886817 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:56.907556 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:57.332360 8290 pod_ready.go:103] pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace has status "Ready":"False"
I0913 23:27:57.336069 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:57.386543 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:57.407633 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:57.836028 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:57.886730 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:57.907239 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:58.335712 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:58.387573 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:58.407139 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:58.836018 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:58.889374 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:58.907104 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:59.332734 8290 pod_ready.go:103] pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace has status "Ready":"False"
I0913 23:27:59.336236 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:59.387621 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:59.407064 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:27:59.835706 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:27:59.887613 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:27:59.907190 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:00.357526 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:00.414219 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:00.426634 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:00.835460 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:00.887121 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:00.908556 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:01.335406 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:01.392547 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:01.408845 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:01.831550 8290 pod_ready.go:103] pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace has status "Ready":"False"
I0913 23:28:01.887244 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:01.888265 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:01.908763 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:02.335843 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:02.386437 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:02.413368 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:02.835534 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:02.887208 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:02.907975 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:03.335636 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:03.387310 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:03.409171 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:03.835854 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:03.887126 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:03.908462 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:04.330315 8290 pod_ready.go:103] pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace has status "Ready":"False"
I0913 23:28:04.336013 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:04.387265 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:04.408218 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:04.835029 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:04.886732 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:04.908064 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:05.389065 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:05.390010 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:05.407615 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:05.845741 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:05.898854 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:05.909470 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:06.340196 8290 pod_ready.go:103] pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace has status "Ready":"False"
I0913 23:28:06.390859 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:06.392732 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:06.408054 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:06.834846 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:06.887594 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:06.907127 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:07.336911 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:07.388105 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:07.408966 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:07.835737 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:07.887233 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:07.907518 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:08.334963 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:08.386262 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:08.408045 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:08.831119 8290 pod_ready.go:103] pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace has status "Ready":"False"
I0913 23:28:08.835356 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:08.890055 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:08.908412 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:09.335981 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:09.387343 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:09.408311 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:09.835592 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:09.887157 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:09.908804 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:10.336135 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:10.386750 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:10.407468 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:10.831549 8290 pod_ready.go:103] pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace has status "Ready":"False"
I0913 23:28:10.835116 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:10.887707 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0913 23:28:10.908910 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:11.382501 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:11.392410 8290 kapi.go:107] duration metric: took 22.00944668s to wait for kubernetes.io/minikube-addons=registry ...
I0913 23:28:11.408424 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:11.835066 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:11.907799 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:12.387791 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:12.408213 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:12.831990 8290 pod_ready.go:103] pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace has status "Ready":"False"
I0913 23:28:12.836383 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:12.908375 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:13.345176 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:13.411646 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:13.887772 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:13.908677 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:14.341672 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:14.407965 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:14.836524 8290 pod_ready.go:103] pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace has status "Ready":"False"
I0913 23:28:14.842337 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:14.907396 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:15.344250 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:15.407984 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:15.887835 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:15.908011 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:16.336347 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:16.408074 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:16.836262 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:16.907543 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:17.331536 8290 pod_ready.go:103] pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace has status "Ready":"False"
I0913 23:28:17.337940 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:17.408136 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:17.844035 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:17.915096 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:18.337971 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:18.407721 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:18.835867 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:18.907146 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:19.331114 8290 pod_ready.go:93] pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace has status "Ready":"True"
I0913 23:28:19.331186 8290 pod_ready.go:82] duration metric: took 40.006747537s for pod "coredns-7c65d6cfc9-7w5hb" in "kube-system" namespace to be "Ready" ...
I0913 23:28:19.331214 8290 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-zlw74" in "kube-system" namespace to be "Ready" ...
I0913 23:28:19.334013 8290 pod_ready.go:98] error getting pod "coredns-7c65d6cfc9-zlw74" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-zlw74" not found
I0913 23:28:19.334079 8290 pod_ready.go:82] duration metric: took 2.843697ms for pod "coredns-7c65d6cfc9-zlw74" in "kube-system" namespace to be "Ready" ...
E0913 23:28:19.334107 8290 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-7c65d6cfc9-zlw74" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-zlw74" not found
I0913 23:28:19.334128 8290 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-467916" in "kube-system" namespace to be "Ready" ...
I0913 23:28:19.340492 8290 pod_ready.go:93] pod "etcd-addons-467916" in "kube-system" namespace has status "Ready":"True"
I0913 23:28:19.340561 8290 pod_ready.go:82] duration metric: took 6.399859ms for pod "etcd-addons-467916" in "kube-system" namespace to be "Ready" ...
I0913 23:28:19.340587 8290 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-467916" in "kube-system" namespace to be "Ready" ...
I0913 23:28:19.345452 8290 pod_ready.go:93] pod "kube-apiserver-addons-467916" in "kube-system" namespace has status "Ready":"True"
I0913 23:28:19.345521 8290 pod_ready.go:82] duration metric: took 4.91326ms for pod "kube-apiserver-addons-467916" in "kube-system" namespace to be "Ready" ...
I0913 23:28:19.345548 8290 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-467916" in "kube-system" namespace to be "Ready" ...
I0913 23:28:19.353611 8290 pod_ready.go:93] pod "kube-controller-manager-addons-467916" in "kube-system" namespace has status "Ready":"True"
I0913 23:28:19.353673 8290 pod_ready.go:82] duration metric: took 8.102687ms for pod "kube-controller-manager-addons-467916" in "kube-system" namespace to be "Ready" ...
I0913 23:28:19.353699 8290 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-hgw86" in "kube-system" namespace to be "Ready" ...
I0913 23:28:19.387601 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:19.407410 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:19.528848 8290 pod_ready.go:93] pod "kube-proxy-hgw86" in "kube-system" namespace has status "Ready":"True"
I0913 23:28:19.528915 8290 pod_ready.go:82] duration metric: took 175.194207ms for pod "kube-proxy-hgw86" in "kube-system" namespace to be "Ready" ...
I0913 23:28:19.528941 8290 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-467916" in "kube-system" namespace to be "Ready" ...
I0913 23:28:19.887706 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:19.907298 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:19.929440 8290 pod_ready.go:93] pod "kube-scheduler-addons-467916" in "kube-system" namespace has status "Ready":"True"
I0913 23:28:19.929511 8290 pod_ready.go:82] duration metric: took 400.549184ms for pod "kube-scheduler-addons-467916" in "kube-system" namespace to be "Ready" ...
I0913 23:28:19.929534 8290 pod_ready.go:39] duration metric: took 40.618120931s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0913 23:28:19.929580 8290 api_server.go:52] waiting for apiserver process to appear ...
I0913 23:28:19.929657 8290 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0913 23:28:19.948612 8290 api_server.go:72] duration metric: took 43.921951115s to wait for apiserver process to appear ...
I0913 23:28:19.948640 8290 api_server.go:88] waiting for apiserver healthz status ...
I0913 23:28:19.948662 8290 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0913 23:28:19.960123 8290 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0913 23:28:19.961925 8290 api_server.go:141] control plane version: v1.31.1
I0913 23:28:19.961955 8290 api_server.go:131] duration metric: took 13.307301ms to wait for apiserver health ...
I0913 23:28:19.961965 8290 system_pods.go:43] waiting for kube-system pods to appear ...
I0913 23:28:20.138300 8290 system_pods.go:59] 17 kube-system pods found
I0913 23:28:20.138338 8290 system_pods.go:61] "coredns-7c65d6cfc9-7w5hb" [1a8e6fd6-e7ce-42bb-a0dc-17c7ef331368] Running
I0913 23:28:20.138350 8290 system_pods.go:61] "csi-hostpath-attacher-0" [21d30727-a22c-493c-bee1-0f962e0783bd] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0913 23:28:20.138358 8290 system_pods.go:61] "csi-hostpath-resizer-0" [228807fd-6f3a-4202-847a-97def273edd0] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0913 23:28:20.138368 8290 system_pods.go:61] "csi-hostpathplugin-fdq4p" [e088fb74-87f7-438a-8f3d-3dcff61456de] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0913 23:28:20.138374 8290 system_pods.go:61] "etcd-addons-467916" [a31bc6c2-28b8-4ff9-a638-1d125a67e089] Running
I0913 23:28:20.138380 8290 system_pods.go:61] "kube-apiserver-addons-467916" [462f0c74-5224-4f68-9c2e-e114bf29b749] Running
I0913 23:28:20.138388 8290 system_pods.go:61] "kube-controller-manager-addons-467916" [b8b46b58-e4cd-43a1-bd9f-9817b89c2be1] Running
I0913 23:28:20.138394 8290 system_pods.go:61] "kube-ingress-dns-minikube" [1ac07004-e505-4f58-b4fb-b3f28ae1857f] Running
I0913 23:28:20.138405 8290 system_pods.go:61] "kube-proxy-hgw86" [273ffd46-671f-4979-b1f4-1c08d9f7087a] Running
I0913 23:28:20.138409 8290 system_pods.go:61] "kube-scheduler-addons-467916" [74d2a1ca-15cf-48f5-9e03-1abfe46facdd] Running
I0913 23:28:20.138416 8290 system_pods.go:61] "metrics-server-84c5f94fbc-cx9cr" [c35bd9f6-56a5-41e8-a831-926ba6fe5266] Running / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0913 23:28:20.138427 8290 system_pods.go:61] "nvidia-device-plugin-daemonset-4zhpp" [425cd5c4-637d-474a-884b-c509d13eb5e5] Running
I0913 23:28:20.138432 8290 system_pods.go:61] "registry-66c9cd494c-696bs" [7aa69fd1-c981-411c-bdd9-00cacd8b1736] Running
I0913 23:28:20.138436 8290 system_pods.go:61] "registry-proxy-sgv4q" [a5a96a3a-0fec-4005-b778-df5a7261b085] Running
I0913 23:28:20.138443 8290 system_pods.go:61] "snapshot-controller-56fcc65765-hfmpp" [efcea3c1-70d5-407c-9cec-4cc4c616c25b] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0913 23:28:20.138453 8290 system_pods.go:61] "snapshot-controller-56fcc65765-qt5qc" [db54941b-e2e8-4753-ab92-95f051c14d7a] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0913 23:28:20.138457 8290 system_pods.go:61] "storage-provisioner" [cb1bc2b7-822a-40e3-bed6-6930d1f510d9] Running
I0913 23:28:20.138464 8290 system_pods.go:74] duration metric: took 176.492626ms to wait for pod list to return data ...
I0913 23:28:20.138476 8290 default_sa.go:34] waiting for default service account to be created ...
I0913 23:28:20.329390 8290 default_sa.go:45] found service account: "default"
I0913 23:28:20.329426 8290 default_sa.go:55] duration metric: took 190.935136ms for default service account to be created ...
I0913 23:28:20.329440 8290 system_pods.go:116] waiting for k8s-apps to be running ...
I0913 23:28:20.336262 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:20.407262 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:20.535946 8290 system_pods.go:86] 17 kube-system pods found
I0913 23:28:20.535982 8290 system_pods.go:89] "coredns-7c65d6cfc9-7w5hb" [1a8e6fd6-e7ce-42bb-a0dc-17c7ef331368] Running
I0913 23:28:20.535993 8290 system_pods.go:89] "csi-hostpath-attacher-0" [21d30727-a22c-493c-bee1-0f962e0783bd] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0913 23:28:20.536000 8290 system_pods.go:89] "csi-hostpath-resizer-0" [228807fd-6f3a-4202-847a-97def273edd0] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0913 23:28:20.536010 8290 system_pods.go:89] "csi-hostpathplugin-fdq4p" [e088fb74-87f7-438a-8f3d-3dcff61456de] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0913 23:28:20.536015 8290 system_pods.go:89] "etcd-addons-467916" [a31bc6c2-28b8-4ff9-a638-1d125a67e089] Running
I0913 23:28:20.536020 8290 system_pods.go:89] "kube-apiserver-addons-467916" [462f0c74-5224-4f68-9c2e-e114bf29b749] Running
I0913 23:28:20.536025 8290 system_pods.go:89] "kube-controller-manager-addons-467916" [b8b46b58-e4cd-43a1-bd9f-9817b89c2be1] Running
I0913 23:28:20.536031 8290 system_pods.go:89] "kube-ingress-dns-minikube" [1ac07004-e505-4f58-b4fb-b3f28ae1857f] Running
I0913 23:28:20.536035 8290 system_pods.go:89] "kube-proxy-hgw86" [273ffd46-671f-4979-b1f4-1c08d9f7087a] Running
I0913 23:28:20.536040 8290 system_pods.go:89] "kube-scheduler-addons-467916" [74d2a1ca-15cf-48f5-9e03-1abfe46facdd] Running
I0913 23:28:20.536053 8290 system_pods.go:89] "metrics-server-84c5f94fbc-cx9cr" [c35bd9f6-56a5-41e8-a831-926ba6fe5266] Running / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0913 23:28:20.536058 8290 system_pods.go:89] "nvidia-device-plugin-daemonset-4zhpp" [425cd5c4-637d-474a-884b-c509d13eb5e5] Running
I0913 23:28:20.536063 8290 system_pods.go:89] "registry-66c9cd494c-696bs" [7aa69fd1-c981-411c-bdd9-00cacd8b1736] Running
I0913 23:28:20.536073 8290 system_pods.go:89] "registry-proxy-sgv4q" [a5a96a3a-0fec-4005-b778-df5a7261b085] Running
I0913 23:28:20.536080 8290 system_pods.go:89] "snapshot-controller-56fcc65765-hfmpp" [efcea3c1-70d5-407c-9cec-4cc4c616c25b] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0913 23:28:20.536087 8290 system_pods.go:89] "snapshot-controller-56fcc65765-qt5qc" [db54941b-e2e8-4753-ab92-95f051c14d7a] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0913 23:28:20.536095 8290 system_pods.go:89] "storage-provisioner" [cb1bc2b7-822a-40e3-bed6-6930d1f510d9] Running
I0913 23:28:20.536102 8290 system_pods.go:126] duration metric: took 206.655974ms to wait for k8s-apps to be running ...
I0913 23:28:20.536112 8290 system_svc.go:44] waiting for kubelet service to be running ....
I0913 23:28:20.536168 8290 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0913 23:28:20.552104 8290 system_svc.go:56] duration metric: took 15.984714ms WaitForService to wait for kubelet
I0913 23:28:20.552132 8290 kubeadm.go:582] duration metric: took 44.525494577s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0913 23:28:20.552151 8290 node_conditions.go:102] verifying NodePressure condition ...
I0913 23:28:20.729780 8290 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0913 23:28:20.729813 8290 node_conditions.go:123] node cpu capacity is 2
I0913 23:28:20.729827 8290 node_conditions.go:105] duration metric: took 177.66982ms to run NodePressure ...
I0913 23:28:20.729840 8290 start.go:241] waiting for startup goroutines ...
I0913 23:28:20.836407 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:20.908133 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:21.336523 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:21.406914 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:21.837011 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:21.907890 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:22.418267 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:22.419941 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:22.889856 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:22.907317 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:23.340549 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:23.408698 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:23.835749 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:23.907752 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:24.336607 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:24.408877 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:24.836584 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:24.908249 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:25.336514 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:25.407147 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:25.850318 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:25.910764 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:26.335870 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:26.407656 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:26.835400 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:26.909876 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:27.336068 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:27.407970 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:27.835988 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:27.910815 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:28.335274 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:28.452983 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:28.835885 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:28.909843 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:29.336124 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:29.407897 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:29.836945 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:29.907607 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:30.336065 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:30.407616 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:30.835395 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:30.914693 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:31.336858 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:31.409779 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:31.835999 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:31.908024 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:32.336032 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:32.408459 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:32.836324 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:32.907710 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:33.336575 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:33.406956 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:33.835806 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:33.907275 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:34.389217 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:34.487913 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:34.837911 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:34.910428 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:35.337459 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:35.406710 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:35.836202 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:35.908956 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:36.335830 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:36.407898 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:36.836500 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:36.907016 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:37.336459 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:37.406698 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:37.887652 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:37.906990 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:38.336626 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:38.407118 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:38.894145 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:38.908804 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:39.335822 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:39.407647 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:39.836456 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:39.907398 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:40.339811 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:40.408954 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:40.835873 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:40.907506 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:41.335595 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:41.407352 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:41.836305 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:41.907903 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:42.388491 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:42.406758 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0913 23:28:42.835490 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:42.907024 8290 kapi.go:107] duration metric: took 53.50450364s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0913 23:28:43.335596 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:43.835850 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:44.335309 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:44.835323 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:45.339788 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:45.835522 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:46.336735 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:46.835146 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:47.336668 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:47.836005 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:48.335306 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:48.835419 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:49.334969 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:49.836371 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:50.336740 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:50.836924 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:51.336617 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:51.837363 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:52.335967 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:52.835561 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:53.335674 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:53.837828 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:54.336569 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:54.836097 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:55.335656 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:55.837284 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:56.337803 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:56.888543 8290 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0913 23:28:57.336498 8290 kapi.go:107] duration metric: took 1m10.505269822s to wait for app.kubernetes.io/name=ingress-nginx ...
I0913 23:29:13.785092 8290 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0913 23:29:13.785116 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:14.285889 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:14.786321 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:15.285683 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:15.785522 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:16.285332 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:16.785795 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:17.285356 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:17.786245 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:18.285193 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:18.785825 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:19.285966 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:19.786506 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:20.285376 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:20.784782 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:21.286189 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:21.786063 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:22.286088 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:22.785997 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:23.285717 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:23.785675 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:24.286264 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:24.785129 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:25.285891 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:25.785549 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:26.285493 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:26.785361 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:27.285410 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:27.785380 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:28.286675 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:28.785123 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:29.285150 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:29.785481 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:30.286356 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:30.785374 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:31.286046 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:31.785503 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:32.285662 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:32.786516 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:33.285561 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:33.784838 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:34.285885 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:34.786211 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:35.285370 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:35.784861 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:36.285426 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:36.786406 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:37.285555 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:37.785448 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:38.285716 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:38.785364 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:39.285424 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:39.785581 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:40.285309 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:40.785442 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:41.284970 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:41.785977 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:42.286362 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:42.786009 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:43.286642 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:43.784997 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:44.285829 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:44.785675 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:45.296900 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:45.786015 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:46.286234 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:46.785457 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:47.284921 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:47.786489 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:48.285756 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:48.786282 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:49.285189 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:49.786056 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:50.285751 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:50.785838 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:51.285654 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:51.792585 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:52.284928 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:52.785387 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:53.285215 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:53.785506 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:54.286017 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:54.793643 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:55.285782 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:55.785002 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:56.285098 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:56.785897 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:57.285161 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:57.785820 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:58.285972 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:58.785712 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:59.285745 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:29:59.785307 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:00.312235 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:00.787639 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:01.285529 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:01.785435 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:02.285551 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:02.785938 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:03.285903 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:03.784909 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:04.285489 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:04.785992 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:05.285654 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:05.785500 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:06.285347 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:06.786164 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:07.285660 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:07.785112 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:08.286042 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:08.785678 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:09.285739 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:09.784830 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:10.285242 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:10.785530 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:11.284748 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:11.785787 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:12.286373 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:12.786343 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:13.285244 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:13.786202 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:14.285894 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:14.785977 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:15.285890 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:15.785712 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:16.284823 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:16.785989 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:17.285769 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:17.785567 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:18.285479 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:18.786184 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:19.286234 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:19.785201 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:20.285473 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:20.785204 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:21.288528 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:21.785935 8290 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0913 23:30:22.285348 8290 kapi.go:107] duration metric: took 2m30.503620575s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0913 23:30:22.288266 8290 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-467916 cluster.
I0913 23:30:22.291166 8290 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0913 23:30:22.293470 8290 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0913 23:30:22.296334 8290 out.go:177] * Enabled addons: cloud-spanner, default-storageclass, volcano, nvidia-device-plugin, ingress-dns, storage-provisioner, metrics-server, inspektor-gadget, yakd, storage-provisioner-rancher, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
I0913 23:30:22.299281 8290 addons.go:510] duration metric: took 2m46.272246782s for enable addons: enabled=[cloud-spanner default-storageclass volcano nvidia-device-plugin ingress-dns storage-provisioner metrics-server inspektor-gadget yakd storage-provisioner-rancher volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
I0913 23:30:22.299344 8290 start.go:246] waiting for cluster config update ...
I0913 23:30:22.299368 8290 start.go:255] writing updated cluster config ...
I0913 23:30:22.299672 8290 ssh_runner.go:195] Run: rm -f paused
I0913 23:30:22.653489 8290 start.go:600] kubectl: 1.31.0, cluster: 1.31.1 (minor skew: 0)
I0913 23:30:22.655413 8290 out.go:177] * Done! kubectl is now configured to use "addons-467916" cluster and "default" namespace by default
==> Docker <==
Sep 13 23:39:26 addons-467916 dockerd[1285]: time="2024-09-13T23:39:26.629056696Z" level=warning msg="reference for unknown type: " digest="sha256:3fbc632167424a6d997e74f52b878d7cc478225cffac6bc977eedfe51c7f4e79" remote="docker.io/library/busybox@sha256:3fbc632167424a6d997e74f52b878d7cc478225cffac6bc977eedfe51c7f4e79"
Sep 13 23:39:27 addons-467916 cri-dockerd[1544]: time="2024-09-13T23:39:27Z" level=info msg="Stop pulling image docker.io/busybox:stable@sha256:3fbc632167424a6d997e74f52b878d7cc478225cffac6bc977eedfe51c7f4e79: Status: Downloaded newer image for busybox@sha256:3fbc632167424a6d997e74f52b878d7cc478225cffac6bc977eedfe51c7f4e79"
Sep 13 23:39:27 addons-467916 dockerd[1285]: time="2024-09-13T23:39:27.350862490Z" level=info msg="ignoring event" container=54662db5b73240d46b6613293a4f9a6ce0ca688d63ab275f59ef539216300f67 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:39:29 addons-467916 dockerd[1285]: time="2024-09-13T23:39:29.100746782Z" level=info msg="ignoring event" container=2ba6cbacffe42144f138d2a566172c8ca0850f2f9e859668ee906b1d972e53fa module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:39:30 addons-467916 dockerd[1285]: time="2024-09-13T23:39:30.799040728Z" level=info msg="Attempting next endpoint for pull after error: Head \"https://gcr.io/v2/k8s-minikube/busybox/manifests/latest\": unauthorized: authentication failed"
Sep 13 23:39:30 addons-467916 dockerd[1285]: time="2024-09-13T23:39:30.801608096Z" level=error msg="Handler for POST /v1.43/images/create returned error: Head \"https://gcr.io/v2/k8s-minikube/busybox/manifests/latest\": unauthorized: authentication failed"
Sep 13 23:39:31 addons-467916 cri-dockerd[1544]: time="2024-09-13T23:39:31Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/1a9ca758880e7c6e3a0b3300e812d7d9aa441ddf627b0b5818fbc58bf26bb408/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local us-east-2.compute.internal options ndots:5]"
Sep 13 23:39:32 addons-467916 cri-dockerd[1544]: time="2024-09-13T23:39:32Z" level=info msg="Stop pulling image busybox:stable: Status: Downloaded newer image for busybox:stable"
Sep 13 23:39:32 addons-467916 dockerd[1285]: time="2024-09-13T23:39:32.460192344Z" level=info msg="ignoring event" container=3b6ee86c417dc5c58b22ee4eb4114100691a25cf6574b8f3c20b3bba672df967 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:39:34 addons-467916 dockerd[1285]: time="2024-09-13T23:39:34.250743626Z" level=info msg="ignoring event" container=1a9ca758880e7c6e3a0b3300e812d7d9aa441ddf627b0b5818fbc58bf26bb408 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:39:36 addons-467916 cri-dockerd[1544]: time="2024-09-13T23:39:36Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/79116ac703552414e55cfb8f6fa9d2ae0c9c1c84a84229efa23c8232041a3443/resolv.conf as [nameserver 10.96.0.10 search local-path-storage.svc.cluster.local svc.cluster.local cluster.local us-east-2.compute.internal options ndots:5]"
Sep 13 23:39:36 addons-467916 dockerd[1285]: time="2024-09-13T23:39:36.489779023Z" level=info msg="ignoring event" container=d5b50901219be314ba34f4e431be4a5cdb99928b36a6d56bd28986d826d54cb7 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:39:36 addons-467916 cri-dockerd[1544]: time="2024-09-13T23:39:36Z" level=info msg="Stop pulling image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec: Status: Image is up to date for ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec"
Sep 13 23:39:38 addons-467916 dockerd[1285]: time="2024-09-13T23:39:38.326934621Z" level=info msg="ignoring event" container=d30927f55ca868fbba2daad992e3897eaec97ddcf7efb5ee31bd18ebcdfc60fd module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:39:38 addons-467916 dockerd[1285]: time="2024-09-13T23:39:38.442880878Z" level=info msg="ignoring event" container=79116ac703552414e55cfb8f6fa9d2ae0c9c1c84a84229efa23c8232041a3443 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:39:56 addons-467916 dockerd[1285]: time="2024-09-13T23:39:56.736568601Z" level=info msg="Attempting next endpoint for pull after error: Head \"https://gcr.io/v2/k8s-minikube/busybox/manifests/latest\": unauthorized: authentication failed"
Sep 13 23:39:56 addons-467916 dockerd[1285]: time="2024-09-13T23:39:56.738963817Z" level=error msg="Handler for POST /v1.43/images/create returned error: Head \"https://gcr.io/v2/k8s-minikube/busybox/manifests/latest\": unauthorized: authentication failed"
Sep 13 23:40:06 addons-467916 dockerd[1285]: time="2024-09-13T23:40:06.413486281Z" level=info msg="Container failed to exit within 30s of signal 15 - using the force" container=6e641d616a3819ed0b124053996c4ac0bc0ff2d62e044518554e99dad182746b
Sep 13 23:40:06 addons-467916 dockerd[1285]: time="2024-09-13T23:40:06.442853598Z" level=info msg="ignoring event" container=6e641d616a3819ed0b124053996c4ac0bc0ff2d62e044518554e99dad182746b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:40:06 addons-467916 dockerd[1285]: time="2024-09-13T23:40:06.594799579Z" level=info msg="ignoring event" container=cb60f4e198dd1ea1fe8dd19e30fafe03eef3e1e259db97aba0396a8a609ac708 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:40:17 addons-467916 dockerd[1285]: time="2024-09-13T23:40:17.478448384Z" level=info msg="ignoring event" container=6bfc08a9ed056b967f4cfba3d372c3bf7f7dcf4fe342aa43040bdd3084603339 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:40:18 addons-467916 dockerd[1285]: time="2024-09-13T23:40:18.171204564Z" level=info msg="ignoring event" container=4dcfffebb5f1779832cab591a1ece3f1b6ec3a5a72606f40fecf7587349e4875 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:40:18 addons-467916 dockerd[1285]: time="2024-09-13T23:40:18.224060599Z" level=info msg="ignoring event" container=da9a19e162a3dda6dc0d4665e03997491f6495ccd0feb59be5d02a31c8fc5935 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:40:18 addons-467916 dockerd[1285]: time="2024-09-13T23:40:18.371158978Z" level=info msg="ignoring event" container=fe17bfd1708160b59c90fa3b9c6e64d73998f1c0992c54d09bc32cd38317282c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 13 23:40:18 addons-467916 dockerd[1285]: time="2024-09-13T23:40:18.473365842Z" level=info msg="ignoring event" container=3cdad3daad7161e68c449de957d43ccbd1a02c62cedc8e6b13a565238ead571e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
d30927f55ca86 ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec 43 seconds ago Exited gadget 7 8889f86811930 gadget-pfpfw
d5b50901219be fc9db2894f4e4 43 seconds ago Exited helper-pod 0 79116ac703552 helper-pod-delete-pvc-57a7b523-7db8-4825-ad64-698dbbbd6c68
3b6ee86c417dc busybox@sha256:c230832bd3b0be59a6c47ed64294f9ce71e91b327957920b6929a0caa8353140 47 seconds ago Exited busybox 0 1a9ca758880e7 test-local-path
33f3c35bcef62 gcr.io/k8s-minikube/gcp-auth-webhook@sha256:e6c5b3bc32072ea370d34c27836efd11b3519d25bd444c2a8efc339cff0e20fb 9 minutes ago Running gcp-auth 0 7b3e0ee52645d gcp-auth-89d5ffd79-5vxqg
5e956531f7255 registry.k8s.io/ingress-nginx/controller@sha256:d5f8217feeac4887cb1ed21f27c2674e58be06bd8f5184cacea2a69abaf78dce 11 minutes ago Running controller 0 f2b750e1cbf2d ingress-nginx-controller-bc57996ff-prb6k
9196c309ccf65 registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f 11 minutes ago Running csi-snapshotter 0 f42d9364a230d csi-hostpathplugin-fdq4p
cefb2f33ee2e8 registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 11 minutes ago Running csi-provisioner 0 f42d9364a230d csi-hostpathplugin-fdq4p
7bf8b2759b8fd registry.k8s.io/sig-storage/livenessprobe@sha256:cacee2b5c36dd59d4c7e8469c05c9e4ef53ecb2df9025fa8c10cdaf61bce62f0 11 minutes ago Running liveness-probe 0 f42d9364a230d csi-hostpathplugin-fdq4p
4e10f94c29b68 registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 11 minutes ago Running hostpath 0 f42d9364a230d csi-hostpathplugin-fdq4p
fd17131ca41c1 registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:f1c25991bac2fbb7f5fcf91ed9438df31e30edee6bed5a780464238aa09ad24c 11 minutes ago Running node-driver-registrar 0 f42d9364a230d csi-hostpathplugin-fdq4p
5cd0105ac6ed4 registry.k8s.io/sig-storage/csi-external-health-monitor-controller@sha256:80b9ba94aa2afe24553d69bd165a6a51552d1582d68618ec00d3b804a7d9193c 11 minutes ago Running csi-external-health-monitor-controller 0 f42d9364a230d csi-hostpathplugin-fdq4p
ab2ad6d46e82c registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 11 minutes ago Running csi-resizer 0 3750b8886c569 csi-hostpath-resizer-0
8884fcbf5cae1 registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b 11 minutes ago Running csi-attacher 0 875929a374271 csi-hostpath-attacher-0
6777d39ef86fc registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a320a50cc91bd15fd2d6fa6de58bd98c1bd64b9a6f926ce23a600d87043455a3 11 minutes ago Exited create 0 b4305bfb473a3 ingress-nginx-admission-create-dlp7n
402383d608f08 registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a320a50cc91bd15fd2d6fa6de58bd98c1bd64b9a6f926ce23a600d87043455a3 11 minutes ago Exited patch 0 9b0557a12dff9 ingress-nginx-admission-patch-q6ltk
a78bf53183715 registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 11 minutes ago Running volume-snapshot-controller 0 1207926fbcdfc snapshot-controller-56fcc65765-hfmpp
e869792a87bbe registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 11 minutes ago Running volume-snapshot-controller 0 01baabcdd836e snapshot-controller-56fcc65765-qt5qc
cd301ceae7031 registry.k8s.io/metrics-server/metrics-server@sha256:ffcb2bf004d6aa0a17d90e0247cf94f2865c8901dcab4427034c341951c239f9 12 minutes ago Running metrics-server 0 16c0ebde5c0b6 metrics-server-84c5f94fbc-cx9cr
5efe4e5f026ba gcr.io/cloud-spanner-emulator/emulator@sha256:636fdfc528824bae5f0ea2eca6ae307fe81092f05ec21038008bc0d6100e52fc 12 minutes ago Running cloud-spanner-emulator 0 f04f7caabd85a cloud-spanner-emulator-769b77f747-k6w6l
35967e8495f1e gcr.io/k8s-minikube/minikube-ingress-dns@sha256:4211a1de532376c881851542238121b26792225faa36a7b02dccad88fd05797c 12 minutes ago Running minikube-ingress-dns 0 2a3b36f0c653b kube-ingress-dns-minikube
22405ec6ec813 ba04bb24b9575 12 minutes ago Running storage-provisioner 0 4837248c997ad storage-provisioner
a57304e14f012 2f6c962e7b831 12 minutes ago Running coredns 0 78389fd9e58f2 coredns-7c65d6cfc9-7w5hb
937776f96a500 24a140c548c07 12 minutes ago Running kube-proxy 0 5201a96a72bf3 kube-proxy-hgw86
a11957d28d9af 279f381cb3736 12 minutes ago Running kube-controller-manager 0 140730838c38a kube-controller-manager-addons-467916
8b0dcc71f91eb d3f53a98c0a9d 12 minutes ago Running kube-apiserver 0 ad423d966da1d kube-apiserver-addons-467916
a6183f4a9c5f3 7f8aa378bb47d 12 minutes ago Running kube-scheduler 0 16f5cf3468c00 kube-scheduler-addons-467916
55bb578134539 27e3830e14027 12 minutes ago Running etcd 0 3ec7f4a9395f2 etcd-addons-467916
==> controller_ingress [5e956531f725] <==
NGINX Ingress controller
Release: v1.11.2
Build: 46e76e5916813cfca2a9b0bfdc34b69a0000f6b9
Repository: https://github.com/kubernetes/ingress-nginx
nginx version: nginx/1.25.5
-------------------------------------------------------------------------------
I0913 23:28:56.962887 7 main.go:248] "Running in Kubernetes cluster" major="1" minor="31" git="v1.31.1" state="clean" commit="948afe5ca072329a73c8e79ed5938717a5cb3d21" platform="linux/arm64"
I0913 23:28:57.780943 7 main.go:101] "SSL fake certificate created" file="/etc/ingress-controller/ssl/default-fake-certificate.pem"
I0913 23:28:57.799765 7 ssl.go:535] "loading tls certificate" path="/usr/local/certificates/cert" key="/usr/local/certificates/key"
I0913 23:28:57.813883 7 nginx.go:271] "Starting NGINX Ingress controller"
I0913 23:28:57.831409 7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"ingress-nginx-controller", UID:"75f58484-7992-4bfc-ab1d-4a2291fb38a0", APIVersion:"v1", ResourceVersion:"700", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/ingress-nginx-controller
I0913 23:28:57.842253 7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"tcp-services", UID:"23810536-ae54-4beb-ac58-8a9dbb323959", APIVersion:"v1", ResourceVersion:"701", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/tcp-services
I0913 23:28:57.842532 7 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"udp-services", UID:"9657921f-f9bc-4c96-b98f-8a829d9093b6", APIVersion:"v1", ResourceVersion:"702", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/udp-services
I0913 23:28:59.015980 7 nginx.go:317] "Starting NGINX process"
I0913 23:28:59.016081 7 leaderelection.go:250] attempting to acquire leader lease ingress-nginx/ingress-nginx-leader...
I0913 23:28:59.016633 7 nginx.go:337] "Starting validation webhook" address=":8443" certPath="/usr/local/certificates/cert" keyPath="/usr/local/certificates/key"
I0913 23:28:59.016814 7 controller.go:193] "Configuration changes detected, backend reload required"
I0913 23:28:59.031809 7 leaderelection.go:260] successfully acquired lease ingress-nginx/ingress-nginx-leader
I0913 23:28:59.032071 7 status.go:85] "New leader elected" identity="ingress-nginx-controller-bc57996ff-prb6k"
I0913 23:28:59.045142 7 status.go:219] "POD is not ready" pod="ingress-nginx/ingress-nginx-controller-bc57996ff-prb6k" node="addons-467916"
I0913 23:28:59.069448 7 controller.go:213] "Backend successfully reloaded"
I0913 23:28:59.069576 7 controller.go:224] "Initial sync, sleeping for 1 second"
I0913 23:28:59.070034 7 event.go:377] Event(v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-bc57996ff-prb6k", UID:"431a3ca8-a7ec-4bc1-8304-084a4a299ecc", APIVersion:"v1", ResourceVersion:"1281", FieldPath:""}): type: 'Normal' reason: 'RELOAD' NGINX reload triggered due to a change in configuration
==> coredns [a57304e14f01] <==
[INFO] 10.244.0.7:59691 - 35490 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000122543s
[INFO] 10.244.0.7:54502 - 54359 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002421077s
[INFO] 10.244.0.7:54502 - 39769 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.00209865s
[INFO] 10.244.0.7:55183 - 28628 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000159983s
[INFO] 10.244.0.7:55183 - 38105 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.00010921s
[INFO] 10.244.0.7:51605 - 15994 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000152713s
[INFO] 10.244.0.7:51605 - 56333 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000075126s
[INFO] 10.244.0.7:48040 - 58675 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000266649s
[INFO] 10.244.0.7:48040 - 43061 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000081961s
[INFO] 10.244.0.7:57644 - 61791 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000058199s
[INFO] 10.244.0.7:57644 - 64605 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000052988s
[INFO] 10.244.0.7:34739 - 12124 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001734844s
[INFO] 10.244.0.7:34739 - 26202 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001546973s
[INFO] 10.244.0.7:50361 - 5348 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000098018s
[INFO] 10.244.0.7:50361 - 4582 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000077612s
[INFO] 10.244.0.25:55979 - 52101 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000254572s
[INFO] 10.244.0.25:34742 - 15603 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000147783s
[INFO] 10.244.0.25:47185 - 44832 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000139421s
[INFO] 10.244.0.25:48915 - 36200 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000124972s
[INFO] 10.244.0.25:35028 - 25377 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000105239s
[INFO] 10.244.0.25:57982 - 36897 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000101415s
[INFO] 10.244.0.25:39169 - 55109 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002517401s
[INFO] 10.244.0.25:53461 - 60602 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002012639s
[INFO] 10.244.0.25:35539 - 9059 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.002301427s
[INFO] 10.244.0.25:57000 - 1806 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 610 0.001804328s
==> describe nodes <==
Name: addons-467916
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-467916
kubernetes.io/os=linux
minikube.k8s.io/commit=7ca96ba7bd97af6e0063398921096f1cca785d18
minikube.k8s.io/name=addons-467916
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_13T23_27_32_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-467916
Annotations: csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-467916"}
kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Fri, 13 Sep 2024 23:27:28 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-467916
AcquireTime: <unset>
RenewTime: Fri, 13 Sep 2024 23:40:16 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Fri, 13 Sep 2024 23:40:06 +0000 Fri, 13 Sep 2024 23:27:25 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Fri, 13 Sep 2024 23:40:06 +0000 Fri, 13 Sep 2024 23:27:25 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Fri, 13 Sep 2024 23:40:06 +0000 Fri, 13 Sep 2024 23:27:25 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Fri, 13 Sep 2024 23:40:06 +0000 Fri, 13 Sep 2024 23:27:29 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-467916
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022292Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022292Ki
pods: 110
System Info:
Machine ID: f9aa28e588d64befb2a416a935cb05a8
System UUID: af8b1151-b68f-4ca2-ad7a-4c4132769083
Boot ID: 5a347e92-47ff-4e1d-8cee-4b20921cd8ac
Kernel Version: 5.15.0-1069-aws
OS Image: Ubuntu 22.04.4 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: docker://27.2.1
Kubelet Version: v1.31.1
Kube-Proxy Version: v1.31.1
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (19 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 9m15s
default cloud-spanner-emulator-769b77f747-k6w6l 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
gadget gadget-pfpfw 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
gcp-auth gcp-auth-89d5ffd79-5vxqg 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
ingress-nginx ingress-nginx-controller-bc57996ff-prb6k 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 12m
kube-system coredns-7c65d6cfc9-7w5hb 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 12m
kube-system csi-hostpath-attacher-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system csi-hostpath-resizer-0 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system csi-hostpathplugin-fdq4p 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system etcd-addons-467916 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 12m
kube-system kube-apiserver-addons-467916 250m (12%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-controller-manager-addons-467916 200m (10%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-proxy-hgw86 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-scheduler-addons-467916 100m (5%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system metrics-server-84c5f94fbc-cx9cr 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 12m
kube-system snapshot-controller-56fcc65765-hfmpp 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system snapshot-controller-56fcc65765-qt5qc 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%) 0 (0%)
memory 460Mi (5%) 170Mi (2%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 12m kube-proxy
Normal NodeHasSufficientMemory 12m (x8 over 12m) kubelet Node addons-467916 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 12m (x7 over 12m) kubelet Node addons-467916 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 12m (x7 over 12m) kubelet Node addons-467916 status is now: NodeHasSufficientPID
Normal NodeAllocatableEnforced 12m kubelet Updated Node Allocatable limit across pods
Normal Starting 12m kubelet Starting kubelet.
Warning CgroupV1 12m kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 12m kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 12m kubelet Node addons-467916 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 12m kubelet Node addons-467916 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 12m kubelet Node addons-467916 status is now: NodeHasSufficientPID
Normal RegisteredNode 12m node-controller Node addons-467916 event: Registered Node addons-467916 in Controller
==> dmesg <==
[Sep13 23:17] ACPI: SRAT not present
[ +0.000000] ACPI: SRAT not present
[ +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr
[ +0.014819] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[ +0.495879] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.745347] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.
[ +6.786510] kauditd_printk_skb: 36 callbacks suppressed
==> etcd [55bb57813453] <==
{"level":"info","ts":"2024-09-13T23:27:24.948895Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc switched to configuration voters=(12593026477526642892)"}
{"level":"info","ts":"2024-09-13T23:27:24.948996Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}
{"level":"info","ts":"2024-09-13T23:27:25.320344Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-09-13T23:27:25.320467Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-09-13T23:27:25.320503Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-09-13T23:27:25.320574Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-09-13T23:27:25.320608Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-13T23:27:25.320698Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-09-13T23:27:25.320773Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-13T23:27:25.324481Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-467916 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-09-13T23:27:25.324774Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-13T23:27:25.325049Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-13T23:27:25.325587Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-13T23:27:25.326592Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-13T23:27:25.337118Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-13T23:27:25.344337Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-09-13T23:27:25.344577Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-09-13T23:27:25.345702Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-09-13T23:27:25.348470Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-13T23:27:25.348801Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-13T23:27:25.348951Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-13T23:27:25.357331Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-09-13T23:37:26.049950Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1888}
{"level":"info","ts":"2024-09-13T23:37:26.109143Z","caller":"mvcc/kvstore_compaction.go:69","msg":"finished scheduled compaction","compact-revision":1888,"took":"58.441643ms","hash":3804136292,"current-db-size-bytes":8863744,"current-db-size":"8.9 MB","current-db-size-in-use-bytes":4956160,"current-db-size-in-use":"5.0 MB"}
{"level":"info","ts":"2024-09-13T23:37:26.109203Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":3804136292,"revision":1888,"compact-revision":-1}
==> gcp-auth [33f3c35bcef6] <==
2024/09/13 23:30:21 GCP Auth Webhook started!
2024/09/13 23:30:39 Ready to marshal response ...
2024/09/13 23:30:39 Ready to write response ...
2024/09/13 23:30:39 Ready to marshal response ...
2024/09/13 23:30:39 Ready to write response ...
2024/09/13 23:31:03 Ready to marshal response ...
2024/09/13 23:31:03 Ready to write response ...
2024/09/13 23:31:04 Ready to marshal response ...
2024/09/13 23:31:04 Ready to write response ...
2024/09/13 23:31:04 Ready to marshal response ...
2024/09/13 23:31:04 Ready to write response ...
2024/09/13 23:39:17 Ready to marshal response ...
2024/09/13 23:39:17 Ready to write response ...
2024/09/13 23:39:25 Ready to marshal response ...
2024/09/13 23:39:25 Ready to write response ...
2024/09/13 23:39:26 Ready to marshal response ...
2024/09/13 23:39:26 Ready to write response ...
2024/09/13 23:39:35 Ready to marshal response ...
2024/09/13 23:39:35 Ready to write response ...
==> kernel <==
23:40:19 up 22 min, 0 users, load average: 0.63, 0.59, 0.52
Linux addons-467916 5.15.0-1069-aws #75~20.04.1-Ubuntu SMP Mon Aug 19 16:22:47 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.4 LTS"
==> kube-apiserver [8b0dcc71f91e] <==
E0913 23:29:54.563116 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.107.10.105:443: connect: connection refused" logger="UnhandledError"
W0913 23:29:54.621279 1 dispatcher.go:210] Failed calling webhook, failing open gcp-auth-mutate.k8s.io: failed calling webhook "gcp-auth-mutate.k8s.io": failed to call webhook: Post "https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s": dial tcp 10.107.10.105:443: connect: connection refused
E0913 23:29:54.621326 1 dispatcher.go:214] "Unhandled Error" err="failed calling webhook \"gcp-auth-mutate.k8s.io\": failed to call webhook: Post \"https://gcp-auth.gcp-auth.svc:443/mutate?timeout=10s\": dial tcp 10.107.10.105:443: connect: connection refused" logger="UnhandledError"
I0913 23:30:39.208585 1 controller.go:615] quota admission added evaluator for: jobs.batch.volcano.sh
I0913 23:30:39.241009 1 controller.go:615] quota admission added evaluator for: podgroups.scheduling.volcano.sh
I0913 23:30:53.979166 1 handler.go:286] Adding GroupVersion batch.volcano.sh v1alpha1 to ResourceManager
I0913 23:30:54.079561 1 handler.go:286] Adding GroupVersion bus.volcano.sh v1alpha1 to ResourceManager
I0913 23:30:54.433898 1 handler.go:286] Adding GroupVersion scheduling.volcano.sh v1beta1 to ResourceManager
I0913 23:30:54.499309 1 handler.go:286] Adding GroupVersion scheduling.volcano.sh v1beta1 to ResourceManager
I0913 23:30:54.516900 1 handler.go:286] Adding GroupVersion scheduling.volcano.sh v1beta1 to ResourceManager
I0913 23:30:54.537496 1 handler.go:286] Adding GroupVersion nodeinfo.volcano.sh v1alpha1 to ResourceManager
I0913 23:30:55.013833 1 handler.go:286] Adding GroupVersion flow.volcano.sh v1alpha1 to ResourceManager
I0913 23:30:55.032982 1 handler.go:286] Adding GroupVersion flow.volcano.sh v1alpha1 to ResourceManager
I0913 23:30:55.107283 1 handler.go:286] Adding GroupVersion flow.volcano.sh v1alpha1 to ResourceManager
W0913 23:30:55.298358 1 cacher.go:171] Terminating all watchers from cacher commands.bus.volcano.sh
W0913 23:30:55.518009 1 cacher.go:171] Terminating all watchers from cacher podgroups.scheduling.volcano.sh
W0913 23:30:55.763033 1 cacher.go:171] Terminating all watchers from cacher numatopologies.nodeinfo.volcano.sh
W0913 23:30:55.763033 1 cacher.go:171] Terminating all watchers from cacher jobs.batch.volcano.sh
W0913 23:30:55.817816 1 cacher.go:171] Terminating all watchers from cacher queues.scheduling.volcano.sh
W0913 23:30:56.108031 1 cacher.go:171] Terminating all watchers from cacher jobflows.flow.volcano.sh
W0913 23:30:56.433190 1 cacher.go:171] Terminating all watchers from cacher jobtemplates.flow.volcano.sh
E0913 23:39:36.660216 1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"
E0913 23:39:36.672145 1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"
E0913 23:39:36.687509 1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"
E0913 23:39:51.684378 1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"
==> kube-controller-manager [a11957d28d9a] <==
I0913 23:39:23.953252 1 namespace_controller.go:187] "Namespace has been deleted" logger="namespace-controller" namespace="yakd-dashboard"
W0913 23:39:25.446320 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0913 23:39:25.446372 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0913 23:39:27.955072 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0913 23:39:27.955112 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0913 23:39:29.503514 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0913 23:39:29.503558 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0913 23:39:29.998642 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0913 23:39:29.998693 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0913 23:39:35.987677 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-467916"
I0913 23:39:36.374245 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="local-path-storage/local-path-provisioner-86d989889c" duration="5.038µs"
W0913 23:39:43.402769 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0913 23:39:43.402969 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0913 23:39:52.598891 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0913 23:39:52.598932 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0913 23:39:58.850107 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0913 23:39:58.850149 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0913 23:40:00.053132 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0913 23:40:00.053178 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0913 23:40:00.715255 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0913 23:40:00.715306 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0913 23:40:01.943428 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0913 23:40:01.943503 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0913 23:40:06.589829 1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="addons-467916"
I0913 23:40:18.087068 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/registry-66c9cd494c" duration="5.227µs"
==> kube-proxy [937776f96a50] <==
I0913 23:27:38.049608 1 server_linux.go:66] "Using iptables proxy"
I0913 23:27:38.158981 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0913 23:27:38.159043 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0913 23:27:38.206789 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0913 23:27:38.206845 1 server_linux.go:169] "Using iptables Proxier"
I0913 23:27:38.209987 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0913 23:27:38.210256 1 server.go:483] "Version info" version="v1.31.1"
I0913 23:27:38.210271 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0913 23:27:38.220707 1 config.go:199] "Starting service config controller"
I0913 23:27:38.220748 1 shared_informer.go:313] Waiting for caches to sync for service config
I0913 23:27:38.220773 1 config.go:105] "Starting endpoint slice config controller"
I0913 23:27:38.220778 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0913 23:27:38.221283 1 config.go:328] "Starting node config controller"
I0913 23:27:38.221294 1 shared_informer.go:313] Waiting for caches to sync for node config
I0913 23:27:38.321015 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0913 23:27:38.321065 1 shared_informer.go:320] Caches are synced for service config
I0913 23:27:38.321343 1 shared_informer.go:320] Caches are synced for node config
==> kube-scheduler [a6183f4a9c5f] <==
I0913 23:27:27.807428 1 serving.go:386] Generated self-signed cert in-memory
I0913 23:27:30.465087 1 server.go:167] "Starting Kubernetes Scheduler" version="v1.31.1"
I0913 23:27:30.465487 1 server.go:169] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0913 23:27:30.474758 1 secure_serving.go:213] Serving securely on 127.0.0.1:10259
I0913 23:27:30.477232 1 requestheader_controller.go:172] Starting RequestHeaderAuthRequestController
I0913 23:27:30.477500 1 shared_informer.go:313] Waiting for caches to sync for RequestHeaderAuthRequestController
I0913 23:27:30.477656 1 tlsconfig.go:243] "Starting DynamicServingCertificateController"
I0913 23:27:30.481405 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"
I0913 23:27:30.482475 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0913 23:27:30.481678 1 configmap_cafile_content.go:205] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"
I0913 23:27:30.482770 1 shared_informer.go:313] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
I0913 23:27:30.577707 1 shared_informer.go:320] Caches are synced for RequestHeaderAuthRequestController
I0913 23:27:30.583113 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
I0913 23:27:30.583910 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file
==> kubelet <==
Sep 13 23:40:11 addons-467916 kubelet[2359]: I0913 23:40:11.541360 2359 scope.go:117] "RemoveContainer" containerID="d30927f55ca868fbba2daad992e3897eaec97ddcf7efb5ee31bd18ebcdfc60fd"
Sep 13 23:40:11 addons-467916 kubelet[2359]: E0913 23:40:11.542054 2359 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=gadget pod=gadget-pfpfw_gadget(f1a9d96c-1db0-4cd8-90ec-9e7b378ddf3c)\"" pod="gadget/gadget-pfpfw" podUID="f1a9d96c-1db0-4cd8-90ec-9e7b378ddf3c"
Sep 13 23:40:17 addons-467916 kubelet[2359]: I0913 23:40:17.736452 2359 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-478p6\" (UniqueName: \"kubernetes.io/projected/5bcfe2f0-9700-4683-bf69-c07a4d0cb9c2-kube-api-access-478p6\") pod \"5bcfe2f0-9700-4683-bf69-c07a4d0cb9c2\" (UID: \"5bcfe2f0-9700-4683-bf69-c07a4d0cb9c2\") "
Sep 13 23:40:17 addons-467916 kubelet[2359]: I0913 23:40:17.736523 2359 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/5bcfe2f0-9700-4683-bf69-c07a4d0cb9c2-gcp-creds\") pod \"5bcfe2f0-9700-4683-bf69-c07a4d0cb9c2\" (UID: \"5bcfe2f0-9700-4683-bf69-c07a4d0cb9c2\") "
Sep 13 23:40:17 addons-467916 kubelet[2359]: I0913 23:40:17.736643 2359 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/5bcfe2f0-9700-4683-bf69-c07a4d0cb9c2-gcp-creds" (OuterVolumeSpecName: "gcp-creds") pod "5bcfe2f0-9700-4683-bf69-c07a4d0cb9c2" (UID: "5bcfe2f0-9700-4683-bf69-c07a4d0cb9c2"). InnerVolumeSpecName "gcp-creds". PluginName "kubernetes.io/host-path", VolumeGidValue ""
Sep 13 23:40:17 addons-467916 kubelet[2359]: I0913 23:40:17.738489 2359 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bcfe2f0-9700-4683-bf69-c07a4d0cb9c2-kube-api-access-478p6" (OuterVolumeSpecName: "kube-api-access-478p6") pod "5bcfe2f0-9700-4683-bf69-c07a4d0cb9c2" (UID: "5bcfe2f0-9700-4683-bf69-c07a4d0cb9c2"). InnerVolumeSpecName "kube-api-access-478p6". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 13 23:40:17 addons-467916 kubelet[2359]: I0913 23:40:17.837539 2359 reconciler_common.go:288] "Volume detached for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/5bcfe2f0-9700-4683-bf69-c07a4d0cb9c2-gcp-creds\") on node \"addons-467916\" DevicePath \"\""
Sep 13 23:40:17 addons-467916 kubelet[2359]: I0913 23:40:17.837596 2359 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-478p6\" (UniqueName: \"kubernetes.io/projected/5bcfe2f0-9700-4683-bf69-c07a4d0cb9c2-kube-api-access-478p6\") on node \"addons-467916\" DevicePath \"\""
Sep 13 23:40:18 addons-467916 kubelet[2359]: I0913 23:40:18.543452 2359 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv5pp\" (UniqueName: \"kubernetes.io/projected/7aa69fd1-c981-411c-bdd9-00cacd8b1736-kube-api-access-mv5pp\") pod \"7aa69fd1-c981-411c-bdd9-00cacd8b1736\" (UID: \"7aa69fd1-c981-411c-bdd9-00cacd8b1736\") "
Sep 13 23:40:18 addons-467916 kubelet[2359]: I0913 23:40:18.555421 2359 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aa69fd1-c981-411c-bdd9-00cacd8b1736-kube-api-access-mv5pp" (OuterVolumeSpecName: "kube-api-access-mv5pp") pod "7aa69fd1-c981-411c-bdd9-00cacd8b1736" (UID: "7aa69fd1-c981-411c-bdd9-00cacd8b1736"). InnerVolumeSpecName "kube-api-access-mv5pp". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 13 23:40:18 addons-467916 kubelet[2359]: I0913 23:40:18.644784 2359 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjnqc\" (UniqueName: \"kubernetes.io/projected/a5a96a3a-0fec-4005-b778-df5a7261b085-kube-api-access-cjnqc\") pod \"a5a96a3a-0fec-4005-b778-df5a7261b085\" (UID: \"a5a96a3a-0fec-4005-b778-df5a7261b085\") "
Sep 13 23:40:18 addons-467916 kubelet[2359]: I0913 23:40:18.644902 2359 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-mv5pp\" (UniqueName: \"kubernetes.io/projected/7aa69fd1-c981-411c-bdd9-00cacd8b1736-kube-api-access-mv5pp\") on node \"addons-467916\" DevicePath \"\""
Sep 13 23:40:18 addons-467916 kubelet[2359]: I0913 23:40:18.658554 2359 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5a96a3a-0fec-4005-b778-df5a7261b085-kube-api-access-cjnqc" (OuterVolumeSpecName: "kube-api-access-cjnqc") pod "a5a96a3a-0fec-4005-b778-df5a7261b085" (UID: "a5a96a3a-0fec-4005-b778-df5a7261b085"). InnerVolumeSpecName "kube-api-access-cjnqc". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 13 23:40:18 addons-467916 kubelet[2359]: I0913 23:40:18.746482 2359 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-cjnqc\" (UniqueName: \"kubernetes.io/projected/a5a96a3a-0fec-4005-b778-df5a7261b085-kube-api-access-cjnqc\") on node \"addons-467916\" DevicePath \"\""
Sep 13 23:40:19 addons-467916 kubelet[2359]: I0913 23:40:19.030469 2359 scope.go:117] "RemoveContainer" containerID="4dcfffebb5f1779832cab591a1ece3f1b6ec3a5a72606f40fecf7587349e4875"
Sep 13 23:40:19 addons-467916 kubelet[2359]: I0913 23:40:19.080064 2359 scope.go:117] "RemoveContainer" containerID="4dcfffebb5f1779832cab591a1ece3f1b6ec3a5a72606f40fecf7587349e4875"
Sep 13 23:40:19 addons-467916 kubelet[2359]: E0913 23:40:19.084945 2359 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: 4dcfffebb5f1779832cab591a1ece3f1b6ec3a5a72606f40fecf7587349e4875" containerID="4dcfffebb5f1779832cab591a1ece3f1b6ec3a5a72606f40fecf7587349e4875"
Sep 13 23:40:19 addons-467916 kubelet[2359]: I0913 23:40:19.084986 2359 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"4dcfffebb5f1779832cab591a1ece3f1b6ec3a5a72606f40fecf7587349e4875"} err="failed to get container status \"4dcfffebb5f1779832cab591a1ece3f1b6ec3a5a72606f40fecf7587349e4875\": rpc error: code = Unknown desc = Error response from daemon: No such container: 4dcfffebb5f1779832cab591a1ece3f1b6ec3a5a72606f40fecf7587349e4875"
Sep 13 23:40:19 addons-467916 kubelet[2359]: I0913 23:40:19.085008 2359 scope.go:117] "RemoveContainer" containerID="da9a19e162a3dda6dc0d4665e03997491f6495ccd0feb59be5d02a31c8fc5935"
Sep 13 23:40:19 addons-467916 kubelet[2359]: I0913 23:40:19.111367 2359 scope.go:117] "RemoveContainer" containerID="da9a19e162a3dda6dc0d4665e03997491f6495ccd0feb59be5d02a31c8fc5935"
Sep 13 23:40:19 addons-467916 kubelet[2359]: E0913 23:40:19.112519 2359 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = Unknown desc = Error response from daemon: No such container: da9a19e162a3dda6dc0d4665e03997491f6495ccd0feb59be5d02a31c8fc5935" containerID="da9a19e162a3dda6dc0d4665e03997491f6495ccd0feb59be5d02a31c8fc5935"
Sep 13 23:40:19 addons-467916 kubelet[2359]: I0913 23:40:19.112552 2359 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"docker","ID":"da9a19e162a3dda6dc0d4665e03997491f6495ccd0feb59be5d02a31c8fc5935"} err="failed to get container status \"da9a19e162a3dda6dc0d4665e03997491f6495ccd0feb59be5d02a31c8fc5935\": rpc error: code = Unknown desc = Error response from daemon: No such container: da9a19e162a3dda6dc0d4665e03997491f6495ccd0feb59be5d02a31c8fc5935"
Sep 13 23:40:19 addons-467916 kubelet[2359]: I0913 23:40:19.552168 2359 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bcfe2f0-9700-4683-bf69-c07a4d0cb9c2" path="/var/lib/kubelet/pods/5bcfe2f0-9700-4683-bf69-c07a4d0cb9c2/volumes"
Sep 13 23:40:19 addons-467916 kubelet[2359]: I0913 23:40:19.552661 2359 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7aa69fd1-c981-411c-bdd9-00cacd8b1736" path="/var/lib/kubelet/pods/7aa69fd1-c981-411c-bdd9-00cacd8b1736/volumes"
Sep 13 23:40:19 addons-467916 kubelet[2359]: I0913 23:40:19.553339 2359 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5a96a3a-0fec-4005-b778-df5a7261b085" path="/var/lib/kubelet/pods/a5a96a3a-0fec-4005-b778-df5a7261b085/volumes"
==> storage-provisioner [22405ec6ec81] <==
I0913 23:27:43.325891 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0913 23:27:43.365135 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0913 23:27:43.365185 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0913 23:27:43.384125 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0913 23:27:43.384379 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"dd36235c-6978-47cd-9345-3198b4fd9f69", APIVersion:"v1", ResourceVersion:"597", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-467916_26622722-f067-4b70-bf16-4657722839b7 became leader
I0913 23:27:43.384931 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-467916_26622722-f067-4b70-bf16-4657722839b7!
I0913 23:27:43.485424 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-467916_26622722-f067-4b70-bf16-4657722839b7!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-467916 -n addons-467916
helpers_test.go:261: (dbg) Run: kubectl --context addons-467916 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: busybox ingress-nginx-admission-create-dlp7n ingress-nginx-admission-patch-q6ltk
helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Registry]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-467916 describe pod busybox ingress-nginx-admission-create-dlp7n ingress-nginx-admission-patch-q6ltk
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-467916 describe pod busybox ingress-nginx-admission-create-dlp7n ingress-nginx-admission-patch-q6ltk: exit status 1 (109.263905ms)
-- stdout --
Name: busybox
Namespace: default
Priority: 0
Service Account: default
Node: addons-467916/192.168.49.2
Start Time: Fri, 13 Sep 2024 23:31:04 +0000
Labels: integration-test=busybox
Annotations: <none>
Status: Pending
IP: 10.244.0.27
IPs:
IP: 10.244.0.27
Containers:
busybox:
Container ID:
Image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
Image ID:
Port: <none>
Host Port: <none>
Command:
sleep
3600
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-tp6tx (ro)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
kube-api-access-tp6tx:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 9m16s default-scheduler Successfully assigned default/busybox to addons-467916
Normal Pulling 8m (x4 over 9m16s) kubelet Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
Warning Failed 8m (x4 over 9m16s) kubelet Failed to pull image "gcr.io/k8s-minikube/busybox:1.28.4-glibc": Error response from daemon: Head "https://gcr.io/v2/k8s-minikube/busybox/manifests/1.28.4-glibc": unauthorized: authentication failed
Warning Failed 8m (x4 over 9m16s) kubelet Error: ErrImagePull
Warning Failed 7m33s (x6 over 9m15s) kubelet Error: ImagePullBackOff
Normal BackOff 4m15s (x20 over 9m15s) kubelet Back-off pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
-- /stdout --
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-dlp7n" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-q6ltk" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-467916 describe pod busybox ingress-nginx-admission-create-dlp7n ingress-nginx-admission-patch-q6ltk: exit status 1
--- FAIL: TestAddons/parallel/Registry (73.52s)