=== RUN TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry
=== CONT TestAddons/parallel/Registry
addons_test.go:328: registry stabilized in 3.133137ms
addons_test.go:330: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-66c9cd494c-8c8sz" [48080209-95a2-4f92-83d3-4a339a6b1b54] Running
addons_test.go:330: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 6.107355039s
addons_test.go:333: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-fvmkn" [34be177b-c148-4a04-9275-afdde27c3678] Running
addons_test.go:333: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 6.003922871s
addons_test.go:338: (dbg) Run: kubectl --context addons-850577 delete po -l run=registry-test --now
addons_test.go:343: (dbg) Run: kubectl --context addons-850577 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:343: (dbg) Non-zero exit: kubectl --context addons-850577 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": exit status 1 (1m0.116407871s)
-- stdout --
pod "registry-test" deleted
-- /stdout --
** stderr **
error: timed out waiting for the condition
** /stderr **
addons_test.go:345: failed to hit registry.kube-system.svc.cluster.local. args "kubectl --context addons-850577 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c \"wget --spider -S http://registry.kube-system.svc.cluster.local\"" failed: exit status 1
addons_test.go:349: expected curl response be "HTTP/1.1 200", but got *pod "registry-test" deleted
*
addons_test.go:357: (dbg) Run: out/minikube-linux-arm64 -p addons-850577 ip
2024/09/20 18:08:41 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:386: (dbg) Run: out/minikube-linux-arm64 -p addons-850577 addons disable registry --alsologtostderr -v=1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======> post-mortem[TestAddons/parallel/Registry]: docker inspect <======
helpers_test.go:231: (dbg) Run: docker inspect addons-850577
helpers_test.go:235: (dbg) docker inspect addons-850577:
-- stdout --
[
{
"Id": "6831d4cd52379740c1979983bf2509960e33e6db9026aab499f3708dea800ac1",
"Created": "2024-09-20T17:55:23.535929527Z",
"Path": "/usr/local/bin/entrypoint",
"Args": [
"/sbin/init"
],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 283912,
"ExitCode": 0,
"Error": "",
"StartedAt": "2024-09-20T17:55:23.689798683Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:f8be4f9f9351784955e36c0e64d55ad19451839d9f6d0c057285eb8f9072963b",
"ResolvConfPath": "/var/lib/docker/containers/6831d4cd52379740c1979983bf2509960e33e6db9026aab499f3708dea800ac1/resolv.conf",
"HostnamePath": "/var/lib/docker/containers/6831d4cd52379740c1979983bf2509960e33e6db9026aab499f3708dea800ac1/hostname",
"HostsPath": "/var/lib/docker/containers/6831d4cd52379740c1979983bf2509960e33e6db9026aab499f3708dea800ac1/hosts",
"LogPath": "/var/lib/docker/containers/6831d4cd52379740c1979983bf2509960e33e6db9026aab499f3708dea800ac1/6831d4cd52379740c1979983bf2509960e33e6db9026aab499f3708dea800ac1-json.log",
"Name": "/addons-850577",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "unconfined",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"addons-850577:/var",
"/lib/modules:/lib/modules:ro"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "addons-850577",
"PortBindings": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": ""
}
]
},
"RestartPolicy": {
"Name": "no",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"ConsoleSize": [
0,
0
],
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": true,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": [
"seccomp=unconfined",
"apparmor=unconfined",
"label=disable"
],
"Tmpfs": {
"/run": "",
"/tmp": ""
},
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"Isolation": "",
"CpuShares": 0,
"Memory": 4194304000,
"NanoCpus": 2000000000,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": [],
"BlkioDeviceWriteBps": [],
"BlkioDeviceReadIOps": [],
"BlkioDeviceWriteIOps": [],
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"MemoryReservation": 0,
"MemorySwap": 8388608000,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": [],
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": null,
"ReadonlyPaths": null
},
"GraphDriver": {
"Data": {
"LowerDir": "/var/lib/docker/overlay2/729f67f266498943b8f444415b740dfdd56cc298487ffc0eb4fad30eaf8e314b-init/diff:/var/lib/docker/overlay2/1053aca897409668adcebf437baa1e9990e7187814591cd6c6cc447a037db101/diff",
"MergedDir": "/var/lib/docker/overlay2/729f67f266498943b8f444415b740dfdd56cc298487ffc0eb4fad30eaf8e314b/merged",
"UpperDir": "/var/lib/docker/overlay2/729f67f266498943b8f444415b740dfdd56cc298487ffc0eb4fad30eaf8e314b/diff",
"WorkDir": "/var/lib/docker/overlay2/729f67f266498943b8f444415b740dfdd56cc298487ffc0eb4fad30eaf8e314b/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "volume",
"Name": "addons-850577",
"Source": "/var/lib/docker/volumes/addons-850577/_data",
"Destination": "/var",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
},
{
"Type": "bind",
"Source": "/lib/modules",
"Destination": "/lib/modules",
"Mode": "ro",
"RW": false,
"Propagation": "rprivate"
}
],
"Config": {
"Hostname": "addons-850577",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"22/tcp": {},
"2376/tcp": {},
"32443/tcp": {},
"5000/tcp": {},
"8443/tcp": {}
},
"Tty": true,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"container=docker",
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4",
"Volumes": null,
"WorkingDir": "/",
"Entrypoint": [
"/usr/local/bin/entrypoint",
"/sbin/init"
],
"OnBuild": null,
"Labels": {
"created_by.minikube.sigs.k8s.io": "true",
"mode.minikube.sigs.k8s.io": "addons-850577",
"name.minikube.sigs.k8s.io": "addons-850577",
"role.minikube.sigs.k8s.io": ""
},
"StopSignal": "SIGRTMIN+3"
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "1dcc65f70edbe4c1f002bba608b1a90acbe5a780d8dc481d550464d5c74d0500",
"SandboxKey": "/var/run/docker/netns/1dcc65f70edb",
"Ports": {
"22/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33133"
}
],
"2376/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33134"
}
],
"32443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33137"
}
],
"5000/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33135"
}
],
"8443/tcp": [
{
"HostIp": "127.0.0.1",
"HostPort": "33136"
}
]
},
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "",
"Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "",
"IPPrefixLen": 0,
"IPv6Gateway": "",
"MacAddress": "",
"Networks": {
"addons-850577": {
"IPAMConfig": {
"IPv4Address": "192.168.49.2"
},
"Links": null,
"Aliases": null,
"MacAddress": "02:42:c0:a8:31:02",
"DriverOpts": null,
"NetworkID": "5c40dbc4ac9ee3f07f8108bcc1dafbc45dc8569431be99bf26417d20f03fcfe3",
"EndpointID": "4afefbeb0c72823b51c6a2b1c9a3a4be182585ba20287c118c0bf149489dc6dd",
"Gateway": "192.168.49.1",
"IPAddress": "192.168.49.2",
"IPPrefixLen": 24,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"DNSNames": [
"addons-850577",
"6831d4cd5237"
]
}
}
}
}
]
-- /stdout --
helpers_test.go:239: (dbg) Run: out/minikube-linux-arm64 status --format={{.Host}} -p addons-850577 -n addons-850577
helpers_test.go:244: <<< TestAddons/parallel/Registry FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======> post-mortem[TestAddons/parallel/Registry]: minikube logs <======
helpers_test.go:247: (dbg) Run: out/minikube-linux-arm64 -p addons-850577 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-850577 logs -n 25: (1.255033235s)
helpers_test.go:252: TestAddons/parallel/Registry logs:
-- stdout --
==> Audit <==
|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| Command | Args | Profile | User | Version | Start Time | End Time |
|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
| start | -o=json --download-only | download-only-997842 | jenkins | v1.34.0 | 20 Sep 24 17:54 UTC | |
| | -p download-only-997842 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.20.0 | | | | | |
| | --container-runtime=docker | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 20 Sep 24 17:54 UTC | 20 Sep 24 17:54 UTC |
| delete | -p download-only-997842 | download-only-997842 | jenkins | v1.34.0 | 20 Sep 24 17:54 UTC | 20 Sep 24 17:54 UTC |
| start | -o=json --download-only | download-only-348035 | jenkins | v1.34.0 | 20 Sep 24 17:54 UTC | |
| | -p download-only-348035 | | | | | |
| | --force --alsologtostderr | | | | | |
| | --kubernetes-version=v1.31.1 | | | | | |
| | --container-runtime=docker | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| delete | --all | minikube | jenkins | v1.34.0 | 20 Sep 24 17:54 UTC | 20 Sep 24 17:54 UTC |
| delete | -p download-only-348035 | download-only-348035 | jenkins | v1.34.0 | 20 Sep 24 17:54 UTC | 20 Sep 24 17:54 UTC |
| delete | -p download-only-997842 | download-only-997842 | jenkins | v1.34.0 | 20 Sep 24 17:54 UTC | 20 Sep 24 17:54 UTC |
| delete | -p download-only-348035 | download-only-348035 | jenkins | v1.34.0 | 20 Sep 24 17:54 UTC | 20 Sep 24 17:54 UTC |
| start | --download-only -p | download-docker-115951 | jenkins | v1.34.0 | 20 Sep 24 17:54 UTC | |
| | download-docker-115951 | | | | | |
| | --alsologtostderr | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| delete | -p download-docker-115951 | download-docker-115951 | jenkins | v1.34.0 | 20 Sep 24 17:54 UTC | 20 Sep 24 17:54 UTC |
| start | --download-only -p | binary-mirror-357659 | jenkins | v1.34.0 | 20 Sep 24 17:54 UTC | |
| | binary-mirror-357659 | | | | | |
| | --alsologtostderr | | | | | |
| | --binary-mirror | | | | | |
| | http://127.0.0.1:43129 | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| delete | -p binary-mirror-357659 | binary-mirror-357659 | jenkins | v1.34.0 | 20 Sep 24 17:54 UTC | 20 Sep 24 17:54 UTC |
| addons | enable dashboard -p | addons-850577 | jenkins | v1.34.0 | 20 Sep 24 17:54 UTC | |
| | addons-850577 | | | | | |
| addons | disable dashboard -p | addons-850577 | jenkins | v1.34.0 | 20 Sep 24 17:54 UTC | |
| | addons-850577 | | | | | |
| start | -p addons-850577 --wait=true | addons-850577 | jenkins | v1.34.0 | 20 Sep 24 17:54 UTC | 20 Sep 24 17:58 UTC |
| | --memory=4000 --alsologtostderr | | | | | |
| | --addons=registry | | | | | |
| | --addons=metrics-server | | | | | |
| | --addons=volumesnapshots | | | | | |
| | --addons=csi-hostpath-driver | | | | | |
| | --addons=gcp-auth | | | | | |
| | --addons=cloud-spanner | | | | | |
| | --addons=inspektor-gadget | | | | | |
| | --addons=storage-provisioner-rancher | | | | | |
| | --addons=nvidia-device-plugin | | | | | |
| | --addons=yakd --addons=volcano | | | | | |
| | --driver=docker | | | | | |
| | --container-runtime=docker | | | | | |
| | --addons=ingress | | | | | |
| | --addons=ingress-dns | | | | | |
| addons | addons-850577 addons disable | addons-850577 | jenkins | v1.34.0 | 20 Sep 24 17:59 UTC | 20 Sep 24 17:59 UTC |
| | volcano --alsologtostderr -v=1 | | | | | |
| addons | addons-850577 addons disable | addons-850577 | jenkins | v1.34.0 | 20 Sep 24 18:07 UTC | 20 Sep 24 18:07 UTC |
| | yakd --alsologtostderr -v=1 | | | | | |
| addons | addons-850577 addons | addons-850577 | jenkins | v1.34.0 | 20 Sep 24 18:08 UTC | 20 Sep 24 18:08 UTC |
| | disable csi-hostpath-driver | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | addons-850577 addons | addons-850577 | jenkins | v1.34.0 | 20 Sep 24 18:08 UTC | 20 Sep 24 18:08 UTC |
| | disable volumesnapshots | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| addons | disable nvidia-device-plugin | addons-850577 | jenkins | v1.34.0 | 20 Sep 24 18:08 UTC | 20 Sep 24 18:08 UTC |
| | -p addons-850577 | | | | | |
| ssh | addons-850577 ssh cat | addons-850577 | jenkins | v1.34.0 | 20 Sep 24 18:08 UTC | 20 Sep 24 18:08 UTC |
| | /opt/local-path-provisioner/pvc-f345ef47-0969-4cae-a23c-0960456ac5a9_default_test-pvc/file1 | | | | | |
| addons | addons-850577 addons disable | addons-850577 | jenkins | v1.34.0 | 20 Sep 24 18:08 UTC | |
| | storage-provisioner-rancher | | | | | |
| | --alsologtostderr -v=1 | | | | | |
| ip | addons-850577 ip | addons-850577 | jenkins | v1.34.0 | 20 Sep 24 18:08 UTC | 20 Sep 24 18:08 UTC |
| addons | addons-850577 addons disable | addons-850577 | jenkins | v1.34.0 | 20 Sep 24 18:08 UTC | 20 Sep 24 18:08 UTC |
| | registry --alsologtostderr | | | | | |
| | -v=1 | | | | | |
|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
==> Last Start <==
Log file created at: 2024/09/20 17:54:58
Running on machine: ip-172-31-21-244
Binary: Built with gc go1.23.0 for linux/arm64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0920 17:54:58.723268 283424 out.go:345] Setting OutFile to fd 1 ...
I0920 17:54:58.723629 283424 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 17:54:58.723645 283424 out.go:358] Setting ErrFile to fd 2...
I0920 17:54:58.723652 283424 out.go:392] TERM=,COLORTERM=, which probably does not support color
I0920 17:54:58.723968 283424 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19679-277267/.minikube/bin
I0920 17:54:58.724499 283424 out.go:352] Setting JSON to false
I0920 17:54:58.725438 283424 start.go:129] hostinfo: {"hostname":"ip-172-31-21-244","uptime":5848,"bootTime":1726849051,"procs":148,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}
I0920 17:54:58.725513 283424 start.go:139] virtualization:
I0920 17:54:58.727323 283424 out.go:177] * [addons-850577] minikube v1.34.0 on Ubuntu 20.04 (arm64)
I0920 17:54:58.728744 283424 out.go:177] - MINIKUBE_LOCATION=19679
I0920 17:54:58.728873 283424 notify.go:220] Checking for updates...
I0920 17:54:58.731152 283424 out.go:177] - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0920 17:54:58.732464 283424 out.go:177] - KUBECONFIG=/home/jenkins/minikube-integration/19679-277267/kubeconfig
I0920 17:54:58.733712 283424 out.go:177] - MINIKUBE_HOME=/home/jenkins/minikube-integration/19679-277267/.minikube
I0920 17:54:58.734811 283424 out.go:177] - MINIKUBE_BIN=out/minikube-linux-arm64
I0920 17:54:58.735864 283424 out.go:177] - MINIKUBE_FORCE_SYSTEMD=
I0920 17:54:58.737280 283424 driver.go:394] Setting default libvirt URI to qemu:///system
I0920 17:54:58.759469 283424 docker.go:123] docker version: linux-27.3.0:Docker Engine - Community
I0920 17:54:58.759613 283424 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0920 17:54:58.832410 283424 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-20 17:54:58.822442379 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:a
arch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: brid
ge-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.6]] Warnings:<nil>}}
I0920 17:54:58.832527 283424 docker.go:318] overlay module found
I0920 17:54:58.834064 283424 out.go:177] * Using the docker driver based on user configuration
I0920 17:54:58.835296 283424 start.go:297] selected driver: docker
I0920 17:54:58.835313 283424 start.go:901] validating driver "docker" against <nil>
I0920 17:54:58.835326 283424 start.go:912] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0920 17:54:58.836052 283424 cli_runner.go:164] Run: docker system info --format "{{json .}}"
I0920 17:54:58.893549 283424 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:false BridgeNfIP6Tables:false Debug:false NFd:25 OomKillDisable:true NGoroutines:44 SystemTime:2024-09-20 17:54:58.88278022 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1070-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:aa
rch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8214835200 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:27.3.0 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c Expected:7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c} RuncCommit:{ID:v1.1.14-0-g2c9f560 Expected:v1.1.14-0-g2c9f560} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:[WARNING: bridg
e-nf-call-iptables is disabled WARNING: bridge-nf-call-ip6tables is disabled] ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.17.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.29.6]] Warnings:<nil>}}
I0920 17:54:58.893759 283424 start_flags.go:310] no existing cluster config was found, will generate one from the flags
I0920 17:54:58.894068 283424 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0920 17:54:58.895495 283424 out.go:177] * Using Docker driver with root privileges
I0920 17:54:58.896775 283424 cni.go:84] Creating CNI manager for ""
I0920 17:54:58.896895 283424 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0920 17:54:58.896916 283424 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
I0920 17:54:58.897013 283424 start.go:340] cluster config:
{Name:addons-850577 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-850577 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock:
SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0920 17:54:58.898571 283424 out.go:177] * Starting "addons-850577" primary control-plane node in "addons-850577" cluster
I0920 17:54:58.899878 283424 cache.go:121] Beginning downloading kic base image for docker with docker
I0920 17:54:58.901198 283424 out.go:177] * Pulling base image v0.0.45-1726589491-19662 ...
I0920 17:54:58.902965 283424 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker
I0920 17:54:58.903052 283424 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19679-277267/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4
I0920 17:54:58.903070 283424 cache.go:56] Caching tarball of preloaded images
I0920 17:54:58.903049 283424 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 in local docker daemon
I0920 17:54:58.903203 283424 preload.go:172] Found /home/jenkins/minikube-integration/19679-277267/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4 in cache, skipping download
I0920 17:54:58.903215 283424 cache.go:59] Finished verifying existence of preloaded tar for v1.31.1 on docker
I0920 17:54:58.903650 283424 profile.go:143] Saving config to /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/config.json ...
I0920 17:54:58.903697 283424 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/config.json: {Name:mk4073299def46734232b028ed2a0aef8d8bb2a6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 17:54:58.924479 283424 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 to local cache
I0920 17:54:58.924610 283424 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 in local cache directory
I0920 17:54:58.924629 283424 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 in local cache directory, skipping pull
I0920 17:54:58.924634 283424 image.go:135] gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 exists in cache, skipping pull
I0920 17:54:58.924642 283424 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 as a tarball
I0920 17:54:58.924647 283424 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 from local cache
I0920 17:55:16.638580 283424 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 from cached tarball
I0920 17:55:16.638620 283424 cache.go:194] Successfully downloaded all kic artifacts
I0920 17:55:16.638653 283424 start.go:360] acquireMachinesLock for addons-850577: {Name:mk3e3f602b855e8d1b162612e49c9b4462386ec4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0920 17:55:16.638802 283424 start.go:364] duration metric: took 123.468µs to acquireMachinesLock for "addons-850577"
I0920 17:55:16.638835 283424 start.go:93] Provisioning new machine with config: &{Name:addons-850577 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-850577 Namespace:default APIServerHAVIP: APIServerName:min
ikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false Cust
omQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0920 17:55:16.638914 283424 start.go:125] createHost starting for "" (driver="docker")
I0920 17:55:16.640684 283424 out.go:235] * Creating docker container (CPUs=2, Memory=4000MB) ...
I0920 17:55:16.640967 283424 start.go:159] libmachine.API.Create for "addons-850577" (driver="docker")
I0920 17:55:16.641007 283424 client.go:168] LocalClient.Create starting
I0920 17:55:16.641142 283424 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19679-277267/.minikube/certs/ca.pem
I0920 17:55:17.135430 283424 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19679-277267/.minikube/certs/cert.pem
I0920 17:55:17.562068 283424 cli_runner.go:164] Run: docker network inspect addons-850577 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
W0920 17:55:17.575800 283424 cli_runner.go:211] docker network inspect addons-850577 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
I0920 17:55:17.575891 283424 network_create.go:284] running [docker network inspect addons-850577] to gather additional debugging logs...
I0920 17:55:17.575912 283424 cli_runner.go:164] Run: docker network inspect addons-850577
W0920 17:55:17.591264 283424 cli_runner.go:211] docker network inspect addons-850577 returned with exit code 1
I0920 17:55:17.591303 283424 network_create.go:287] error running [docker network inspect addons-850577]: docker network inspect addons-850577: exit status 1
stdout:
[]
stderr:
Error response from daemon: network addons-850577 not found
I0920 17:55:17.591318 283424 network_create.go:289] output of [docker network inspect addons-850577]: -- stdout --
[]
-- /stdout --
** stderr **
Error response from daemon: network addons-850577 not found
** /stderr **
I0920 17:55:17.591443 283424 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0920 17:55:17.606707 283424 network.go:206] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x4001897080}
I0920 17:55:17.606760 283424 network_create.go:124] attempt to create docker network addons-850577 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
I0920 17:55:17.606824 283424 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-850577 addons-850577
I0920 17:55:17.677415 283424 network_create.go:108] docker network addons-850577 192.168.49.0/24 created
I0920 17:55:17.677445 283424 kic.go:121] calculated static IP "192.168.49.2" for the "addons-850577" container
I0920 17:55:17.677524 283424 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
I0920 17:55:17.690965 283424 cli_runner.go:164] Run: docker volume create addons-850577 --label name.minikube.sigs.k8s.io=addons-850577 --label created_by.minikube.sigs.k8s.io=true
I0920 17:55:17.706912 283424 oci.go:103] Successfully created a docker volume addons-850577
I0920 17:55:17.707006 283424 cli_runner.go:164] Run: docker run --rm --name addons-850577-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-850577 --entrypoint /usr/bin/test -v addons-850577:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 -d /var/lib
I0920 17:55:19.750457 283424 cli_runner.go:217] Completed: docker run --rm --name addons-850577-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-850577 --entrypoint /usr/bin/test -v addons-850577:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 -d /var/lib: (2.043405251s)
I0920 17:55:19.750488 283424 oci.go:107] Successfully prepared a docker volume addons-850577
I0920 17:55:19.750505 283424 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker
I0920 17:55:19.750526 283424 kic.go:194] Starting extracting preloaded images to volume ...
I0920 17:55:19.750593 283424 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19679-277267/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-850577:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 -I lz4 -xf /preloaded.tar -C /extractDir
I0920 17:55:23.470695 283424 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/19679-277267/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.1-docker-overlay2-arm64.tar.lz4:/preloaded.tar:ro -v addons-850577:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 -I lz4 -xf /preloaded.tar -C /extractDir: (3.720059067s)
I0920 17:55:23.470725 283424 kic.go:203] duration metric: took 3.720196788s to extract preloaded images to volume ...
W0920 17:55:23.470870 283424 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
I0920 17:55:23.470975 283424 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
I0920 17:55:23.521380 283424 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-850577 --name addons-850577 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-850577 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-850577 --network addons-850577 --ip 192.168.49.2 --volume addons-850577:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4
I0920 17:55:23.856455 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Running}}
I0920 17:55:23.877678 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:23.900786 283424 cli_runner.go:164] Run: docker exec addons-850577 stat /var/lib/dpkg/alternatives/iptables
I0920 17:55:23.964677 283424 oci.go:144] the created container "addons-850577" has a running status.
I0920 17:55:23.964736 283424 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa...
I0920 17:55:25.195417 283424 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
I0920 17:55:25.217510 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:25.235713 283424 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
I0920 17:55:25.235736 283424 kic_runner.go:114] Args: [docker exec --privileged addons-850577 chown docker:docker /home/docker/.ssh/authorized_keys]
I0920 17:55:25.293288 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:25.312253 283424 machine.go:93] provisionDockerMachine start ...
I0920 17:55:25.312364 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:25.330096 283424 main.go:141] libmachine: Using SSH client type: native
I0920 17:55:25.330374 283424 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I0920 17:55:25.330391 283424 main.go:141] libmachine: About to run SSH command:
hostname
I0920 17:55:25.480270 283424 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-850577
I0920 17:55:25.480295 283424 ubuntu.go:169] provisioning hostname "addons-850577"
I0920 17:55:25.480360 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:25.497811 283424 main.go:141] libmachine: Using SSH client type: native
I0920 17:55:25.498086 283424 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I0920 17:55:25.498104 283424 main.go:141] libmachine: About to run SSH command:
sudo hostname addons-850577 && echo "addons-850577" | sudo tee /etc/hostname
I0920 17:55:25.657449 283424 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-850577
I0920 17:55:25.657537 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:25.677195 283424 main.go:141] libmachine: Using SSH client type: native
I0920 17:55:25.677533 283424 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I0920 17:55:25.677558 283424 main.go:141] libmachine: About to run SSH command:
if ! grep -xq '.*\saddons-850577' /etc/hosts; then
if grep -xq '127.0.1.1\s.*' /etc/hosts; then
sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-850577/g' /etc/hosts;
else
echo '127.0.1.1 addons-850577' | sudo tee -a /etc/hosts;
fi
fi
I0920 17:55:25.825170 283424 main.go:141] libmachine: SSH cmd err, output: <nil>:
I0920 17:55:25.825204 283424 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/19679-277267/.minikube CaCertPath:/home/jenkins/minikube-integration/19679-277267/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19679-277267/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19679-277267/.minikube}
I0920 17:55:25.825234 283424 ubuntu.go:177] setting up certificates
I0920 17:55:25.825244 283424 provision.go:84] configureAuth start
I0920 17:55:25.825317 283424 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-850577
I0920 17:55:25.847886 283424 provision.go:143] copyHostCerts
I0920 17:55:25.848134 283424 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19679-277267/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19679-277267/.minikube/cert.pem (1123 bytes)
I0920 17:55:25.848320 283424 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19679-277267/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19679-277267/.minikube/key.pem (1675 bytes)
I0920 17:55:25.848572 283424 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19679-277267/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19679-277267/.minikube/ca.pem (1082 bytes)
I0920 17:55:25.848669 283424 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19679-277267/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19679-277267/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19679-277267/.minikube/certs/ca-key.pem org=jenkins.addons-850577 san=[127.0.0.1 192.168.49.2 addons-850577 localhost minikube]
I0920 17:55:26.306971 283424 provision.go:177] copyRemoteCerts
I0920 17:55:26.307047 283424 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
I0920 17:55:26.307090 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:26.328103 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:55:26.433669 283424 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-277267/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)
I0920 17:55:26.460527 283424 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-277267/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
I0920 17:55:26.485915 283424 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-277267/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)
I0920 17:55:26.510584 283424 provision.go:87] duration metric: took 685.321652ms to configureAuth
I0920 17:55:26.510613 283424 ubuntu.go:193] setting minikube options for container-runtime
I0920 17:55:26.510835 283424 config.go:182] Loaded profile config "addons-850577": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.1
I0920 17:55:26.510896 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:26.527583 283424 main.go:141] libmachine: Using SSH client type: native
I0920 17:55:26.527828 283424 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I0920 17:55:26.527846 283424 main.go:141] libmachine: About to run SSH command:
df --output=fstype / | tail -n 1
I0920 17:55:26.673314 283424 main.go:141] libmachine: SSH cmd err, output: <nil>: overlay
I0920 17:55:26.673336 283424 ubuntu.go:71] root file system type: overlay
I0920 17:55:26.673450 283424 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...
I0920 17:55:26.673522 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:26.690999 283424 main.go:141] libmachine: Using SSH client type: native
I0920 17:55:26.691248 283424 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I0920 17:55:26.691332 283424 main.go:141] libmachine: About to run SSH command:
sudo mkdir -p /lib/systemd/system && printf %s "[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP \$MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
" | sudo tee /lib/systemd/system/docker.service.new
I0920 17:55:26.848803 283424 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
BindsTo=containerd.service
After=network-online.target firewalld.service containerd.service
Wants=network-online.target
Requires=docker.socket
StartLimitBurst=3
StartLimitIntervalSec=60
[Service]
Type=notify
Restart=on-failure
# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
# The base configuration already specifies an 'ExecStart=...' command. The first directive
# here is to clear out that command inherited from the base configuration. Without this,
# the command from the base configuration and the command specified here are treated as
# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
# will catch this invalid input and refuse to start the service with an error like:
# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
ExecStart=
ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
# Uncomment TasksMax if your systemd version supports it.
# Only systemd 226 and above support this version.
TasksMax=infinity
TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
[Install]
WantedBy=multi-user.target
I0920 17:55:26.848901 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:26.866715 283424 main.go:141] libmachine: Using SSH client type: native
I0920 17:55:26.866961 283424 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x413650] 0x415e90 <nil> [] 0s} 127.0.0.1 33133 <nil> <nil>}
I0920 17:55:26.866984 283424 main.go:141] libmachine: About to run SSH command:
sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }
I0920 17:55:27.710613 283424 main.go:141] libmachine: SSH cmd err, output: <nil>: --- /lib/systemd/system/docker.service 2024-09-06 12:06:36.000000000 +0000
+++ /lib/systemd/system/docker.service.new 2024-09-20 17:55:26.842727010 +0000
@@ -1,46 +1,49 @@
[Unit]
Description=Docker Application Container Engine
Documentation=https://docs.docker.com
-After=network-online.target docker.socket firewalld.service containerd.service time-set.target
-Wants=network-online.target containerd.service
+BindsTo=containerd.service
+After=network-online.target firewalld.service containerd.service
+Wants=network-online.target
Requires=docker.socket
+StartLimitBurst=3
+StartLimitIntervalSec=60
[Service]
Type=notify
-# the default is not to use systemd for cgroups because the delegate issues still
-# exists and systemd currently does not support the cgroup feature set required
-# for containers run by docker
-ExecStart=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
-ExecReload=/bin/kill -s HUP $MAINPID
-TimeoutStartSec=0
-RestartSec=2
-Restart=always
+Restart=on-failure
-# Note that StartLimit* options were moved from "Service" to "Unit" in systemd 229.
-# Both the old, and new location are accepted by systemd 229 and up, so using the old location
-# to make them work for either version of systemd.
-StartLimitBurst=3
-# Note that StartLimitInterval was renamed to StartLimitIntervalSec in systemd 230.
-# Both the old, and new name are accepted by systemd 230 and up, so using the old name to make
-# this option work for either version of systemd.
-StartLimitInterval=60s
+
+# This file is a systemd drop-in unit that inherits from the base dockerd configuration.
+# The base configuration already specifies an 'ExecStart=...' command. The first directive
+# here is to clear out that command inherited from the base configuration. Without this,
+# the command from the base configuration and the command specified here are treated as
+# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd
+# will catch this invalid input and refuse to start the service with an error like:
+# Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.
+
+# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other
+# container runtimes. If left unlimited, it may result in OOM issues with MySQL.
+ExecStart=
+ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=docker --insecure-registry 10.96.0.0/12
+ExecReload=/bin/kill -s HUP $MAINPID
# Having non-zero Limit*s causes performance problems due to accounting overhead
# in the kernel. We recommend using cgroups to do container-local accounting.
+LimitNOFILE=infinity
LimitNPROC=infinity
LimitCORE=infinity
-# Comment TasksMax if your systemd version does not support it.
-# Only systemd 226 and above support this option.
+# Uncomment TasksMax if your systemd version supports it.
+# Only systemd 226 and above support this version.
TasksMax=infinity
+TimeoutStartSec=0
# set delegate yes so that systemd does not reset the cgroups of docker containers
Delegate=yes
# kill only the docker process, not all processes in the cgroup
KillMode=process
-OOMScoreAdjust=-500
[Install]
WantedBy=multi-user.target
Synchronizing state of docker.service with SysV service script with /lib/systemd/systemd-sysv-install.
Executing: /lib/systemd/systemd-sysv-install enable docker
I0920 17:55:27.710661 283424 machine.go:96] duration metric: took 2.398378608s to provisionDockerMachine
I0920 17:55:27.710674 283424 client.go:171] duration metric: took 11.069657045s to LocalClient.Create
I0920 17:55:27.710693 283424 start.go:167] duration metric: took 11.069726903s to libmachine.API.Create "addons-850577"
I0920 17:55:27.710706 283424 start.go:293] postStartSetup for "addons-850577" (driver="docker")
I0920 17:55:27.710718 283424 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
I0920 17:55:27.710793 283424 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
I0920 17:55:27.710850 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:27.732075 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:55:27.834183 283424 ssh_runner.go:195] Run: cat /etc/os-release
I0920 17:55:27.837786 283424 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
I0920 17:55:27.837829 283424 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
I0920 17:55:27.837844 283424 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
I0920 17:55:27.837852 283424 info.go:137] Remote host: Ubuntu 22.04.5 LTS
I0920 17:55:27.837867 283424 filesync.go:126] Scanning /home/jenkins/minikube-integration/19679-277267/.minikube/addons for local assets ...
I0920 17:55:27.837944 283424 filesync.go:126] Scanning /home/jenkins/minikube-integration/19679-277267/.minikube/files for local assets ...
I0920 17:55:27.837971 283424 start.go:296] duration metric: took 127.258595ms for postStartSetup
I0920 17:55:27.838316 283424 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-850577
I0920 17:55:27.857310 283424 profile.go:143] Saving config to /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/config.json ...
I0920 17:55:27.857686 283424 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I0920 17:55:27.857746 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:27.874224 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:55:27.973732 283424 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
I0920 17:55:27.978336 283424 start.go:128] duration metric: took 11.339404514s to createHost
I0920 17:55:27.978366 283424 start.go:83] releasing machines lock for "addons-850577", held for 11.33954943s
I0920 17:55:27.978448 283424 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-850577
I0920 17:55:27.995528 283424 ssh_runner.go:195] Run: cat /version.json
I0920 17:55:27.995586 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:27.995839 283424 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
I0920 17:55:27.995908 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:28.019116 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:55:28.035722 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:55:28.125295 283424 ssh_runner.go:195] Run: systemctl --version
I0920 17:55:28.263424 283424 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
I0920 17:55:28.268032 283424 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "grep -q loopback {} && ( grep -q name {} || sudo sed -i '/"type": "loopback"/i \ \ \ \ "name": "loopback",' {} ) && sudo sed -i 's|"cniVersion": ".*"|"cniVersion": "1.0.0"|g' {}" ;
I0920 17:55:28.294078 283424 cni.go:230] loopback cni configuration patched: "/etc/cni/net.d/*loopback.conf*" found
I0920 17:55:28.294163 283424 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;
I0920 17:55:28.325010 283424 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
I0920 17:55:28.325043 283424 start.go:495] detecting cgroup driver to use...
I0920 17:55:28.325078 283424 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0920 17:55:28.325191 283424 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock
" | sudo tee /etc/crictl.yaml"
I0920 17:55:28.341925 283424 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.10"|' /etc/containerd/config.toml"
I0920 17:55:28.351993 283424 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"
I0920 17:55:28.362058 283424 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...
I0920 17:55:28.362198 283424 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"
I0920 17:55:28.372257 283424 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0920 17:55:28.382929 283424 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"
I0920 17:55:28.393548 283424 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"
I0920 17:55:28.403726 283424 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
I0920 17:55:28.413421 283424 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"
I0920 17:55:28.423194 283424 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"
I0920 17:55:28.432866 283424 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1 enable_unprivileged_ports = true|' /etc/containerd/config.toml"
I0920 17:55:28.442902 283424 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
I0920 17:55:28.451597 283424 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
I0920 17:55:28.460219 283424 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 17:55:28.583359 283424 ssh_runner.go:195] Run: sudo systemctl restart containerd
I0920 17:55:28.698215 283424 start.go:495] detecting cgroup driver to use...
I0920 17:55:28.698328 283424 detect.go:187] detected "cgroupfs" cgroup driver on host os
I0920 17:55:28.698420 283424 ssh_runner.go:195] Run: sudo systemctl cat docker.service
I0920 17:55:28.720453 283424 cruntime.go:279] skipping containerd shutdown because we are bound to it
I0920 17:55:28.720582 283424 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio
I0920 17:55:28.732836 283424 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock
" | sudo tee /etc/crictl.yaml"
I0920 17:55:28.749667 283424 ssh_runner.go:195] Run: which cri-dockerd
I0920 17:55:28.753639 283424 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d
I0920 17:55:28.762678 283424 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (190 bytes)
I0920 17:55:28.786361 283424 ssh_runner.go:195] Run: sudo systemctl unmask docker.service
I0920 17:55:28.896207 283424 ssh_runner.go:195] Run: sudo systemctl enable docker.socket
I0920 17:55:28.998600 283424 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...
I0920 17:55:28.998744 283424 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)
I0920 17:55:29.020841 283424 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 17:55:29.119701 283424 ssh_runner.go:195] Run: sudo systemctl restart docker
I0920 17:55:29.396995 283424 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket
I0920 17:55:29.410098 283424 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0920 17:55:29.422737 283424 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket
I0920 17:55:29.507156 283424 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket
I0920 17:55:29.591807 283424 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 17:55:29.679043 283424 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket
I0920 17:55:29.695443 283424 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service
I0920 17:55:29.707985 283424 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 17:55:29.803108 283424 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service
I0920 17:55:29.877305 283424 start.go:542] Will wait 60s for socket path /var/run/cri-dockerd.sock
I0920 17:55:29.877464 283424 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock
I0920 17:55:29.881559 283424 start.go:563] Will wait 60s for crictl version
I0920 17:55:29.881672 283424 ssh_runner.go:195] Run: which crictl
I0920 17:55:29.885811 283424 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
I0920 17:55:29.925407 283424 start.go:579] Version: 0.1.0
RuntimeName: docker
RuntimeVersion: 27.2.1
RuntimeApiVersion: v1
I0920 17:55:29.925555 283424 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0920 17:55:29.957360 283424 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}
I0920 17:55:29.985364 283424 out.go:235] * Preparing Kubernetes v1.31.1 on Docker 27.2.1 ...
I0920 17:55:29.985556 283424 cli_runner.go:164] Run: docker network inspect addons-850577 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
I0920 17:55:30.001772 283424 ssh_runner.go:195] Run: grep 192.168.49.1 host.minikube.internal$ /etc/hosts
I0920 17:55:30.019549 283424 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1 host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0920 17:55:30.054883 283424 kubeadm.go:883] updating cluster {Name:addons-850577 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-850577 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNa
mes:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuF
irmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...
I0920 17:55:30.055020 283424 preload.go:131] Checking if preload exists for k8s version v1.31.1 and runtime docker
I0920 17:55:30.055093 283424 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0920 17:55:30.095559 283424 docker.go:685] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.31.1
registry.k8s.io/kube-controller-manager:v1.31.1
registry.k8s.io/kube-scheduler:v1.31.1
registry.k8s.io/kube-proxy:v1.31.1
registry.k8s.io/coredns/coredns:v1.11.3
registry.k8s.io/etcd:3.5.15-0
registry.k8s.io/pause:3.10
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0920 17:55:30.095907 283424 docker.go:615] Images already preloaded, skipping extraction
I0920 17:55:30.096073 283424 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}
I0920 17:55:30.121040 283424 docker.go:685] Got preloaded images: -- stdout --
registry.k8s.io/kube-apiserver:v1.31.1
registry.k8s.io/kube-controller-manager:v1.31.1
registry.k8s.io/kube-scheduler:v1.31.1
registry.k8s.io/kube-proxy:v1.31.1
registry.k8s.io/coredns/coredns:v1.11.3
registry.k8s.io/etcd:3.5.15-0
registry.k8s.io/pause:3.10
gcr.io/k8s-minikube/storage-provisioner:v5
-- /stdout --
I0920 17:55:30.121067 283424 cache_images.go:84] Images are preloaded, skipping loading
I0920 17:55:30.121085 283424 kubeadm.go:934] updating node { 192.168.49.2 8443 v1.31.1 docker true true} ...
I0920 17:55:30.121221 283424 kubeadm.go:946] kubelet [Unit]
Wants=docker.socket
[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.31.1/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-850577 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
[Install]
config:
{KubernetesVersion:v1.31.1 ClusterName:addons-850577 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}
I0920 17:55:30.121313 283424 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}
I0920 17:55:30.185211 283424 cni.go:84] Creating CNI manager for ""
I0920 17:55:30.185306 283424 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0920 17:55:30.185332 283424 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16
I0920 17:55:30.185386 283424 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.31.1 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-850577 NodeName:addons-850577 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuber
netes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
I0920 17:55:30.185604 283424 kubeadm.go:187] kubeadm config:
apiVersion: kubeadm.k8s.io/v1beta3
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.49.2
bindPort: 8443
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
ttl: 24h0m0s
usages:
- signing
- authentication
nodeRegistration:
criSocket: unix:///var/run/cri-dockerd.sock
name: "addons-850577"
kubeletExtraArgs:
node-ip: 192.168.49.2
taints: []
---
apiVersion: kubeadm.k8s.io/v1beta3
kind: ClusterConfiguration
apiServer:
certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
extraArgs:
enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
controllerManager:
extraArgs:
allocate-node-cidrs: "true"
leader-elect: "false"
scheduler:
extraArgs:
leader-elect: "false"
certificatesDir: /var/lib/minikube/certs
clusterName: mk
controlPlaneEndpoint: control-plane.minikube.internal:8443
etcd:
local:
dataDir: /var/lib/minikube/etcd
extraArgs:
proxy-refresh-interval: "70000"
kubernetesVersion: v1.31.1
networking:
dnsDomain: cluster.local
podSubnet: "10.244.0.0/16"
serviceSubnet: 10.96.0.0/12
---
apiVersion: kubelet.config.k8s.io/v1beta1
kind: KubeletConfiguration
authentication:
x509:
clientCAFile: /var/lib/minikube/certs/ca.crt
cgroupDriver: cgroupfs
containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock
hairpinMode: hairpin-veth
runtimeRequestTimeout: 15m
clusterDomain: "cluster.local"
# disable disk resource management by default
imageGCHighThresholdPercent: 100
evictionHard:
nodefs.available: "0%"
nodefs.inodesFree: "0%"
imagefs.available: "0%"
failSwapOn: false
staticPodPath: /etc/kubernetes/manifests
---
apiVersion: kubeproxy.config.k8s.io/v1alpha1
kind: KubeProxyConfiguration
clusterCIDR: "10.244.0.0/16"
metricsBindAddress: 0.0.0.0:10249
conntrack:
maxPerCore: 0
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
tcpEstablishedTimeout: 0s
# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
tcpCloseWaitTimeout: 0s
I0920 17:55:30.185758 283424 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.1
I0920 17:55:30.200010 283424 binaries.go:44] Found k8s binaries, skipping transfer
I0920 17:55:30.200096 283424 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
I0920 17:55:30.213078 283424 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (312 bytes)
I0920 17:55:30.244663 283424 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
I0920 17:55:30.267619 283424 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2155 bytes)
I0920 17:55:30.288458 283424 ssh_runner.go:195] Run: grep 192.168.49.2 control-plane.minikube.internal$ /etc/hosts
I0920 17:55:30.292579 283424 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2 control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
I0920 17:55:30.306197 283424 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 17:55:30.390711 283424 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0920 17:55:30.406854 283424 certs.go:68] Setting up /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577 for IP: 192.168.49.2
I0920 17:55:30.406876 283424 certs.go:194] generating shared ca certs ...
I0920 17:55:30.406893 283424 certs.go:226] acquiring lock for ca certs: {Name:mka5e3b330be08f0c494d71f47d44c93b5adf1f2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 17:55:30.407101 283424 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19679-277267/.minikube/ca.key
I0920 17:55:30.680821 283424 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19679-277267/.minikube/ca.crt ...
I0920 17:55:30.680858 283424 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-277267/.minikube/ca.crt: {Name:mk232667ea8e1ae46cd0055bb27f1cd24bdf1fc1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 17:55:30.681058 283424 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19679-277267/.minikube/ca.key ...
I0920 17:55:30.681074 283424 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-277267/.minikube/ca.key: {Name:mk245add7be79e96b8506c28e4b25c83a32dac0e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 17:55:30.681168 283424 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19679-277267/.minikube/proxy-client-ca.key
I0920 17:55:30.942534 283424 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19679-277267/.minikube/proxy-client-ca.crt ...
I0920 17:55:30.942563 283424 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-277267/.minikube/proxy-client-ca.crt: {Name:mk6aada32ca6adf9622cd81082857e6ee6e1851b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 17:55:30.942754 283424 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19679-277267/.minikube/proxy-client-ca.key ...
I0920 17:55:30.942767 283424 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-277267/.minikube/proxy-client-ca.key: {Name:mk11084c8c75bbe9fbcec781aa9e1ad698974469 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 17:55:30.942849 283424 certs.go:256] generating profile certs ...
I0920 17:55:30.942914 283424 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/client.key
I0920 17:55:30.942944 283424 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/client.crt with IP's: []
I0920 17:55:31.324932 283424 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/client.crt ...
I0920 17:55:31.324972 283424 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/client.crt: {Name:mk919ac99d4cc46156ef76a6cf7124a498f3cc28 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 17:55:31.325172 283424 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/client.key ...
I0920 17:55:31.325189 283424 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/client.key: {Name:mk650ec7e006168a21faf50e2badbab9bdc8c6ba Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 17:55:31.325319 283424 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/apiserver.key.8dc847fb
I0920 17:55:31.325342 283424 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/apiserver.crt.8dc847fb with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.49.2]
I0920 17:55:31.685192 283424 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/apiserver.crt.8dc847fb ...
I0920 17:55:31.685225 283424 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/apiserver.crt.8dc847fb: {Name:mk0eb5cd2f1dec3407223c93632a91891f3f1332 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 17:55:31.685418 283424 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/apiserver.key.8dc847fb ...
I0920 17:55:31.685433 283424 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/apiserver.key.8dc847fb: {Name:mk7a771ec10854e067e2c1ddf868e6d54efd8246 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 17:55:31.685527 283424 certs.go:381] copying /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/apiserver.crt.8dc847fb -> /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/apiserver.crt
I0920 17:55:31.685611 283424 certs.go:385] copying /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/apiserver.key.8dc847fb -> /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/apiserver.key
I0920 17:55:31.685670 283424 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/proxy-client.key
I0920 17:55:31.685690 283424 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/proxy-client.crt with IP's: []
I0920 17:55:32.108328 283424 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/proxy-client.crt ...
I0920 17:55:32.108362 283424 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/proxy-client.crt: {Name:mkec3c1f231202e321c9ffbbf4afe74b84f01d81 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 17:55:32.108542 283424 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/proxy-client.key ...
I0920 17:55:32.108556 283424 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/proxy-client.key: {Name:mk47071cc3a7e1e13296cb51c31b067ecc341f8a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 17:55:32.108801 283424 certs.go:484] found cert: /home/jenkins/minikube-integration/19679-277267/.minikube/certs/ca-key.pem (1679 bytes)
I0920 17:55:32.108844 283424 certs.go:484] found cert: /home/jenkins/minikube-integration/19679-277267/.minikube/certs/ca.pem (1082 bytes)
I0920 17:55:32.108875 283424 certs.go:484] found cert: /home/jenkins/minikube-integration/19679-277267/.minikube/certs/cert.pem (1123 bytes)
I0920 17:55:32.108904 283424 certs.go:484] found cert: /home/jenkins/minikube-integration/19679-277267/.minikube/certs/key.pem (1675 bytes)
I0920 17:55:32.109527 283424 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-277267/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
I0920 17:55:32.134215 283424 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-277267/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
I0920 17:55:32.160669 283424 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-277267/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
I0920 17:55:32.185522 283424 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-277267/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
I0920 17:55:32.210814 283424 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)
I0920 17:55:32.234718 283424 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
I0920 17:55:32.260345 283424 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
I0920 17:55:32.284779 283424 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-277267/.minikube/profiles/addons-850577/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
I0920 17:55:32.309684 283424 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19679-277267/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
I0920 17:55:32.334262 283424 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
I0920 17:55:32.352453 283424 ssh_runner.go:195] Run: openssl version
I0920 17:55:32.358543 283424 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
I0920 17:55:32.368306 283424 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
I0920 17:55:32.371809 283424 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Sep 20 17:55 /usr/share/ca-certificates/minikubeCA.pem
I0920 17:55:32.371880 283424 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
I0920 17:55:32.378847 283424 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
I0920 17:55:32.388732 283424 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt
I0920 17:55:32.392104 283424 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1
stdout:
stderr:
stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory
I0920 17:55:32.392194 283424 kubeadm.go:392] StartCluster: {Name:addons-850577 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1726589491-19662@sha256:6370b9fec173944088c2d87d44b01819c0ec611a83d9e2f38d36352dff8121a4 Memory:4000 CPUs:2 DiskSize:20000 Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.1 ClusterName:addons-850577 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames
:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirm
warePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0920 17:55:32.392323 283424 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}
I0920 17:55:32.409243 283424 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
I0920 17:55:32.417905 283424 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
I0920 17:55:32.428009 283424 kubeadm.go:214] ignoring SystemVerification for kubeadm because of docker driver
I0920 17:55:32.428084 283424 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
I0920 17:55:32.437352 283424 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
I0920 17:55:32.437374 283424 kubeadm.go:157] found existing configuration files:
I0920 17:55:32.437428 283424 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf
I0920 17:55:32.446277 283424 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/admin.conf: No such file or directory
I0920 17:55:32.446344 283424 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf
I0920 17:55:32.454921 283424 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf
I0920 17:55:32.463702 283424 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/kubelet.conf: No such file or directory
I0920 17:55:32.463769 283424 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf
I0920 17:55:32.473212 283424 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf
I0920 17:55:32.482098 283424 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/controller-manager.conf: No such file or directory
I0920 17:55:32.482220 283424 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf
I0920 17:55:32.491347 283424 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf
I0920 17:55:32.500657 283424 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2
stdout:
stderr:
grep: /etc/kubernetes/scheduler.conf: No such file or directory
I0920 17:55:32.500777 283424 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf
I0920 17:55:32.509132 283424 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.1:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
I0920 17:55:32.554897 283424 kubeadm.go:310] [init] Using Kubernetes version: v1.31.1
I0920 17:55:32.555244 283424 kubeadm.go:310] [preflight] Running pre-flight checks
I0920 17:55:32.576355 283424 kubeadm.go:310] [preflight] The system verification failed. Printing the output from the verification:
I0920 17:55:32.576441 283424 kubeadm.go:310] [0;37mKERNEL_VERSION[0m: [0;32m5.15.0-1070-aws[0m
I0920 17:55:32.576481 283424 kubeadm.go:310] [0;37mOS[0m: [0;32mLinux[0m
I0920 17:55:32.576540 283424 kubeadm.go:310] [0;37mCGROUPS_CPU[0m: [0;32menabled[0m
I0920 17:55:32.576600 283424 kubeadm.go:310] [0;37mCGROUPS_CPUACCT[0m: [0;32menabled[0m
I0920 17:55:32.576658 283424 kubeadm.go:310] [0;37mCGROUPS_CPUSET[0m: [0;32menabled[0m
I0920 17:55:32.576745 283424 kubeadm.go:310] [0;37mCGROUPS_DEVICES[0m: [0;32menabled[0m
I0920 17:55:32.576806 283424 kubeadm.go:310] [0;37mCGROUPS_FREEZER[0m: [0;32menabled[0m
I0920 17:55:32.576868 283424 kubeadm.go:310] [0;37mCGROUPS_MEMORY[0m: [0;32menabled[0m
I0920 17:55:32.576919 283424 kubeadm.go:310] [0;37mCGROUPS_PIDS[0m: [0;32menabled[0m
I0920 17:55:32.577000 283424 kubeadm.go:310] [0;37mCGROUPS_HUGETLB[0m: [0;32menabled[0m
I0920 17:55:32.577063 283424 kubeadm.go:310] [0;37mCGROUPS_BLKIO[0m: [0;32menabled[0m
I0920 17:55:32.655407 283424 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster
I0920 17:55:32.655617 283424 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection
I0920 17:55:32.655798 283424 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'
I0920 17:55:32.675479 283424 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"
I0920 17:55:32.681559 283424 out.go:235] - Generating certificates and keys ...
I0920 17:55:32.681673 283424 kubeadm.go:310] [certs] Using existing ca certificate authority
I0920 17:55:32.681747 283424 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk
I0920 17:55:32.918080 283424 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key
I0920 17:55:33.306698 283424 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key
I0920 17:55:33.461219 283424 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key
I0920 17:55:34.344336 283424 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key
I0920 17:55:34.701009 283424 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key
I0920 17:55:34.701322 283424 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-850577 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0920 17:55:35.122233 283424 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key
I0920 17:55:35.122567 283424 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-850577 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
I0920 17:55:35.889254 283424 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key
I0920 17:55:36.490090 283424 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key
I0920 17:55:36.751123 283424 kubeadm.go:310] [certs] Generating "sa" key and public key
I0920 17:55:36.751348 283424 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
I0920 17:55:37.380474 283424 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file
I0920 17:55:38.003291 283424 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file
I0920 17:55:38.901878 283424 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file
I0920 17:55:39.893023 283424 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
I0920 17:55:40.449455 283424 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file
I0920 17:55:40.450081 283424 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
I0920 17:55:40.453007 283424 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
I0920 17:55:40.456091 283424 out.go:235] - Booting up control plane ...
I0920 17:55:40.456191 283424 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"
I0920 17:55:40.456265 283424 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"
I0920 17:55:40.456332 283424 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"
I0920 17:55:40.467107 283424 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
I0920 17:55:40.472950 283424 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
I0920 17:55:40.473309 283424 kubeadm.go:310] [kubelet-start] Starting the kubelet
I0920 17:55:40.571454 283424 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"
I0920 17:55:40.571580 283424 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s
I0920 17:55:42.572914 283424 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 2.001796817s
I0920 17:55:42.573000 283424 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s
I0920 17:55:49.574299 283424 kubeadm.go:310] [api-check] The API server is healthy after 7.001392439s
I0920 17:55:49.597391 283424 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
I0920 17:55:49.612875 283424 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
I0920 17:55:49.644069 283424 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs
I0920 17:55:49.644532 283424 kubeadm.go:310] [mark-control-plane] Marking the node addons-850577 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
I0920 17:55:49.660272 283424 kubeadm.go:310] [bootstrap-token] Using token: gaa441.o297y6sembn5rifg
I0920 17:55:49.662908 283424 out.go:235] - Configuring RBAC rules ...
I0920 17:55:49.663053 283424 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
I0920 17:55:49.668367 283424 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
I0920 17:55:49.681235 283424 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
I0920 17:55:49.685562 283424 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
I0920 17:55:49.691694 283424 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
I0920 17:55:49.695955 283424 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
I0920 17:55:49.984601 283424 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
I0920 17:55:50.432940 283424 kubeadm.go:310] [addons] Applied essential addon: CoreDNS
I0920 17:55:50.981798 283424 kubeadm.go:310] [addons] Applied essential addon: kube-proxy
I0920 17:55:50.983249 283424 kubeadm.go:310]
I0920 17:55:50.983352 283424 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!
I0920 17:55:50.983395 283424 kubeadm.go:310]
I0920 17:55:50.983515 283424 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:
I0920 17:55:50.983527 283424 kubeadm.go:310]
I0920 17:55:50.983565 283424 kubeadm.go:310] mkdir -p $HOME/.kube
I0920 17:55:50.983636 283424 kubeadm.go:310] sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
I0920 17:55:50.983698 283424 kubeadm.go:310] sudo chown $(id -u):$(id -g) $HOME/.kube/config
I0920 17:55:50.983708 283424 kubeadm.go:310]
I0920 17:55:50.983789 283424 kubeadm.go:310] Alternatively, if you are the root user, you can run:
I0920 17:55:50.983808 283424 kubeadm.go:310]
I0920 17:55:50.983864 283424 kubeadm.go:310] export KUBECONFIG=/etc/kubernetes/admin.conf
I0920 17:55:50.983870 283424 kubeadm.go:310]
I0920 17:55:50.983933 283424 kubeadm.go:310] You should now deploy a pod network to the cluster.
I0920 17:55:50.984022 283424 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
I0920 17:55:50.984123 283424 kubeadm.go:310] https://kubernetes.io/docs/concepts/cluster-administration/addons/
I0920 17:55:50.984138 283424 kubeadm.go:310]
I0920 17:55:50.984236 283424 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities
I0920 17:55:50.984333 283424 kubeadm.go:310] and service account keys on each node and then running the following as root:
I0920 17:55:50.984343 283424 kubeadm.go:310]
I0920 17:55:50.984441 283424 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token gaa441.o297y6sembn5rifg \
I0920 17:55:50.984550 283424 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:dda7c38952bdad399beeb9e26a12c373a083486065b66df016dc0978329ffab7 \
I0920 17:55:50.984581 283424 kubeadm.go:310] --control-plane
I0920 17:55:50.984597 283424 kubeadm.go:310]
I0920 17:55:50.984723 283424 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:
I0920 17:55:50.984732 283424 kubeadm.go:310]
I0920 17:55:50.984815 283424 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token gaa441.o297y6sembn5rifg \
I0920 17:55:50.984924 283424 kubeadm.go:310] --discovery-token-ca-cert-hash sha256:dda7c38952bdad399beeb9e26a12c373a083486065b66df016dc0978329ffab7
I0920 17:55:50.988035 283424 kubeadm.go:310] W0920 17:55:32.550985 1815 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "ClusterConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0920 17:55:50.988341 283424 kubeadm.go:310] W0920 17:55:32.552189 1815 common.go:101] your configuration file uses a deprecated API spec: "kubeadm.k8s.io/v1beta3" (kind: "InitConfiguration"). Please use 'kubeadm config migrate --old-config old.yaml --new-config new.yaml', which will write the new, similar spec using a newer API version.
I0920 17:55:50.988562 283424 kubeadm.go:310] [WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1070-aws\n", err: exit status 1
I0920 17:55:50.988730 283424 kubeadm.go:310] [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
I0920 17:55:50.988754 283424 cni.go:84] Creating CNI manager for ""
I0920 17:55:50.988770 283424 cni.go:158] "docker" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0920 17:55:50.991814 283424 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...
I0920 17:55:50.994640 283424 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d
I0920 17:55:51.003466 283424 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)
I0920 17:55:51.027080 283424 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
I0920 17:55:51.027225 283424 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 17:55:51.027312 283424 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-850577 minikube.k8s.io/updated_at=2024_09_20T17_55_51_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=35d0eeb96573bd708dfd5c070da844e6f0fad78a minikube.k8s.io/name=addons-850577 minikube.k8s.io/primary=true
I0920 17:55:51.039840 283424 ops.go:34] apiserver oom_adj: -16
I0920 17:55:51.166407 283424 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 17:55:51.667334 283424 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 17:55:52.167156 283424 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 17:55:52.666789 283424 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 17:55:53.166462 283424 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 17:55:53.667265 283424 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 17:55:54.167126 283424 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 17:55:54.666591 283424 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 17:55:55.167367 283424 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 17:55:55.666506 283424 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.1/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
I0920 17:55:55.812270 283424 kubeadm.go:1113] duration metric: took 4.785096317s to wait for elevateKubeSystemPrivileges
I0920 17:55:55.812299 283424 kubeadm.go:394] duration metric: took 23.420109906s to StartCluster
I0920 17:55:55.812317 283424 settings.go:142] acquiring lock: {Name:mk09b32ff96b7671dba5302a8b6c59455cc8c936 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 17:55:55.812449 283424 settings.go:150] Updating kubeconfig: /home/jenkins/minikube-integration/19679-277267/kubeconfig
I0920 17:55:55.812889 283424 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19679-277267/kubeconfig: {Name:mk5af2d4931ad8cfafe47962fae060ea6c484f02 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0920 17:55:55.813108 283424 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.31.1 ContainerRuntime:docker ControlPlane:true Worker:true}
I0920 17:55:55.813256 283424 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
I0920 17:55:55.813516 283424 config.go:182] Loaded profile config "addons-850577": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.1
I0920 17:55:55.813547 283424 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]
I0920 17:55:55.813638 283424 addons.go:69] Setting yakd=true in profile "addons-850577"
I0920 17:55:55.813652 283424 addons.go:234] Setting addon yakd=true in "addons-850577"
I0920 17:55:55.813677 283424 host.go:66] Checking if "addons-850577" exists ...
I0920 17:55:55.814204 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:55.814724 283424 addons.go:69] Setting cloud-spanner=true in profile "addons-850577"
I0920 17:55:55.814751 283424 addons.go:234] Setting addon cloud-spanner=true in "addons-850577"
I0920 17:55:55.814753 283424 addons.go:69] Setting metrics-server=true in profile "addons-850577"
I0920 17:55:55.814769 283424 addons.go:234] Setting addon metrics-server=true in "addons-850577"
I0920 17:55:55.814792 283424 host.go:66] Checking if "addons-850577" exists ...
I0920 17:55:55.814799 283424 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-850577"
I0920 17:55:55.814828 283424 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-850577"
I0920 17:55:55.814845 283424 host.go:66] Checking if "addons-850577" exists ...
I0920 17:55:55.815247 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:55.815279 283424 addons.go:69] Setting volumesnapshots=true in profile "addons-850577"
I0920 17:55:55.815290 283424 addons.go:234] Setting addon volumesnapshots=true in "addons-850577"
I0920 17:55:55.815307 283424 host.go:66] Checking if "addons-850577" exists ...
I0920 17:55:55.815678 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:55.815252 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:55.826407 283424 addons.go:69] Setting default-storageclass=true in profile "addons-850577"
I0920 17:55:55.826441 283424 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-850577"
I0920 17:55:55.826573 283424 out.go:177] * Verifying Kubernetes components...
I0920 17:55:55.826766 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:55.837823 283424 addons.go:69] Setting gcp-auth=true in profile "addons-850577"
I0920 17:55:55.837861 283424 mustload.go:65] Loading cluster: addons-850577
I0920 17:55:55.838079 283424 config.go:182] Loaded profile config "addons-850577": Driver=docker, ContainerRuntime=docker, KubernetesVersion=v1.31.1
I0920 17:55:55.838342 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:55.841020 283424 ssh_runner.go:195] Run: sudo systemctl daemon-reload
I0920 17:55:55.856659 283424 out.go:177] - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
I0920 17:55:55.860183 283424 addons.go:69] Setting ingress=true in profile "addons-850577"
I0920 17:55:55.860235 283424 addons.go:234] Setting addon ingress=true in "addons-850577"
I0920 17:55:55.860313 283424 host.go:66] Checking if "addons-850577" exists ...
I0920 17:55:55.861193 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:55.866658 283424 out.go:177] - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
I0920 17:55:55.878310 283424 addons.go:69] Setting ingress-dns=true in profile "addons-850577"
I0920 17:55:55.878345 283424 addons.go:234] Setting addon ingress-dns=true in "addons-850577"
I0920 17:55:55.878390 283424 host.go:66] Checking if "addons-850577" exists ...
I0920 17:55:55.878882 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:55.896682 283424 addons.go:69] Setting inspektor-gadget=true in profile "addons-850577"
I0920 17:55:55.896798 283424 addons.go:234] Setting addon inspektor-gadget=true in "addons-850577"
I0920 17:55:55.896876 283424 host.go:66] Checking if "addons-850577" exists ...
I0920 17:55:55.906682 283424 out.go:177] - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
I0920 17:55:55.909776 283424 out.go:177] - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
I0920 17:55:55.814793 283424 host.go:66] Checking if "addons-850577" exists ...
I0920 17:55:55.913009 283424 out.go:177] - Using image docker.io/marcnuri/yakd:0.0.5
I0920 17:55:55.917125 283424 out.go:177] - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
I0920 17:55:55.917215 283424 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml
I0920 17:55:55.917225 283424 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
I0920 17:55:55.917296 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:55.918186 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:55.932794 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:55.815258 283424 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-850577"
I0920 17:55:55.933066 283424 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-850577"
I0920 17:55:55.933126 283424 host.go:66] Checking if "addons-850577" exists ...
I0920 17:55:55.933597 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:55.956843 283424 out.go:177] - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
I0920 17:55:55.958176 283424 out.go:177] - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
I0920 17:55:55.962129 283424 out.go:177] - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
I0920 17:55:55.962356 283424 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
I0920 17:55:55.962422 283424 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
I0920 17:55:55.962542 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:55.815269 283424 addons.go:69] Setting storage-provisioner=true in profile "addons-850577"
I0920 17:55:55.815272 283424 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-850577"
I0920 17:55:55.972413 283424 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-850577"
I0920 17:55:55.815275 283424 addons.go:69] Setting volcano=true in profile "addons-850577"
I0920 17:55:55.815263 283424 addons.go:69] Setting registry=true in profile "addons-850577"
I0920 17:55:55.972566 283424 addons.go:234] Setting addon registry=true in "addons-850577"
I0920 17:55:55.975229 283424 addons.go:234] Setting addon storage-provisioner=true in "addons-850577"
I0920 17:55:55.975296 283424 host.go:66] Checking if "addons-850577" exists ...
I0920 17:55:55.975971 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:55.979310 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:55.987411 283424 out.go:177] - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.24
I0920 17:55:55.987653 283424 addons.go:234] Setting addon volcano=true in "addons-850577"
I0920 17:55:55.987747 283424 out.go:177] - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
I0920 17:55:55.987777 283424 host.go:66] Checking if "addons-850577" exists ...
I0920 17:55:55.987760 283424 host.go:66] Checking if "addons-850577" exists ...
I0920 17:55:55.988846 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:55.989338 283424 host.go:66] Checking if "addons-850577" exists ...
I0920 17:55:56.001134 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:56.001353 283424 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml
I0920 17:55:56.036762 283424 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
I0920 17:55:56.036859 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:56.036539 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:55:56.001362 283424 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
I0920 17:55:56.052714 283424 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
I0920 17:55:56.052827 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:56.002972 283424 addons.go:234] Setting addon default-storageclass=true in "addons-850577"
I0920 17:55:56.065239 283424 host.go:66] Checking if "addons-850577" exists ...
I0920 17:55:56.065801 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:56.073232 283424 out.go:177] - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.32.0
I0920 17:55:56.073498 283424 out.go:177] - Using image registry.k8s.io/ingress-nginx/controller:v1.11.2
I0920 17:55:56.085078 283424 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0920 17:55:56.085339 283424 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml
I0920 17:55:56.085358 283424 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
I0920 17:55:56.085463 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:56.107168 283424 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0920 17:55:56.110242 283424 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml
I0920 17:55:56.110271 283424 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
I0920 17:55:56.110342 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:56.147385 283424 out.go:177] - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3
I0920 17:55:56.150514 283424 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
I0920 17:55:56.150547 283424 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
I0920 17:55:56.150615 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:56.211273 283424 out.go:177] - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2
I0920 17:55:56.214082 283424 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0920 17:55:56.214107 283424 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
I0920 17:55:56.214180 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:56.235854 283424 out.go:177] - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2
I0920 17:55:56.240078 283424 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml
I0920 17:55:56.240143 283424 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
I0920 17:55:56.240390 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:56.273373 283424 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-850577"
I0920 17:55:56.273415 283424 host.go:66] Checking if "addons-850577" exists ...
I0920 17:55:56.273853 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:55:56.293255 283424 out.go:177] - Using image gcr.io/k8s-minikube/storage-provisioner:v5
I0920 17:55:56.293389 283424 out.go:177] - Using image docker.io/volcanosh/vc-webhook-manager:v1.9.0
I0920 17:55:56.294100 283424 out.go:177] - Using image docker.io/registry:2.8.3
I0920 17:55:56.296120 283424 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml
I0920 17:55:56.296144 283424 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
I0920 17:55:56.296229 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:56.297746 283424 out.go:177] - Using image docker.io/volcanosh/vc-controller-manager:v1.9.0
I0920 17:55:56.300324 283424 out.go:177] - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6
I0920 17:55:56.303728 283424 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml
I0920 17:55:56.303770 283424 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)
I0920 17:55:56.303918 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:56.323504 283424 out.go:177] - Using image docker.io/volcanosh/vc-scheduler:v1.9.0
I0920 17:55:56.325244 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:55:56.330353 283424 addons.go:431] installing /etc/kubernetes/addons/volcano-deployment.yaml
I0920 17:55:56.330383 283424 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volcano-deployment.yaml (434001 bytes)
I0920 17:55:56.330458 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:56.386726 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:55:56.388141 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:55:56.391440 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:55:56.408746 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:55:56.409552 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:55:56.415237 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:55:56.420824 283424 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml
I0920 17:55:56.420847 283424 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
I0920 17:55:56.420913 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:56.473074 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:55:56.492780 283424 out.go:177] - Using image docker.io/rancher/local-path-provisioner:v0.0.22
I0920 17:55:56.498805 283424 out.go:177] - Using image docker.io/busybox:stable
I0920 17:55:56.504282 283424 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0920 17:55:56.504313 283424 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
I0920 17:55:56.504403 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:55:56.508638 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:55:56.517058 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:55:56.525919 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:55:56.530517 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:55:56.558539 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
W0920 17:55:56.559910 283424 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
I0920 17:55:56.559938 283424 retry.go:31] will retry after 373.163707ms: ssh: handshake failed: EOF
I0920 17:55:56.940830 283424 ssh_runner.go:235] Completed: sudo systemctl daemon-reload: (1.099726559s)
I0920 17:55:56.940948 283424 ssh_runner.go:195] Run: sudo systemctl start kubelet
I0920 17:55:56.941122 283424 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml": (1.127845258s)
I0920 17:55:56.941287 283424 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
I0920 17:55:56.959398 283424 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
I0920 17:55:56.992089 283424 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml
I0920 17:55:56.992172 283424 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
I0920 17:55:57.203822 283424 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
I0920 17:55:57.222139 283424 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
I0920 17:55:57.336016 283424 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
I0920 17:55:57.477823 283424 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
I0920 17:55:57.477896 283424 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
I0920 17:55:57.531344 283424 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml
I0920 17:55:57.531446 283424 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
I0920 17:55:57.582226 283424 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
I0920 17:55:57.582319 283424 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
I0920 17:55:57.593198 283424 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
I0920 17:55:57.608190 283424 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml
I0920 17:55:57.608274 283424 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
I0920 17:55:57.749630 283424 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
I0920 17:55:57.749728 283424 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
I0920 17:55:57.759026 283424 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml
I0920 17:55:57.759127 283424 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
I0920 17:55:57.788562 283424 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
I0920 17:55:57.872168 283424 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml
I0920 17:55:57.872247 283424 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
I0920 17:55:57.883324 283424 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml
I0920 17:55:57.888631 283424 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
I0920 17:55:57.888735 283424 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
I0920 17:55:57.914421 283424 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml
I0920 17:55:57.914456 283424 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
I0920 17:55:57.944389 283424 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
I0920 17:55:57.983658 283424 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
I0920 17:55:57.983692 283424 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
I0920 17:55:58.040837 283424 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml
I0920 17:55:58.040864 283424 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
I0920 17:55:58.090461 283424 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
I0920 17:55:58.090491 283424 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
I0920 17:55:58.127602 283424 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml
I0920 17:55:58.127628 283424 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
I0920 17:55:58.157868 283424 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
I0920 17:55:58.242956 283424 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
I0920 17:55:58.242987 283424 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
I0920 17:55:58.318756 283424 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml
I0920 17:55:58.318783 283424 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
I0920 17:55:58.337836 283424 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml
I0920 17:55:58.337861 283424 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
I0920 17:55:58.344488 283424 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
I0920 17:55:58.344514 283424 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
I0920 17:55:58.463752 283424 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml
I0920 17:55:58.463780 283424 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
I0920 17:55:58.479395 283424 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
I0920 17:55:58.479421 283424 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
I0920 17:55:58.517236 283424 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
I0920 17:55:58.576370 283424 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
I0920 17:55:58.576395 283424 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
I0920 17:55:58.580184 283424 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
I0920 17:55:58.580210 283424 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
I0920 17:55:58.647858 283424 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
I0920 17:55:58.742224 283424 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0920 17:55:58.742293 283424 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
I0920 17:55:58.776006 283424 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
I0920 17:55:58.776031 283424 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
I0920 17:55:58.895855 283424 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml
I0920 17:55:58.895880 283424 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
I0920 17:55:58.999484 283424 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0920 17:55:59.073319 283424 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
I0920 17:55:59.073343 283424 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
I0920 17:55:59.214768 283424 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^ forward . \/etc\/resolv.conf.*/i \ hosts {\n 192.168.49.1 host.minikube.internal\n fallthrough\n }' -e '/^ errors *$/i \ log' | sudo /var/lib/minikube/binaries/v1.31.1/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.273440122s)
I0920 17:55:59.214794 283424 start.go:971] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
I0920 17:55:59.215900 283424 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (2.274930545s)
I0920 17:55:59.216643 283424 node_ready.go:35] waiting up to 6m0s for node "addons-850577" to be "Ready" ...
I0920 17:55:59.221277 283424 node_ready.go:49] node "addons-850577" has status "Ready":"True"
I0920 17:55:59.221305 283424 node_ready.go:38] duration metric: took 4.635317ms for node "addons-850577" to be "Ready" ...
I0920 17:55:59.221315 283424 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0920 17:55:59.234497 283424 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml
I0920 17:55:59.234523 283424 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
I0920 17:55:59.240075 283424 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-7h69s" in "kube-system" namespace to be "Ready" ...
I0920 17:55:59.522658 283424 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
I0920 17:55:59.522687 283424 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
I0920 17:55:59.588333 283424 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
I0920 17:55:59.733892 283424 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-850577" context rescaled to 1 replicas
I0920 17:55:59.984278 283424 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
I0920 17:55:59.984372 283424 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
I0920 17:56:00.214208 283424 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
I0920 17:56:00.214297 283424 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
I0920 17:56:00.978623 283424 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0920 17:56:00.978767 283424 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
I0920 17:56:01.253705 283424 pod_ready.go:103] pod "coredns-7c65d6cfc9-7h69s" in "kube-system" namespace has status "Ready":"False"
I0920 17:56:01.816668 283424 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
I0920 17:56:01.919550 283424 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (4.960059634s)
I0920 17:56:02.104113 283424 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (4.900203791s)
I0920 17:56:02.104235 283424 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (4.881947673s)
I0920 17:56:02.104312 283424 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (4.768268714s)
I0920 17:56:03.038702 283424 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
I0920 17:56:03.038793 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:56:03.074156 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:56:03.747008 283424 pod_ready.go:103] pod "coredns-7c65d6cfc9-7h69s" in "kube-system" namespace has status "Ready":"False"
I0920 17:56:04.398322 283424 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
I0920 17:56:04.629794 283424 addons.go:234] Setting addon gcp-auth=true in "addons-850577"
I0920 17:56:04.629853 283424 host.go:66] Checking if "addons-850577" exists ...
I0920 17:56:04.630432 283424 cli_runner.go:164] Run: docker container inspect addons-850577 --format={{.State.Status}}
I0920 17:56:04.665261 283424 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
I0920 17:56:04.665323 283424 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-850577
I0920 17:56:04.702968 283424 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33133 SSHKeyPath:/home/jenkins/minikube-integration/19679-277267/.minikube/machines/addons-850577/id_rsa Username:docker}
I0920 17:56:06.246610 283424 pod_ready.go:103] pod "coredns-7c65d6cfc9-7h69s" in "kube-system" namespace has status "Ready":"False"
I0920 17:56:07.434612 283424 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (9.841311657s)
I0920 17:56:07.434645 283424 addons.go:475] Verifying addon ingress=true in "addons-850577"
I0920 17:56:07.434841 283424 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (9.646252144s)
I0920 17:56:07.440324 283424 out.go:177] * Verifying ingress addon...
I0920 17:56:07.443702 283424 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
I0920 17:56:07.448927 283424 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
I0920 17:56:07.448956 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:07.995705 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:08.274085 283424 pod_ready.go:103] pod "coredns-7c65d6cfc9-7h69s" in "kube-system" namespace has status "Ready":"False"
I0920 17:56:08.474627 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:08.959769 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:09.219975 283424 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (11.062077204s)
I0920 17:56:09.220009 283424 addons.go:475] Verifying addon registry=true in "addons-850577"
I0920 17:56:09.220114 283424 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (11.275493266s)
I0920 17:56:09.220441 283424 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (10.703173904s)
I0920 17:56:09.220530 283424 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (10.572643695s)
I0920 17:56:09.220545 283424 addons.go:475] Verifying addon metrics-server=true in "addons-850577"
I0920 17:56:09.220624 283424 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (10.221111254s)
W0920 17:56:09.220646 283424 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0920 17:56:09.220664 283424 retry.go:31] will retry after 368.784236ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
stdout:
customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
serviceaccount/snapshot-controller created
clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
deployment.apps/snapshot-controller created
stderr:
error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
ensure CRDs are installed first
I0920 17:56:09.220769 283424 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (9.632397263s)
I0920 17:56:09.220900 283424 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/volcano-deployment.yaml: (11.337501334s)
I0920 17:56:09.222938 283424 out.go:177] * Verifying registry addon...
I0920 17:56:09.224666 283424 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
minikube -p addons-850577 service yakd-dashboard -n yakd-dashboard
I0920 17:56:09.227520 283424 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
I0920 17:56:09.262971 283424 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
I0920 17:56:09.262995 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:09.468371 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:09.590449 283424 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
I0920 17:56:09.788859 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:09.952509 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:10.235618 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:10.276932 283424 pod_ready.go:103] pod "coredns-7c65d6cfc9-7h69s" in "kube-system" namespace has status "Ready":"False"
I0920 17:56:10.456584 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:10.480251 283424 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (8.66350606s)
I0920 17:56:10.480288 283424 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-850577"
I0920 17:56:10.480413 283424 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (5.815127127s)
I0920 17:56:10.485073 283424 out.go:177] - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.3
I0920 17:56:10.485146 283424 out.go:177] * Verifying csi-hostpath-driver addon...
I0920 17:56:10.488317 283424 out.go:177] - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2
I0920 17:56:10.489372 283424 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
I0920 17:56:10.491662 283424 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
I0920 17:56:10.491690 283424 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
I0920 17:56:10.557976 283424 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
I0920 17:56:10.558009 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:10.581505 283424 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml
I0920 17:56:10.581529 283424 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
I0920 17:56:10.642302 283424 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0920 17:56:10.642333 283424 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
I0920 17:56:10.731478 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:10.766566 283424 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
I0920 17:56:10.949640 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:10.998099 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:11.231797 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:11.449250 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:11.495283 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:11.732183 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:11.949475 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:11.994415 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:12.072258 283424 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.481758839s)
I0920 17:56:12.237138 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:12.341390 283424 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.1/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.574778489s)
I0920 17:56:12.344684 283424 addons.go:475] Verifying addon gcp-auth=true in "addons-850577"
I0920 17:56:12.349350 283424 out.go:177] * Verifying gcp-auth addon...
I0920 17:56:12.353106 283424 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
I0920 17:56:12.360346 283424 kapi.go:86] Found 0 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0920 17:56:12.461065 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:12.561824 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:12.732898 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:12.747730 283424 pod_ready.go:103] pod "coredns-7c65d6cfc9-7h69s" in "kube-system" namespace has status "Ready":"False"
I0920 17:56:12.948196 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:12.996514 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:13.231445 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:13.449079 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:13.494925 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:13.733269 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:13.948844 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:13.994957 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:14.232130 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:14.448971 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:14.495193 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:14.732157 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:14.949401 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:14.994952 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:15.232630 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:15.247409 283424 pod_ready.go:103] pod "coredns-7c65d6cfc9-7h69s" in "kube-system" namespace has status "Ready":"False"
I0920 17:56:15.447822 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:15.493955 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:15.731373 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:15.959107 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:15.994680 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:16.231621 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:16.448744 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:16.494669 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:16.731790 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:16.949607 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:16.995056 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:17.231889 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:17.448484 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:17.494836 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:17.732652 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:17.748859 283424 pod_ready.go:103] pod "coredns-7c65d6cfc9-7h69s" in "kube-system" namespace has status "Ready":"False"
I0920 17:56:17.948385 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:17.995278 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:18.231918 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:18.448653 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:18.494610 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:18.733063 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:18.948552 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:18.994375 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:19.233141 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:19.460393 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:19.563034 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:19.731826 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:19.948829 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:19.996587 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:20.232038 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:20.247172 283424 pod_ready.go:103] pod "coredns-7c65d6cfc9-7h69s" in "kube-system" namespace has status "Ready":"False"
I0920 17:56:20.448602 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:20.494183 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:20.731261 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:20.949482 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:20.995692 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:21.232073 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:21.450192 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:21.498852 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:21.732788 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:21.948759 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:21.995845 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:22.232190 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:22.449100 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:22.494475 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:22.732340 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:22.747173 283424 pod_ready.go:103] pod "coredns-7c65d6cfc9-7h69s" in "kube-system" namespace has status "Ready":"False"
I0920 17:56:22.947884 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:22.993975 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:23.232296 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:23.447954 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:23.494534 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:23.731764 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:23.948234 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:23.995370 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:24.231070 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:24.448652 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:24.494174 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:24.745192 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:24.749102 283424 pod_ready.go:103] pod "coredns-7c65d6cfc9-7h69s" in "kube-system" namespace has status "Ready":"False"
I0920 17:56:24.948490 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:24.994845 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:25.232508 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:25.448604 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:25.494120 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:25.731939 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
I0920 17:56:25.948935 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:25.994586 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:26.231835 283424 kapi.go:107] duration metric: took 17.004312127s to wait for kubernetes.io/minikube-addons=registry ...
I0920 17:56:26.448210 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:26.494976 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:26.751726 283424 pod_ready.go:103] pod "coredns-7c65d6cfc9-7h69s" in "kube-system" namespace has status "Ready":"False"
I0920 17:56:26.948585 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:26.995012 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:27.459629 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:27.493979 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:27.948352 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:27.997355 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:28.448720 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:28.494644 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:28.948298 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:28.993647 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:29.247812 283424 pod_ready.go:103] pod "coredns-7c65d6cfc9-7h69s" in "kube-system" namespace has status "Ready":"False"
I0920 17:56:29.448675 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:29.495570 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:29.948121 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:29.994727 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:30.449667 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:30.495324 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:30.948757 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:30.995239 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:31.448594 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:31.494483 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:31.748163 283424 pod_ready.go:103] pod "coredns-7c65d6cfc9-7h69s" in "kube-system" namespace has status "Ready":"False"
I0920 17:56:31.948850 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:31.995747 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:32.448627 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:32.494199 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:32.746939 283424 pod_ready.go:93] pod "coredns-7c65d6cfc9-7h69s" in "kube-system" namespace has status "Ready":"True"
I0920 17:56:32.746967 283424 pod_ready.go:82] duration metric: took 33.506854076s for pod "coredns-7c65d6cfc9-7h69s" in "kube-system" namespace to be "Ready" ...
I0920 17:56:32.746980 283424 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-gpttq" in "kube-system" namespace to be "Ready" ...
I0920 17:56:32.749366 283424 pod_ready.go:98] error getting pod "coredns-7c65d6cfc9-gpttq" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-gpttq" not found
I0920 17:56:32.749439 283424 pod_ready.go:82] duration metric: took 2.449722ms for pod "coredns-7c65d6cfc9-gpttq" in "kube-system" namespace to be "Ready" ...
E0920 17:56:32.749465 283424 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-7c65d6cfc9-gpttq" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-gpttq" not found
I0920 17:56:32.749488 283424 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-850577" in "kube-system" namespace to be "Ready" ...
I0920 17:56:32.755578 283424 pod_ready.go:93] pod "etcd-addons-850577" in "kube-system" namespace has status "Ready":"True"
I0920 17:56:32.755652 283424 pod_ready.go:82] duration metric: took 6.123729ms for pod "etcd-addons-850577" in "kube-system" namespace to be "Ready" ...
I0920 17:56:32.755680 283424 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-850577" in "kube-system" namespace to be "Ready" ...
I0920 17:56:32.762070 283424 pod_ready.go:93] pod "kube-apiserver-addons-850577" in "kube-system" namespace has status "Ready":"True"
I0920 17:56:32.762166 283424 pod_ready.go:82] duration metric: took 6.464021ms for pod "kube-apiserver-addons-850577" in "kube-system" namespace to be "Ready" ...
I0920 17:56:32.762193 283424 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-850577" in "kube-system" namespace to be "Ready" ...
I0920 17:56:32.769340 283424 pod_ready.go:93] pod "kube-controller-manager-addons-850577" in "kube-system" namespace has status "Ready":"True"
I0920 17:56:32.769418 283424 pod_ready.go:82] duration metric: took 7.202139ms for pod "kube-controller-manager-addons-850577" in "kube-system" namespace to be "Ready" ...
I0920 17:56:32.769446 283424 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-gpmhn" in "kube-system" namespace to be "Ready" ...
I0920 17:56:32.945465 283424 pod_ready.go:93] pod "kube-proxy-gpmhn" in "kube-system" namespace has status "Ready":"True"
I0920 17:56:32.945540 283424 pod_ready.go:82] duration metric: took 176.073443ms for pod "kube-proxy-gpmhn" in "kube-system" namespace to be "Ready" ...
I0920 17:56:32.945567 283424 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-850577" in "kube-system" namespace to be "Ready" ...
I0920 17:56:32.948543 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:32.994758 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:33.345997 283424 pod_ready.go:93] pod "kube-scheduler-addons-850577" in "kube-system" namespace has status "Ready":"True"
I0920 17:56:33.346028 283424 pod_ready.go:82] duration metric: took 400.43927ms for pod "kube-scheduler-addons-850577" in "kube-system" namespace to be "Ready" ...
I0920 17:56:33.346041 283424 pod_ready.go:79] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-6zxks" in "kube-system" namespace to be "Ready" ...
I0920 17:56:33.459031 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:33.560616 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:33.746372 283424 pod_ready.go:93] pod "nvidia-device-plugin-daemonset-6zxks" in "kube-system" namespace has status "Ready":"True"
I0920 17:56:33.746400 283424 pod_ready.go:82] duration metric: took 400.349204ms for pod "nvidia-device-plugin-daemonset-6zxks" in "kube-system" namespace to be "Ready" ...
I0920 17:56:33.746411 283424 pod_ready.go:39] duration metric: took 34.52508419s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
I0920 17:56:33.746431 283424 api_server.go:52] waiting for apiserver process to appear ...
I0920 17:56:33.746500 283424 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
I0920 17:56:33.776057 283424 api_server.go:72] duration metric: took 37.962919733s to wait for apiserver process to appear ...
I0920 17:56:33.776085 283424 api_server.go:88] waiting for apiserver healthz status ...
I0920 17:56:33.776107 283424 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
I0920 17:56:33.785725 283424 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
ok
I0920 17:56:33.786832 283424 api_server.go:141] control plane version: v1.31.1
I0920 17:56:33.786858 283424 api_server.go:131] duration metric: took 10.766011ms to wait for apiserver health ...
I0920 17:56:33.786868 283424 system_pods.go:43] waiting for kube-system pods to appear ...
I0920 17:56:33.951236 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:33.958653 283424 system_pods.go:59] 17 kube-system pods found
I0920 17:56:33.958752 283424 system_pods.go:61] "coredns-7c65d6cfc9-7h69s" [9a558d7a-0902-4311-9e03-37b7e777b7ea] Running
I0920 17:56:33.958778 283424 system_pods.go:61] "csi-hostpath-attacher-0" [1e6a1806-5a0e-4d9b-8226-6dd15458d077] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0920 17:56:33.958825 283424 system_pods.go:61] "csi-hostpath-resizer-0" [dea5489d-d945-4d45-ac46-bd6ec45c5d38] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0920 17:56:33.958854 283424 system_pods.go:61] "csi-hostpathplugin-jtnb9" [4845c672-f105-4f74-a139-938c1552c61b] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0920 17:56:33.958876 283424 system_pods.go:61] "etcd-addons-850577" [c828c556-c896-4188-9dea-49da081f4960] Running
I0920 17:56:33.958909 283424 system_pods.go:61] "kube-apiserver-addons-850577" [46334579-4abf-478f-b45e-d12db5d4d6a6] Running
I0920 17:56:33.958933 283424 system_pods.go:61] "kube-controller-manager-addons-850577" [4210bece-d382-4405-a4c0-4b72505b3388] Running
I0920 17:56:33.958956 283424 system_pods.go:61] "kube-ingress-dns-minikube" [37bf8c14-c53d-4a81-b9d6-510e6390c934] Pending / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])
I0920 17:56:33.958993 283424 system_pods.go:61] "kube-proxy-gpmhn" [f98ded18-6250-44d9-b128-ba3c6c921056] Running
I0920 17:56:33.959023 283424 system_pods.go:61] "kube-scheduler-addons-850577" [992349d6-fee6-4700-a741-26e39b687ff3] Running
I0920 17:56:33.959046 283424 system_pods.go:61] "metrics-server-84c5f94fbc-lzgjn" [a4dc3384-43e1-4ebe-8492-5adb0ce969d3] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0920 17:56:33.959081 283424 system_pods.go:61] "nvidia-device-plugin-daemonset-6zxks" [ac4e3a6e-15b5-407e-8aea-d28feff68e17] Running
I0920 17:56:33.959105 283424 system_pods.go:61] "registry-66c9cd494c-8c8sz" [48080209-95a2-4f92-83d3-4a339a6b1b54] Running
I0920 17:56:33.959126 283424 system_pods.go:61] "registry-proxy-fvmkn" [34be177b-c148-4a04-9275-afdde27c3678] Running
I0920 17:56:33.959163 283424 system_pods.go:61] "snapshot-controller-56fcc65765-nmgdg" [553ea066-259f-4267-8358-c92e60831dd3] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0920 17:56:33.959189 283424 system_pods.go:61] "snapshot-controller-56fcc65765-rct4g" [90ebe3ee-8d90-4610-9cc5-c31d34a9723e] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0920 17:56:33.959219 283424 system_pods.go:61] "storage-provisioner" [c54b2527-1026-42bb-8514-949f115e15bf] Running
I0920 17:56:33.959252 283424 system_pods.go:74] duration metric: took 172.377217ms to wait for pod list to return data ...
I0920 17:56:33.959277 283424 default_sa.go:34] waiting for default service account to be created ...
I0920 17:56:33.994851 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:34.146795 283424 default_sa.go:45] found service account: "default"
I0920 17:56:34.146873 283424 default_sa.go:55] duration metric: took 187.567128ms for default service account to be created ...
I0920 17:56:34.146900 283424 system_pods.go:116] waiting for k8s-apps to be running ...
I0920 17:56:34.366466 283424 system_pods.go:86] 17 kube-system pods found
I0920 17:56:34.366549 283424 system_pods.go:89] "coredns-7c65d6cfc9-7h69s" [9a558d7a-0902-4311-9e03-37b7e777b7ea] Running
I0920 17:56:34.366578 283424 system_pods.go:89] "csi-hostpath-attacher-0" [1e6a1806-5a0e-4d9b-8226-6dd15458d077] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
I0920 17:56:34.366619 283424 system_pods.go:89] "csi-hostpath-resizer-0" [dea5489d-d945-4d45-ac46-bd6ec45c5d38] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
I0920 17:56:34.366646 283424 system_pods.go:89] "csi-hostpathplugin-jtnb9" [4845c672-f105-4f74-a139-938c1552c61b] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
I0920 17:56:34.366667 283424 system_pods.go:89] "etcd-addons-850577" [c828c556-c896-4188-9dea-49da081f4960] Running
I0920 17:56:34.366685 283424 system_pods.go:89] "kube-apiserver-addons-850577" [46334579-4abf-478f-b45e-d12db5d4d6a6] Running
I0920 17:56:34.366707 283424 system_pods.go:89] "kube-controller-manager-addons-850577" [4210bece-d382-4405-a4c0-4b72505b3388] Running
I0920 17:56:34.366749 283424 system_pods.go:89] "kube-ingress-dns-minikube" [37bf8c14-c53d-4a81-b9d6-510e6390c934] Running
I0920 17:56:34.366770 283424 system_pods.go:89] "kube-proxy-gpmhn" [f98ded18-6250-44d9-b128-ba3c6c921056] Running
I0920 17:56:34.366790 283424 system_pods.go:89] "kube-scheduler-addons-850577" [992349d6-fee6-4700-a741-26e39b687ff3] Running
I0920 17:56:34.366825 283424 system_pods.go:89] "metrics-server-84c5f94fbc-lzgjn" [a4dc3384-43e1-4ebe-8492-5adb0ce969d3] Pending / Ready:ContainersNotReady (containers with unready status: [metrics-server]) / ContainersReady:ContainersNotReady (containers with unready status: [metrics-server])
I0920 17:56:34.366852 283424 system_pods.go:89] "nvidia-device-plugin-daemonset-6zxks" [ac4e3a6e-15b5-407e-8aea-d28feff68e17] Running
I0920 17:56:34.366872 283424 system_pods.go:89] "registry-66c9cd494c-8c8sz" [48080209-95a2-4f92-83d3-4a339a6b1b54] Running
I0920 17:56:34.366893 283424 system_pods.go:89] "registry-proxy-fvmkn" [34be177b-c148-4a04-9275-afdde27c3678] Running
I0920 17:56:34.366932 283424 system_pods.go:89] "snapshot-controller-56fcc65765-nmgdg" [553ea066-259f-4267-8358-c92e60831dd3] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0920 17:56:34.366957 283424 system_pods.go:89] "snapshot-controller-56fcc65765-rct4g" [90ebe3ee-8d90-4610-9cc5-c31d34a9723e] Pending / Ready:ContainersNotReady (containers with unready status: [volume-snapshot-controller]) / ContainersReady:ContainersNotReady (containers with unready status: [volume-snapshot-controller])
I0920 17:56:34.366974 283424 system_pods.go:89] "storage-provisioner" [c54b2527-1026-42bb-8514-949f115e15bf] Running
I0920 17:56:34.366997 283424 system_pods.go:126] duration metric: took 220.07269ms to wait for k8s-apps to be running ...
I0920 17:56:34.367030 283424 system_svc.go:44] waiting for kubelet service to be running ....
I0920 17:56:34.367109 283424 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
I0920 17:56:34.406498 283424 system_svc.go:56] duration metric: took 39.469331ms WaitForService to wait for kubelet
I0920 17:56:34.406529 283424 kubeadm.go:582] duration metric: took 38.593396515s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0920 17:56:34.406553 283424 node_conditions.go:102] verifying NodePressure condition ...
I0920 17:56:34.449416 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:34.496947 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:34.546118 283424 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki
I0920 17:56:34.546152 283424 node_conditions.go:123] node cpu capacity is 2
I0920 17:56:34.546171 283424 node_conditions.go:105] duration metric: took 139.607741ms to run NodePressure ...
I0920 17:56:34.546198 283424 start.go:241] waiting for startup goroutines ...
I0920 17:56:34.948149 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:34.994587 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:35.448660 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:35.494620 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:35.949242 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:35.995139 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:36.448758 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:36.494672 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:36.962490 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:36.995360 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:37.450204 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:37.495138 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:37.949241 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:37.995026 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:38.448534 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:38.494815 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:38.947920 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:38.995155 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:39.459438 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:39.561406 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:39.948595 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:40.003554 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:40.449214 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:40.496819 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:40.948517 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:40.995056 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:41.448447 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:41.494713 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:41.965070 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:41.995579 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:42.458305 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:42.496052 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:42.948244 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:42.997723 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:43.449363 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:43.494716 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:43.950153 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:43.994947 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:44.463915 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:44.572400 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:44.949126 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:44.996479 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:45.448727 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:45.494582 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:45.948593 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:45.996194 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:46.449483 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:46.494904 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:46.949305 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:46.995752 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:47.448888 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:47.494216 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:47.949517 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:47.994970 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:48.449453 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:48.550674 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:48.961188 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:49.061933 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:49.448826 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:49.549891 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:49.948326 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:49.994090 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:50.458486 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:50.495345 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:50.948602 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:50.995298 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:51.449376 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:51.495328 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:51.949374 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:52.050011 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:52.448244 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:52.496775 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:52.949026 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:52.995584 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:53.459105 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:53.497556 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:53.949300 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:53.999275 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:54.458515 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:54.494661 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:54.949075 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:54.995454 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:55.448974 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:55.494610 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:55.948398 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:55.994072 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:56.463573 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:56.496582 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:56.968323 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:56.994795 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:57.449233 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:57.498647 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:57.948849 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:57.994159 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:58.449067 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:58.494433 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:58.949612 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:58.996981 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:59.458676 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:59.558983 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:56:59.948559 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:56:59.994445 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:57:00.451118 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:00.517353 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:57:00.962997 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:00.995337 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:57:01.449087 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:01.495061 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:57:01.951979 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:01.995717 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:57:02.458787 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:02.494509 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:57:02.948559 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:02.993757 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:57:03.449262 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:03.495004 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:57:03.948652 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:03.994918 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:57:04.459019 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:04.495397 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
I0920 17:57:04.952547 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:04.994433 283424 kapi.go:107] duration metric: took 54.505059291s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
I0920 17:57:05.449146 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:05.948308 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:06.450210 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:06.950825 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:07.449142 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:07.948130 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:08.448340 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:08.948334 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:09.450890 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:09.948545 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:10.448093 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:10.948328 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:11.448165 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:11.949052 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:12.449633 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:12.950269 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:13.449384 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:13.950560 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:14.449601 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:14.949835 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:15.458948 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:15.949461 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:16.449035 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:16.948769 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:17.463527 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:17.949423 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:18.448668 283424 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
I0920 17:57:18.949848 283424 kapi.go:107] duration metric: took 1m11.506140911s to wait for app.kubernetes.io/name=ingress-nginx ...
I0920 17:57:34.369403 283424 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
I0920 17:57:34.369429 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:34.858281 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:35.357244 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:35.858154 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:36.357583 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:36.857378 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:37.357012 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:37.857570 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:38.357684 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:38.858620 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:39.356126 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:39.858521 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:40.357886 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:40.857737 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:41.356742 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:41.858963 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:42.357853 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:42.856881 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:43.356791 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:43.856350 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:44.357391 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:44.856922 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:45.357749 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:45.859431 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:46.357908 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:46.859843 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:47.358000 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:47.857855 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:48.357135 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:48.859529 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:49.358040 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:49.860076 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:50.356990 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:50.861191 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:51.357003 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:51.857888 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:52.357504 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:52.857180 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:53.357059 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:53.859502 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:54.356916 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:54.864837 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:55.357077 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:55.858861 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:56.360817 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:56.857183 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:57.357066 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:57.859678 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:58.356411 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:58.861181 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:59.356384 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:57:59.861380 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:00.359979 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:00.857681 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:01.356456 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:01.858688 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:02.356519 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:02.858209 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:03.356859 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:03.859218 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:04.357431 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:04.860320 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:05.356232 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:05.858404 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:06.357240 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:06.859084 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:07.356547 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:07.857571 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:08.357084 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:08.858481 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:09.356911 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:09.858149 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:10.356610 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:10.858492 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:11.357140 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:11.857699 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:12.356772 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:12.857861 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:13.357053 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:13.857305 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:14.356914 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:14.857902 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:15.357034 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:15.859300 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:16.362109 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:16.857280 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:17.357637 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:17.858659 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:18.356621 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:18.860241 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:19.357137 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:19.877854 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:20.358087 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:20.859625 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:21.356850 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:21.858932 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:22.357637 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:22.857579 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:23.357069 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:23.857922 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:24.356964 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:24.857982 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:25.356922 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:25.857634 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:26.356647 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:26.857197 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:27.357379 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:27.857736 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:28.356447 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:28.858381 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:29.356329 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:29.858567 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:30.356337 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:30.858429 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:31.357142 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:31.860072 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:32.357061 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:32.861631 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:33.357703 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:33.857924 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:34.356835 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:34.857389 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:35.357196 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:35.861314 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:36.356430 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:36.857860 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:37.356460 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:37.858160 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:38.357318 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:38.862161 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:39.357050 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:39.858411 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:40.357381 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:40.859121 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:41.357049 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:41.857623 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:42.358368 283424 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
I0920 17:58:42.857435 283424 kapi.go:107] duration metric: took 2m30.504328972s to wait for kubernetes.io/minikube-addons=gcp-auth ...
I0920 17:58:42.860054 283424 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-850577 cluster.
I0920 17:58:42.863069 283424 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
I0920 17:58:42.865687 283424 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
I0920 17:58:42.868464 283424 out.go:177] * Enabled addons: storage-provisioner, ingress-dns, nvidia-device-plugin, cloud-spanner, default-storageclass, metrics-server, inspektor-gadget, volcano, yakd, storage-provisioner-rancher, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth
I0920 17:58:42.871081 283424 addons.go:510] duration metric: took 2m47.057520984s for enable addons: enabled=[storage-provisioner ingress-dns nvidia-device-plugin cloud-spanner default-storageclass metrics-server inspektor-gadget volcano yakd storage-provisioner-rancher volumesnapshots registry csi-hostpath-driver ingress gcp-auth]
I0920 17:58:42.871144 283424 start.go:246] waiting for cluster config update ...
I0920 17:58:42.871171 283424 start.go:255] writing updated cluster config ...
I0920 17:58:42.871512 283424 ssh_runner.go:195] Run: rm -f paused
I0920 17:58:43.334528 283424 start.go:600] kubectl: 1.31.1, cluster: 1.31.1 (minor skew: 0)
I0920 17:58:43.337813 283424 out.go:177] * Done! kubectl is now configured to use "addons-850577" cluster and "default" namespace by default
==> Docker <==
Sep 20 18:08:18 addons-850577 dockerd[1288]: time="2024-09-20T18:08:18.053737207Z" level=info msg="ignoring event" container=42bb617c98fe5b3a5bac8530048d557d26030c843eb1b0e0c408ea5470627180 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 20 18:08:18 addons-850577 dockerd[1288]: time="2024-09-20T18:08:18.289346703Z" level=info msg="ignoring event" container=29de06590a5e97fb5fd981704f7bec809a13942843eb53e649b9c1c618626558 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 20 18:08:18 addons-850577 dockerd[1288]: time="2024-09-20T18:08:18.346170739Z" level=info msg="ignoring event" container=c87494f1c7215e410daaabaec6b9b2ebe7f9b87df449afc48138cd998b536707 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 20 18:08:20 addons-850577 dockerd[1288]: time="2024-09-20T18:08:20.670735863Z" level=info msg="Attempting next endpoint for pull after error: Head \"https://gcr.io/v2/k8s-minikube/busybox/manifests/latest\": unauthorized: authentication failed"
Sep 20 18:08:20 addons-850577 dockerd[1288]: time="2024-09-20T18:08:20.673986011Z" level=error msg="Handler for POST /v1.43/images/create returned error: Head \"https://gcr.io/v2/k8s-minikube/busybox/manifests/latest\": unauthorized: authentication failed"
Sep 20 18:08:24 addons-850577 dockerd[1288]: time="2024-09-20T18:08:24.756333361Z" level=info msg="ignoring event" container=f02bfd522ca040118dc01f93f3e93086400e3d1b58e384e4ea10796bd8c343e0 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 20 18:08:24 addons-850577 dockerd[1288]: time="2024-09-20T18:08:24.931070163Z" level=info msg="ignoring event" container=90b800dd9bf93fbe73a7eda6efa8133d1e14b77c1aa5c3f9690ad387263881c4 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 20 18:08:25 addons-850577 cri-dockerd[1546]: time="2024-09-20T18:08:25Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/f3f97bf3dac9666b26089473fa62d95f75b165989621bab7f860437cb4ec475e/resolv.conf as [nameserver 10.96.0.10 search local-path-storage.svc.cluster.local svc.cluster.local cluster.local us-east-2.compute.internal options ndots:5]"
Sep 20 18:08:25 addons-850577 dockerd[1288]: time="2024-09-20T18:08:25.878401778Z" level=warning msg="reference for unknown type: " digest="sha256:3fbc632167424a6d997e74f52b878d7cc478225cffac6bc977eedfe51c7f4e79" remote="docker.io/library/busybox@sha256:3fbc632167424a6d997e74f52b878d7cc478225cffac6bc977eedfe51c7f4e79"
Sep 20 18:08:26 addons-850577 cri-dockerd[1546]: time="2024-09-20T18:08:26Z" level=info msg="Stop pulling image docker.io/busybox:stable@sha256:3fbc632167424a6d997e74f52b878d7cc478225cffac6bc977eedfe51c7f4e79: Status: Downloaded newer image for busybox@sha256:3fbc632167424a6d997e74f52b878d7cc478225cffac6bc977eedfe51c7f4e79"
Sep 20 18:08:26 addons-850577 dockerd[1288]: time="2024-09-20T18:08:26.565878391Z" level=info msg="ignoring event" container=c756f742dfff844d7c813feb3393ce6446a7502c6c6a1fa61beeedfb41398987 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 20 18:08:27 addons-850577 dockerd[1288]: time="2024-09-20T18:08:27.746764696Z" level=info msg="ignoring event" container=f3f97bf3dac9666b26089473fa62d95f75b165989621bab7f860437cb4ec475e module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 20 18:08:29 addons-850577 cri-dockerd[1546]: time="2024-09-20T18:08:29Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/a999b9269ffe1d07c450dae0c7948e4b7fd74254e2daefb5a3dd0233ef273244/resolv.conf as [nameserver 10.96.0.10 search default.svc.cluster.local svc.cluster.local cluster.local us-east-2.compute.internal options ndots:5]"
Sep 20 18:08:30 addons-850577 cri-dockerd[1546]: time="2024-09-20T18:08:30Z" level=info msg="Stop pulling image busybox:stable: Status: Downloaded newer image for busybox:stable"
Sep 20 18:08:30 addons-850577 dockerd[1288]: time="2024-09-20T18:08:30.700515167Z" level=info msg="ignoring event" container=9394472b4acd8fbdcf18d136a44adc214e9df24bc702b32f55cdc77ad9a072ec module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 20 18:08:32 addons-850577 dockerd[1288]: time="2024-09-20T18:08:32.889394448Z" level=info msg="ignoring event" container=a999b9269ffe1d07c450dae0c7948e4b7fd74254e2daefb5a3dd0233ef273244 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 20 18:08:34 addons-850577 cri-dockerd[1546]: time="2024-09-20T18:08:34Z" level=info msg="Will attempt to re-write config file /var/lib/docker/containers/ea3e387b9bb0160af6f4159cf700caec5448361765dfe1e2fd99accc2d53587b/resolv.conf as [nameserver 10.96.0.10 search local-path-storage.svc.cluster.local svc.cluster.local cluster.local us-east-2.compute.internal options ndots:5]"
Sep 20 18:08:34 addons-850577 dockerd[1288]: time="2024-09-20T18:08:34.665756409Z" level=info msg="ignoring event" container=af5c48ed52189edf7bba805d88cf48f7ac9e268d8c17c8a2df6e4fd215fe6a3a module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 20 18:08:35 addons-850577 dockerd[1288]: time="2024-09-20T18:08:35.966061751Z" level=info msg="ignoring event" container=ea3e387b9bb0160af6f4159cf700caec5448361765dfe1e2fd99accc2d53587b module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 20 18:08:41 addons-850577 dockerd[1288]: time="2024-09-20T18:08:41.070744807Z" level=info msg="ignoring event" container=cc2cb9727eaa91716f0b0afdf52be1b30f72e161658221cc04c0e43a8bcdc172 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 20 18:08:41 addons-850577 dockerd[1288]: time="2024-09-20T18:08:41.786413597Z" level=info msg="ignoring event" container=ab743b3168bf21c5901c6013e3eedeb2a4218eb2ac593c9f1797bd67e214b7cf module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 20 18:08:41 addons-850577 dockerd[1288]: time="2024-09-20T18:08:41.894631167Z" level=info msg="ignoring event" container=0ae58fce91b0234aafb8c21e9914a236a4ade7bf57961951420d90f04432f6be module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 20 18:08:42 addons-850577 dockerd[1288]: time="2024-09-20T18:08:42.057239022Z" level=info msg="ignoring event" container=44d62df1c000df7db22c3f1925af70250a483f799af5e37e6f04b926186d981c module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
Sep 20 18:08:42 addons-850577 cri-dockerd[1546]: time="2024-09-20T18:08:42Z" level=info msg="Failed to read pod IP from plugin/docker: networkPlugin cni failed on the status hook for pod \"registry-proxy-fvmkn_kube-system\": unexpected command output nsenter: cannot open /proc/3613/ns/net: No such file or directory\n with error: exit status 1"
Sep 20 18:08:42 addons-850577 dockerd[1288]: time="2024-09-20T18:08:42.378901946Z" level=info msg="ignoring event" container=15e875e274ee8e563d60e4ce52fa127809b59d532d0aa9c1672dea5f2653bf60 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"
==> container status <==
CONTAINER IMAGE CREATED STATE NAME ATTEMPT POD ID POD
af5c48ed52189 fc9db2894f4e4 9 seconds ago Exited helper-pod 0 ea3e387b9bb01 helper-pod-delete-pvc-f345ef47-0969-4cae-a23c-0960456ac5a9
9394472b4acd8 busybox@sha256:c230832bd3b0be59a6c47ed64294f9ce71e91b327957920b6929a0caa8353140 13 seconds ago Exited busybox 0 a999b9269ffe1 test-local-path
cb9144005732b ghcr.io/inspektor-gadget/inspektor-gadget@sha256:03e677e1cf9d2c9bea454e3dbcbcef20b3022e987534a2874eb1abc5bc3e73ec 43 seconds ago Exited gadget 7 6dc6e4b8b08fb gadget-72nst
f1bde31761a4f gcr.io/k8s-minikube/gcp-auth-webhook@sha256:e6c5b3bc32072ea370d34c27836efd11b3519d25bd444c2a8efc339cff0e20fb 10 minutes ago Running gcp-auth 0 0c76d2f64ccdd gcp-auth-89d5ffd79-wtttv
6c14536a93d9e registry.k8s.io/ingress-nginx/controller@sha256:d5f8217feeac4887cb1ed21f27c2674e58be06bd8f5184cacea2a69abaf78dce 11 minutes ago Running controller 0 3e0433bf6afbf ingress-nginx-controller-bc57996ff-9r7sq
567c8958e15a2 420193b27261a 11 minutes ago Exited patch 1 5cdc93e3d8a54 ingress-nginx-admission-patch-dgrfg
9034b6b32e919 registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:a320a50cc91bd15fd2d6fa6de58bd98c1bd64b9a6f926ce23a600d87043455a3 11 minutes ago Exited create 0 95a75a87464ea ingress-nginx-admission-create-d6p8g
b2630aea8d232 rancher/local-path-provisioner@sha256:e34c88ae0affb1cdefbb874140d6339d4a27ec4ee420ae8199cd839997b05246 12 minutes ago Running local-path-provisioner 0 5ff619e647444 local-path-provisioner-86d989889c-wczhz
59d07b7bbb5ac registry.k8s.io/metrics-server/metrics-server@sha256:ffcb2bf004d6aa0a17d90e0247cf94f2865c8901dcab4427034c341951c239f9 12 minutes ago Running metrics-server 0 2ffb82c6c7346 metrics-server-84c5f94fbc-lzgjn
399bc310c0c81 gcr.io/k8s-minikube/minikube-ingress-dns@sha256:4211a1de532376c881851542238121b26792225faa36a7b02dccad88fd05797c 12 minutes ago Running minikube-ingress-dns 0 303559a542e5b kube-ingress-dns-minikube
0ae58fce91b02 gcr.io/k8s-minikube/kube-registry-proxy@sha256:b3fa0b2df8737fdb85ad5918a7e2652527463e357afff83a5e5bb966bcedc367 12 minutes ago Exited registry-proxy 0 15e875e274ee8 registry-proxy-fvmkn
81e12cd1b2dac gcr.io/cloud-spanner-emulator/emulator@sha256:f78b14fe7e4632fc0b3c65e15101ebbbcf242857de9851d3c0baea94bd269b5e 12 minutes ago Running cloud-spanner-emulator 0 43b1240fed69a cloud-spanner-emulator-5b584cc74-rjshz
48ba5c67461f1 ba04bb24b9575 12 minutes ago Running storage-provisioner 0 82cfdf70ec2b6 storage-provisioner
6f1c6e5b28358 2f6c962e7b831 12 minutes ago Running coredns 0 b210c2133221f coredns-7c65d6cfc9-7h69s
8df24902f2157 24a140c548c07 12 minutes ago Running kube-proxy 0 820aa048f8b68 kube-proxy-gpmhn
0440cf4705730 279f381cb3736 13 minutes ago Running kube-controller-manager 0 ac11da38fda35 kube-controller-manager-addons-850577
e279c84c57659 27e3830e14027 13 minutes ago Running etcd 0 058e7aedcea6e etcd-addons-850577
b9933d5643290 7f8aa378bb47d 13 minutes ago Running kube-scheduler 0 1c1759dc9888c kube-scheduler-addons-850577
d24680d8b6670 d3f53a98c0a9d 13 minutes ago Running kube-apiserver 0 74b068e8b79bb kube-apiserver-addons-850577
==> controller_ingress [6c14536a93d9] <==
W0920 17:57:17.360165 6 client_config.go:659] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
I0920 17:57:17.360479 6 main.go:205] "Creating API client" host="https://10.96.0.1:443"
I0920 17:57:17.378376 6 main.go:248] "Running in Kubernetes cluster" major="1" minor="31" git="v1.31.1" state="clean" commit="948afe5ca072329a73c8e79ed5938717a5cb3d21" platform="linux/arm64"
I0920 17:57:17.804569 6 main.go:101] "SSL fake certificate created" file="/etc/ingress-controller/ssl/default-fake-certificate.pem"
I0920 17:57:17.827716 6 ssl.go:535] "loading tls certificate" path="/usr/local/certificates/cert" key="/usr/local/certificates/key"
I0920 17:57:17.838092 6 nginx.go:271] "Starting NGINX Ingress controller"
I0920 17:57:17.871945 6 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"ingress-nginx-controller", UID:"d5ae74a7-8c87-4b0f-b498-27cfb727cf99", APIVersion:"v1", ResourceVersion:"666", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/ingress-nginx-controller
I0920 17:57:17.878082 6 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"tcp-services", UID:"4122a3f7-cefb-44e5-afc7-3d2a42768c05", APIVersion:"v1", ResourceVersion:"667", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/tcp-services
I0920 17:57:17.878170 6 event.go:377] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"ingress-nginx", Name:"udp-services", UID:"d8e69daa-cb9f-4a6b-95ee-94eff9538bd9", APIVersion:"v1", ResourceVersion:"668", FieldPath:""}): type: 'Normal' reason: 'CREATE' ConfigMap ingress-nginx/udp-services
I0920 17:57:19.041717 6 nginx.go:317] "Starting NGINX process"
I0920 17:57:19.041933 6 leaderelection.go:250] attempting to acquire leader lease ingress-nginx/ingress-nginx-leader...
I0920 17:57:19.042582 6 nginx.go:337] "Starting validation webhook" address=":8443" certPath="/usr/local/certificates/cert" keyPath="/usr/local/certificates/key"
I0920 17:57:19.042907 6 controller.go:193] "Configuration changes detected, backend reload required"
I0920 17:57:19.062287 6 leaderelection.go:260] successfully acquired lease ingress-nginx/ingress-nginx-leader
I0920 17:57:19.063503 6 status.go:85] "New leader elected" identity="ingress-nginx-controller-bc57996ff-9r7sq"
I0920 17:57:19.069816 6 status.go:219] "POD is not ready" pod="ingress-nginx/ingress-nginx-controller-bc57996ff-9r7sq" node="addons-850577"
I0920 17:57:19.098862 6 controller.go:213] "Backend successfully reloaded"
I0920 17:57:19.099045 6 controller.go:224] "Initial sync, sleeping for 1 second"
I0920 17:57:19.099462 6 event.go:377] Event(v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-bc57996ff-9r7sq", UID:"46e78e03-ff68-4691-8e62-89e4d6375b24", APIVersion:"v1", ResourceVersion:"692", FieldPath:""}): type: 'Normal' reason: 'RELOAD' NGINX reload triggered due to a change in configuration
Build: 46e76e5916813cfca2a9b0bfdc34b69a0000f6b9
Repository: https://github.com/kubernetes/ingress-nginx
nginx version: nginx/1.25.5
-------------------------------------------------------------------------------
==> coredns [6f1c6e5b2835] <==
[INFO] plugin/reload: Running configuration SHA512 = 05e3eaddc414b2d71a69b2e2bc6f2681fc1f4d04bcdd3acc1a41457bb7db518208b95ddfc4c9fffedc59c25a8faf458be1af4915a4a3c0d6777cb7a346bc5d86
[INFO] Reloading complete
[INFO] 127.0.0.1:46447 - 29647 "HINFO IN 2165942655590568091.7520587168380827109. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.004666659s
[INFO] 10.244.0.7:60227 - 23748 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000326196s
[INFO] 10.244.0.7:60227 - 60608 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000208644s
[INFO] 10.244.0.7:57680 - 10623 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000193858s
[INFO] 10.244.0.7:57680 - 12803 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000096983s
[INFO] 10.244.0.7:55798 - 25193 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000100847s
[INFO] 10.244.0.7:55798 - 27222 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000112506s
[INFO] 10.244.0.7:52421 - 6955 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000104301s
[INFO] 10.244.0.7:52421 - 40229 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000096474s
[INFO] 10.244.0.7:57043 - 3415 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002606444s
[INFO] 10.244.0.7:57043 - 47705 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002563868s
[INFO] 10.244.0.7:35399 - 63224 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000088039s
[INFO] 10.244.0.7:35399 - 30966 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000221181s
[INFO] 10.244.0.25:38476 - 14519 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000286386s
[INFO] 10.244.0.25:52326 - 48525 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000153466s
[INFO] 10.244.0.25:47119 - 39882 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000228623s
[INFO] 10.244.0.25:43140 - 49227 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000112548s
[INFO] 10.244.0.25:45376 - 15040 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000283883s
[INFO] 10.244.0.25:40073 - 61313 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000114877s
[INFO] 10.244.0.25:59465 - 5287 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.0031376s
[INFO] 10.244.0.25:53399 - 52561 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002925477s
[INFO] 10.244.0.25:57179 - 7042 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 648 0.0041789s
[INFO] 10.244.0.25:52302 - 38193 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.005090815s
==> describe nodes <==
Name: addons-850577
Roles: control-plane
Labels: beta.kubernetes.io/arch=arm64
beta.kubernetes.io/os=linux
kubernetes.io/arch=arm64
kubernetes.io/hostname=addons-850577
kubernetes.io/os=linux
minikube.k8s.io/commit=35d0eeb96573bd708dfd5c070da844e6f0fad78a
minikube.k8s.io/name=addons-850577
minikube.k8s.io/primary=true
minikube.k8s.io/updated_at=2024_09_20T17_55_51_0700
minikube.k8s.io/version=v1.34.0
node-role.kubernetes.io/control-plane=
node.kubernetes.io/exclude-from-external-load-balancers=
topology.hostpath.csi/node=addons-850577
Annotations: kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock
node.alpha.kubernetes.io/ttl: 0
volumes.kubernetes.io/controller-managed-attach-detach: true
CreationTimestamp: Fri, 20 Sep 2024 17:55:47 +0000
Taints: <none>
Unschedulable: false
Lease:
HolderIdentity: addons-850577
AcquireTime: <unset>
RenewTime: Fri, 20 Sep 2024 18:08:35 +0000
Conditions:
Type Status LastHeartbeatTime LastTransitionTime Reason Message
---- ------ ----------------- ------------------ ------ -------
MemoryPressure False Fri, 20 Sep 2024 18:04:31 +0000 Fri, 20 Sep 2024 17:55:43 +0000 KubeletHasSufficientMemory kubelet has sufficient memory available
DiskPressure False Fri, 20 Sep 2024 18:04:31 +0000 Fri, 20 Sep 2024 17:55:43 +0000 KubeletHasNoDiskPressure kubelet has no disk pressure
PIDPressure False Fri, 20 Sep 2024 18:04:31 +0000 Fri, 20 Sep 2024 17:55:43 +0000 KubeletHasSufficientPID kubelet has sufficient PID available
Ready True Fri, 20 Sep 2024 18:04:31 +0000 Fri, 20 Sep 2024 17:55:47 +0000 KubeletReady kubelet is posting ready status
Addresses:
InternalIP: 192.168.49.2
Hostname: addons-850577
Capacity:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
Allocatable:
cpu: 2
ephemeral-storage: 203034800Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
hugepages-32Mi: 0
hugepages-64Ki: 0
memory: 8022300Ki
pods: 110
System Info:
Machine ID: dac8d98d5be146bab3e0b9a96da0cb9c
System UUID: 811a88e0-455f-4a45-868d-205d0da4cf1f
Boot ID: 7d682649-b07c-44b5-a0a6-3c50df538ea4
Kernel Version: 5.15.0-1070-aws
OS Image: Ubuntu 22.04.5 LTS
Operating System: linux
Architecture: arm64
Container Runtime Version: docker://27.2.1
Kubelet Version: v1.31.1
Kube-Proxy Version: v1.31.1
PodCIDR: 10.244.0.0/24
PodCIDRs: 10.244.0.0/24
Non-terminated Pods: (15 in total)
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits Age
--------- ---- ------------ ---------- --------------- ------------- ---
default busybox 0 (0%) 0 (0%) 0 (0%) 0 (0%) 9m18s
default cloud-spanner-emulator-5b584cc74-rjshz 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
gadget gadget-72nst 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
gcp-auth gcp-auth-89d5ffd79-wtttv 0 (0%) 0 (0%) 0 (0%) 0 (0%) 11m
ingress-nginx ingress-nginx-controller-bc57996ff-9r7sq 100m (5%) 0 (0%) 90Mi (1%) 0 (0%) 12m
kube-system coredns-7c65d6cfc9-7h69s 100m (5%) 0 (0%) 70Mi (0%) 170Mi (2%) 12m
kube-system etcd-addons-850577 100m (5%) 0 (0%) 100Mi (1%) 0 (0%) 12m
kube-system kube-apiserver-addons-850577 250m (12%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-controller-manager-addons-850577 200m (10%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-ingress-dns-minikube 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-proxy-gpmhn 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system kube-scheduler-addons-850577 100m (5%) 0 (0%) 0 (0%) 0 (0%) 12m
kube-system metrics-server-84c5f94fbc-lzgjn 100m (5%) 0 (0%) 200Mi (2%) 0 (0%) 12m
kube-system storage-provisioner 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
local-path-storage local-path-provisioner-86d989889c-wczhz 0 (0%) 0 (0%) 0 (0%) 0 (0%) 12m
Allocated resources:
(Total limits may be over 100 percent, i.e., overcommitted.)
Resource Requests Limits
-------- -------- ------
cpu 950m (47%) 0 (0%)
memory 460Mi (5%) 170Mi (2%)
ephemeral-storage 0 (0%) 0 (0%)
hugepages-1Gi 0 (0%) 0 (0%)
hugepages-2Mi 0 (0%) 0 (0%)
hugepages-32Mi 0 (0%) 0 (0%)
hugepages-64Ki 0 (0%) 0 (0%)
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Starting 12m kube-proxy
Normal Starting 12m kubelet Starting kubelet.
Warning CgroupV1 12m kubelet Cgroup v1 support is in maintenance mode, please migrate to Cgroup v2.
Normal NodeAllocatableEnforced 12m kubelet Updated Node Allocatable limit across pods
Normal NodeHasSufficientMemory 12m kubelet Node addons-850577 status is now: NodeHasSufficientMemory
Normal NodeHasNoDiskPressure 12m kubelet Node addons-850577 status is now: NodeHasNoDiskPressure
Normal NodeHasSufficientPID 12m kubelet Node addons-850577 status is now: NodeHasSufficientPID
Normal RegisteredNode 12m node-controller Node addons-850577 event: Registered Node addons-850577 in Controller
==> dmesg <==
[Sep20 16:17] ACPI: SRAT not present
[ +0.000000] ACPI: SRAT not present
[ +0.000000] SPI driver altr_a10sr has no spi_device_id for altr,a10sr
[ +0.015881] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[ +0.524754] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[ +0.847718] ena 0000:00:05.0: LLQ is not supported Fallback to host mode policy.
[ +6.590447] kauditd_printk_skb: 36 callbacks suppressed
[Sep20 16:50] FS-Cache: Duplicate cookie detected
[ +0.000825] FS-Cache: O-cookie c=00000012 [p=00000002 fl=222 nc=0 na=1]
[ +0.001034] FS-Cache: O-cookie d=000000008ea1ce8f{9P.session} n=000000001a8428bc
[ +0.001205] FS-Cache: O-key=[10] '34323935333931393837'
[ +0.000859] FS-Cache: N-cookie c=00000013 [p=00000002 fl=2 nc=0 na=1]
[ +0.001030] FS-Cache: N-cookie d=000000008ea1ce8f{9P.session} n=00000000d3d4e3e3
[ +0.001174] FS-Cache: N-key=[10] '34323935333931393837'
[Sep20 16:51] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
[Sep20 16:52] hrtimer: interrupt took 16185074 ns
[Sep20 17:26] overlayfs: '/var/lib/containers/storage/overlay/l/Q2QJNMTVZL6GMULS36RA5ZJGSA' not a directory
==> etcd [e279c84c5765] <==
{"level":"info","ts":"2024-09-20T17:55:43.598703Z","caller":"embed/etcd.go:279","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}
{"level":"info","ts":"2024-09-20T17:55:43.599337Z","caller":"embed/etcd.go:870","msg":"serving metrics","address":"http://127.0.0.1:2381"}
{"level":"info","ts":"2024-09-20T17:55:43.848746Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 1"}
{"level":"info","ts":"2024-09-20T17:55:43.848975Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 1"}
{"level":"info","ts":"2024-09-20T17:55:43.849100Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 1"}
{"level":"info","ts":"2024-09-20T17:55:43.849209Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 2"}
{"level":"info","ts":"2024-09-20T17:55:43.849286Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-20T17:55:43.849397Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 2"}
{"level":"info","ts":"2024-09-20T17:55:43.849478Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2"}
{"level":"info","ts":"2024-09-20T17:55:43.852821Z","caller":"etcdserver/server.go:2629","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-20T17:55:43.856930Z","caller":"etcdserver/server.go:2118","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:addons-850577 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}
{"level":"info","ts":"2024-09-20T17:55:43.857132Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-20T17:55:43.857666Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-20T17:55:43.857872Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-20T17:55:43.857978Z","caller":"etcdserver/server.go:2653","msg":"cluster version is updated","cluster-version":"3.5"}
{"level":"info","ts":"2024-09-20T17:55:43.857696Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}
{"level":"info","ts":"2024-09-20T17:55:43.858403Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-20T17:55:43.858851Z","caller":"v3rpc/health.go:61","msg":"grpc service status changed","service":"","status":"SERVING"}
{"level":"info","ts":"2024-09-20T17:55:43.868929Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}
{"level":"info","ts":"2024-09-20T17:55:43.859561Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}
{"level":"info","ts":"2024-09-20T17:55:43.869311Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}
{"level":"info","ts":"2024-09-20T17:55:43.872739Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}
{"level":"info","ts":"2024-09-20T18:05:45.521388Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1862}
{"level":"info","ts":"2024-09-20T18:05:45.564340Z","caller":"mvcc/kvstore_compaction.go:69","msg":"finished scheduled compaction","compact-revision":1862,"took":"42.306509ms","hash":2504355425,"current-db-size-bytes":8687616,"current-db-size":"8.7 MB","current-db-size-in-use-bytes":4902912,"current-db-size-in-use":"4.9 MB"}
{"level":"info","ts":"2024-09-20T18:05:45.564393Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":2504355425,"revision":1862,"compact-revision":-1}
==> gcp-auth [f1bde31761a4] <==
2024/09/20 17:58:42 GCP Auth Webhook started!
2024/09/20 17:58:59 Ready to marshal response ...
2024/09/20 17:58:59 Ready to write response ...
2024/09/20 17:59:00 Ready to marshal response ...
2024/09/20 17:59:00 Ready to write response ...
2024/09/20 17:59:24 Ready to marshal response ...
2024/09/20 17:59:24 Ready to write response ...
2024/09/20 17:59:25 Ready to marshal response ...
2024/09/20 17:59:25 Ready to write response ...
2024/09/20 17:59:25 Ready to marshal response ...
2024/09/20 17:59:25 Ready to write response ...
2024/09/20 18:07:40 Ready to marshal response ...
2024/09/20 18:07:40 Ready to write response ...
2024/09/20 18:07:46 Ready to marshal response ...
2024/09/20 18:07:46 Ready to write response ...
2024/09/20 18:08:01 Ready to marshal response ...
2024/09/20 18:08:01 Ready to write response ...
2024/09/20 18:08:25 Ready to marshal response ...
2024/09/20 18:08:25 Ready to write response ...
2024/09/20 18:08:25 Ready to marshal response ...
2024/09/20 18:08:25 Ready to write response ...
2024/09/20 18:08:33 Ready to marshal response ...
2024/09/20 18:08:33 Ready to write response ...
==> kernel <==
18:08:43 up 1:51, 0 users, load average: 2.95, 1.47, 1.97
Linux addons-850577 5.15.0-1070-aws #76~20.04.1-Ubuntu SMP Mon Sep 2 12:20:48 UTC 2024 aarch64 aarch64 aarch64 GNU/Linux
PRETTY_NAME="Ubuntu 22.04.5 LTS"
==> kube-apiserver [d24680d8b667] <==
I0920 17:59:15.658864 1 handler.go:286] Adding GroupVersion scheduling.volcano.sh v1beta1 to ResourceManager
I0920 17:59:15.957574 1 handler.go:286] Adding GroupVersion flow.volcano.sh v1alpha1 to ResourceManager
I0920 17:59:16.001839 1 handler.go:286] Adding GroupVersion flow.volcano.sh v1alpha1 to ResourceManager
I0920 17:59:16.227141 1 handler.go:286] Adding GroupVersion flow.volcano.sh v1alpha1 to ResourceManager
W0920 17:59:16.378403 1 cacher.go:171] Terminating all watchers from cacher commands.bus.volcano.sh
W0920 17:59:16.658995 1 cacher.go:171] Terminating all watchers from cacher podgroups.scheduling.volcano.sh
W0920 17:59:16.783703 1 cacher.go:171] Terminating all watchers from cacher jobs.batch.volcano.sh
W0920 17:59:16.823625 1 cacher.go:171] Terminating all watchers from cacher numatopologies.nodeinfo.volcano.sh
W0920 17:59:16.910709 1 cacher.go:171] Terminating all watchers from cacher queues.scheduling.volcano.sh
W0920 17:59:17.239069 1 cacher.go:171] Terminating all watchers from cacher jobflows.flow.volcano.sh
W0920 17:59:17.339486 1 cacher.go:171] Terminating all watchers from cacher jobtemplates.flow.volcano.sh
I0920 18:07:53.929744 1 controller.go:615] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
I0920 18:08:17.755929 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0920 18:08:17.755996 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0920 18:08:17.780306 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0920 18:08:17.780369 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0920 18:08:17.810218 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0920 18:08:17.810278 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0920 18:08:17.950482 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0920 18:08:17.950546 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
I0920 18:08:17.992587 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
I0920 18:08:17.993781 1 handler.go:286] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
W0920 18:08:18.950923 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
W0920 18:08:18.993297 1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
W0920 18:08:18.998597 1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
==> kube-controller-manager [0440cf470573] <==
I0920 18:08:25.181235 1 shared_informer.go:320] Caches are synced for resource quota
W0920 18:08:25.214853 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0920 18:08:25.214908 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0920 18:08:25.468302 1 shared_informer.go:313] Waiting for caches to sync for garbage collector
I0920 18:08:25.468506 1 shared_informer.go:320] Caches are synced for garbage collector
W0920 18:08:26.702369 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0920 18:08:26.702425 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0920 18:08:27.596056 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0920 18:08:27.596111 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0920 18:08:28.545845 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0920 18:08:28.545891 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0920 18:08:31.566215 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0920 18:08:31.566264 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0920 18:08:34.502027 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="local-path-storage/local-path-provisioner-86d989889c" duration="9.001µs"
W0920 18:08:35.919013 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0920 18:08:35.919068 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0920 18:08:37.874038 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0920 18:08:37.874081 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0920 18:08:38.739004 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0920 18:08:38.739050 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
W0920 18:08:39.370146 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0920 18:08:39.370194 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
I0920 18:08:41.701271 1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/registry-66c9cd494c" duration="5.826µs"
W0920 18:08:42.184489 1 reflector.go:561] k8s.io/client-go/metadata/metadatainformer/informer.go:138: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
E0920 18:08:42.184555 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/metadata/metadatainformer/informer.go:138: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource" logger="UnhandledError"
==> kube-proxy [8df24902f215] <==
I0920 17:55:57.219003 1 server_linux.go:66] "Using iptables proxy"
I0920 17:55:57.311066 1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.49.2"]
E0920 17:55:57.311131 1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"
I0920 17:55:57.375285 1 server.go:243] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
I0920 17:55:57.375358 1 server_linux.go:169] "Using iptables Proxier"
I0920 17:55:57.380403 1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"
I0920 17:55:57.380759 1 server.go:483] "Version info" version="v1.31.1"
I0920 17:55:57.380775 1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
I0920 17:55:57.382541 1 config.go:199] "Starting service config controller"
I0920 17:55:57.382567 1 shared_informer.go:313] Waiting for caches to sync for service config
I0920 17:55:57.382595 1 config.go:105] "Starting endpoint slice config controller"
I0920 17:55:57.382599 1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config
I0920 17:55:57.386499 1 config.go:328] "Starting node config controller"
I0920 17:55:57.386515 1 shared_informer.go:313] Waiting for caches to sync for node config
I0920 17:55:57.482846 1 shared_informer.go:320] Caches are synced for endpoint slice config
I0920 17:55:57.482911 1 shared_informer.go:320] Caches are synced for service config
I0920 17:55:57.486674 1 shared_informer.go:320] Caches are synced for node config
==> kube-scheduler [b9933d564329] <==
W0920 17:55:47.904473 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
E0920 17:55:47.904595 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumeclaims\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0920 17:55:47.904725 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0920 17:55:47.904872 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0920 17:55:47.905226 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
E0920 17:55:47.905369 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"replicasets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0920 17:55:47.905461 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
E0920 17:55:47.905546 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User \"system:kube-scheduler\" cannot list resource \"poddisruptionbudgets\" in API group \"policy\" at the cluster scope" logger="UnhandledError"
W0920 17:55:47.905648 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0920 17:55:47.905743 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0920 17:55:47.905840 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
E0920 17:55:47.905925 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0920 17:55:48.720843 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
E0920 17:55:48.721138 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User \"system:kube-scheduler\" cannot list resource \"pods\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0920 17:55:48.746651 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
E0920 17:55:48.746781 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User \"system:kube-scheduler\" cannot list resource \"persistentvolumes\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0920 17:55:48.746908 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
E0920 17:55:48.746962 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User \"system:kube-scheduler\" cannot list resource \"statefulsets\" in API group \"apps\" at the cluster scope" logger="UnhandledError"
W0920 17:55:48.803865 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
E0920 17:55:48.803905 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:kube-scheduler\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError"
W0920 17:55:48.817465 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
E0920 17:55:48.817569 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
W0920 17:55:48.842323 1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
E0920 17:55:48.842603 1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"storageclasses\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"
I0920 17:55:49.388584 1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
==> kubelet <==
Sep 20 18:08:36 addons-850577 kubelet[2351]: I0920 18:08:36.133706 2351 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a432d9a-a7dc-4eee-b82a-b9bf9d04b997-kube-api-access-6pcds" (OuterVolumeSpecName: "kube-api-access-6pcds") pod "6a432d9a-a7dc-4eee-b82a-b9bf9d04b997" (UID: "6a432d9a-a7dc-4eee-b82a-b9bf9d04b997"). InnerVolumeSpecName "kube-api-access-6pcds". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 20 18:08:36 addons-850577 kubelet[2351]: I0920 18:08:36.229154 2351 reconciler_common.go:288] "Volume detached for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/6a432d9a-a7dc-4eee-b82a-b9bf9d04b997-gcp-creds\") on node \"addons-850577\" DevicePath \"\""
Sep 20 18:08:36 addons-850577 kubelet[2351]: I0920 18:08:36.229202 2351 reconciler_common.go:288] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/host-path/6a432d9a-a7dc-4eee-b82a-b9bf9d04b997-data\") on node \"addons-850577\" DevicePath \"\""
Sep 20 18:08:36 addons-850577 kubelet[2351]: I0920 18:08:36.229212 2351 reconciler_common.go:288] "Volume detached for volume \"script\" (UniqueName: \"kubernetes.io/configmap/6a432d9a-a7dc-4eee-b82a-b9bf9d04b997-script\") on node \"addons-850577\" DevicePath \"\""
Sep 20 18:08:36 addons-850577 kubelet[2351]: I0920 18:08:36.229223 2351 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-6pcds\" (UniqueName: \"kubernetes.io/projected/6a432d9a-a7dc-4eee-b82a-b9bf9d04b997-kube-api-access-6pcds\") on node \"addons-850577\" DevicePath \"\""
Sep 20 18:08:36 addons-850577 kubelet[2351]: I0920 18:08:36.895642 2351 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea3e387b9bb0160af6f4159cf700caec5448361765dfe1e2fd99accc2d53587b"
Sep 20 18:08:40 addons-850577 kubelet[2351]: I0920 18:08:40.465862 2351 scope.go:117] "RemoveContainer" containerID="cb9144005732b0b4023d89552ae77410821ccd8e9901dcd7e971e3510fd08258"
Sep 20 18:08:40 addons-850577 kubelet[2351]: E0920 18:08:40.466502 2351 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"gadget\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=gadget pod=gadget-72nst_gadget(f6786842-da0a-41e3-aa14-f99bd8e3655a)\"" pod="gadget/gadget-72nst" podUID="f6786842-da0a-41e3-aa14-f99bd8e3655a"
Sep 20 18:08:40 addons-850577 kubelet[2351]: I0920 18:08:40.475966 2351 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a432d9a-a7dc-4eee-b82a-b9bf9d04b997" path="/var/lib/kubelet/pods/6a432d9a-a7dc-4eee-b82a-b9bf9d04b997/volumes"
Sep 20 18:08:41 addons-850577 kubelet[2351]: I0920 18:08:41.275806 2351 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/25ec6de7-555e-4a19-af2f-2684fc2e84a8-gcp-creds\") pod \"25ec6de7-555e-4a19-af2f-2684fc2e84a8\" (UID: \"25ec6de7-555e-4a19-af2f-2684fc2e84a8\") "
Sep 20 18:08:41 addons-850577 kubelet[2351]: I0920 18:08:41.275963 2351 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8klmr\" (UniqueName: \"kubernetes.io/projected/25ec6de7-555e-4a19-af2f-2684fc2e84a8-kube-api-access-8klmr\") pod \"25ec6de7-555e-4a19-af2f-2684fc2e84a8\" (UID: \"25ec6de7-555e-4a19-af2f-2684fc2e84a8\") "
Sep 20 18:08:41 addons-850577 kubelet[2351]: I0920 18:08:41.275900 2351 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/25ec6de7-555e-4a19-af2f-2684fc2e84a8-gcp-creds" (OuterVolumeSpecName: "gcp-creds") pod "25ec6de7-555e-4a19-af2f-2684fc2e84a8" (UID: "25ec6de7-555e-4a19-af2f-2684fc2e84a8"). InnerVolumeSpecName "gcp-creds". PluginName "kubernetes.io/host-path", VolumeGidValue ""
Sep 20 18:08:41 addons-850577 kubelet[2351]: I0920 18:08:41.276733 2351 reconciler_common.go:288] "Volume detached for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/25ec6de7-555e-4a19-af2f-2684fc2e84a8-gcp-creds\") on node \"addons-850577\" DevicePath \"\""
Sep 20 18:08:41 addons-850577 kubelet[2351]: I0920 18:08:41.283314 2351 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25ec6de7-555e-4a19-af2f-2684fc2e84a8-kube-api-access-8klmr" (OuterVolumeSpecName: "kube-api-access-8klmr") pod "25ec6de7-555e-4a19-af2f-2684fc2e84a8" (UID: "25ec6de7-555e-4a19-af2f-2684fc2e84a8"). InnerVolumeSpecName "kube-api-access-8klmr". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 20 18:08:41 addons-850577 kubelet[2351]: I0920 18:08:41.377295 2351 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-8klmr\" (UniqueName: \"kubernetes.io/projected/25ec6de7-555e-4a19-af2f-2684fc2e84a8-kube-api-access-8klmr\") on node \"addons-850577\" DevicePath \"\""
Sep 20 18:08:42 addons-850577 kubelet[2351]: I0920 18:08:42.289052 2351 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vplmj\" (UniqueName: \"kubernetes.io/projected/48080209-95a2-4f92-83d3-4a339a6b1b54-kube-api-access-vplmj\") pod \"48080209-95a2-4f92-83d3-4a339a6b1b54\" (UID: \"48080209-95a2-4f92-83d3-4a339a6b1b54\") "
Sep 20 18:08:42 addons-850577 kubelet[2351]: I0920 18:08:42.294740 2351 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48080209-95a2-4f92-83d3-4a339a6b1b54-kube-api-access-vplmj" (OuterVolumeSpecName: "kube-api-access-vplmj") pod "48080209-95a2-4f92-83d3-4a339a6b1b54" (UID: "48080209-95a2-4f92-83d3-4a339a6b1b54"). InnerVolumeSpecName "kube-api-access-vplmj". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 20 18:08:42 addons-850577 kubelet[2351]: I0920 18:08:42.331440 2351 scope.go:117] "RemoveContainer" containerID="ab743b3168bf21c5901c6013e3eedeb2a4218eb2ac593c9f1797bd67e214b7cf"
Sep 20 18:08:42 addons-850577 kubelet[2351]: I0920 18:08:42.390195 2351 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-vplmj\" (UniqueName: \"kubernetes.io/projected/48080209-95a2-4f92-83d3-4a339a6b1b54-kube-api-access-vplmj\") on node \"addons-850577\" DevicePath \"\""
Sep 20 18:08:42 addons-850577 kubelet[2351]: I0920 18:08:42.486035 2351 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25ec6de7-555e-4a19-af2f-2684fc2e84a8" path="/var/lib/kubelet/pods/25ec6de7-555e-4a19-af2f-2684fc2e84a8/volumes"
Sep 20 18:08:42 addons-850577 kubelet[2351]: I0920 18:08:42.486316 2351 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48080209-95a2-4f92-83d3-4a339a6b1b54" path="/var/lib/kubelet/pods/48080209-95a2-4f92-83d3-4a339a6b1b54/volumes"
Sep 20 18:08:42 addons-850577 kubelet[2351]: I0920 18:08:42.591608 2351 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwrfx\" (UniqueName: \"kubernetes.io/projected/34be177b-c148-4a04-9275-afdde27c3678-kube-api-access-wwrfx\") pod \"34be177b-c148-4a04-9275-afdde27c3678\" (UID: \"34be177b-c148-4a04-9275-afdde27c3678\") "
Sep 20 18:08:42 addons-850577 kubelet[2351]: I0920 18:08:42.594095 2351 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34be177b-c148-4a04-9275-afdde27c3678-kube-api-access-wwrfx" (OuterVolumeSpecName: "kube-api-access-wwrfx") pod "34be177b-c148-4a04-9275-afdde27c3678" (UID: "34be177b-c148-4a04-9275-afdde27c3678"). InnerVolumeSpecName "kube-api-access-wwrfx". PluginName "kubernetes.io/projected", VolumeGidValue ""
Sep 20 18:08:42 addons-850577 kubelet[2351]: I0920 18:08:42.692667 2351 reconciler_common.go:288] "Volume detached for volume \"kube-api-access-wwrfx\" (UniqueName: \"kubernetes.io/projected/34be177b-c148-4a04-9275-afdde27c3678-kube-api-access-wwrfx\") on node \"addons-850577\" DevicePath \"\""
Sep 20 18:08:43 addons-850577 kubelet[2351]: I0920 18:08:43.355253 2351 scope.go:117] "RemoveContainer" containerID="0ae58fce91b0234aafb8c21e9914a236a4ade7bf57961951420d90f04432f6be"
==> storage-provisioner [48ba5c67461f] <==
I0920 17:56:03.431077 1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
I0920 17:56:03.452085 1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
I0920 17:56:03.452136 1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
I0920 17:56:03.473567 1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
I0920 17:56:03.477996 1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-850577_72358eea-0e46-48b6-87a8-3a0dbb56c58e!
I0920 17:56:03.478066 1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"6b43ea81-2cf6-4cdb-a253-10a333a9bc53", APIVersion:"v1", ResourceVersion:"508", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-850577_72358eea-0e46-48b6-87a8-3a0dbb56c58e became leader
I0920 17:56:03.582156 1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-850577_72358eea-0e46-48b6-87a8-3a0dbb56c58e!
-- /stdout --
helpers_test.go:254: (dbg) Run: out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-850577 -n addons-850577
helpers_test.go:261: (dbg) Run: kubectl --context addons-850577 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: busybox ingress-nginx-admission-create-d6p8g ingress-nginx-admission-patch-dgrfg
helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Registry]: describe non-running pods <======
helpers_test.go:277: (dbg) Run: kubectl --context addons-850577 describe pod busybox ingress-nginx-admission-create-d6p8g ingress-nginx-admission-patch-dgrfg
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-850577 describe pod busybox ingress-nginx-admission-create-d6p8g ingress-nginx-admission-patch-dgrfg: exit status 1 (110.609984ms)
-- stdout --
Name: busybox
Namespace: default
Priority: 0
Service Account: default
Node: addons-850577/192.168.49.2
Start Time: Fri, 20 Sep 2024 17:59:25 +0000
Labels: integration-test=busybox
Annotations: <none>
Status: Pending
IP: 10.244.0.27
IPs:
IP: 10.244.0.27
Containers:
busybox:
Container ID:
Image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
Image ID:
Port: <none>
Host Port: <none>
Command:
sleep
3600
State: Waiting
Reason: ImagePullBackOff
Ready: False
Restart Count: 0
Environment:
GOOGLE_APPLICATION_CREDENTIALS: /google-app-creds.json
PROJECT_ID: this_is_fake
GCP_PROJECT: this_is_fake
GCLOUD_PROJECT: this_is_fake
GOOGLE_CLOUD_PROJECT: this_is_fake
CLOUDSDK_CORE_PROJECT: this_is_fake
Mounts:
/google-app-creds.json from gcp-creds (ro)
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-c9jgm (ro)
Conditions:
Type Status
PodReadyToStartContainers True
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
kube-api-access-c9jgm:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
gcp-creds:
Type: HostPath (bare host directory volume)
Path: /var/lib/minikube/google_application_credentials.json
HostPathType: File
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 9m19s default-scheduler Successfully assigned default/busybox to addons-850577
Warning Failed 7m55s (x6 over 9m18s) kubelet Error: ImagePullBackOff
Normal Pulling 7m42s (x4 over 9m19s) kubelet Pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
Warning Failed 7m42s (x4 over 9m19s) kubelet Failed to pull image "gcr.io/k8s-minikube/busybox:1.28.4-glibc": Error response from daemon: Head "https://gcr.io/v2/k8s-minikube/busybox/manifests/1.28.4-glibc": unauthorized: authentication failed
Warning Failed 7m42s (x4 over 9m19s) kubelet Error: ErrImagePull
Normal BackOff 4m11s (x21 over 9m18s) kubelet Back-off pulling image "gcr.io/k8s-minikube/busybox:1.28.4-glibc"
-- /stdout --
** stderr **
Error from server (NotFound): pods "ingress-nginx-admission-create-d6p8g" not found
Error from server (NotFound): pods "ingress-nginx-admission-patch-dgrfg" not found
** /stderr **
helpers_test.go:279: kubectl --context addons-850577 describe pod busybox ingress-nginx-admission-create-d6p8g ingress-nginx-admission-patch-dgrfg: exit status 1
--- FAIL: TestAddons/parallel/Registry (75.80s)