=== RUN   TestAddons/parallel/Ingress

=== PAUSE TestAddons/parallel/Ingress

=== CONT  TestAddons/parallel/Ingress

addons_test.go:207: (dbg) Run:  kubectl --context addons-154736 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s

addons_test.go:232: (dbg) Run:  kubectl --context addons-154736 replace --force -f testdata/nginx-ingress-v1.yaml

addons_test.go:245: (dbg) Run:  kubectl --context addons-154736 replace --force -f testdata/nginx-pod-svc.yaml

addons_test.go:250: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...

helpers_test.go:344: "nginx" [89cc57b4-3f60-4a69-b7d3-dbc25226b9c0] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])

helpers_test.go:329: TestAddons/parallel/Ingress: WARNING: pod list for "default" "run=nginx" returned: client rate limiter Wait returned an error: rate: Wait(n=1) would exceed context deadline

addons_test.go:250: ***** TestAddons/parallel/Ingress: pod "run=nginx" failed to start within 8m0s: context deadline exceeded ****

addons_test.go:250: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-154736 -n addons-154736

addons_test.go:250: TestAddons/parallel/Ingress: showing logs for failed pods as of 2023-12-26 21:56:59.622298452 +0000 UTC m=+740.275273307

addons_test.go:250: (dbg) Run:  kubectl --context addons-154736 describe po nginx -n default

addons_test.go:250: (dbg) kubectl --context addons-154736 describe po nginx -n default:

Name:             nginx

Namespace:        default

Priority:         0

Service Account:  default

Node:             addons-154736/192.168.49.2

Start Time:       Tue, 26 Dec 2023 21:48:59 +0000

Labels:           run=nginx

Annotations:      <none>

Status:           Pending

IP:               10.244.0.27

IPs:

IP:  10.244.0.27

Containers:

nginx:

Container ID:   

Image:          docker.io/nginx:alpine

Image ID:       

Port:           80/TCP

Host Port:      0/TCP

State:          Waiting

Reason:       ImagePullBackOff

Ready:          False

Restart Count:  0

Environment:

GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json

PROJECT_ID:                      this_is_fake

GCP_PROJECT:                     this_is_fake

GCLOUD_PROJECT:                  this_is_fake

GOOGLE_CLOUD_PROJECT:            this_is_fake

CLOUDSDK_CORE_PROJECT:           this_is_fake

Mounts:

/google-app-creds.json from gcp-creds (ro)

/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-mttn4 (ro)

Conditions:

Type              Status

Initialized       True 

Ready             False 

ContainersReady   False 

PodScheduled      True 

Volumes:

kube-api-access-mttn4:

Type:                    Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds:  3607

ConfigMapName:           kube-root-ca.crt

ConfigMapOptional:       <nil>

DownwardAPI:             true

gcp-creds:

Type:          HostPath (bare host directory volume)

Path:          /var/lib/minikube/google_application_credentials.json

HostPathType:  File

QoS Class:         BestEffort

Node-Selectors:    <none>

Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

Events:

Type     Reason     Age                    From               Message

----     ------     ----                   ----               -------

Normal   Scheduled  8m                     default-scheduler  Successfully assigned default/nginx to addons-154736

Warning  Failed     7m29s                  kubelet            Failed to pull image "docker.io/nginx:alpine": initializing source docker://nginx:alpine: reading manifest alpine in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

Warning  Failed     4m27s                  kubelet            Failed to pull image "docker.io/nginx:alpine": loading manifest for target platform: reading manifest sha256:7913e8fa2e6a5f0160a5e6b7ea48b7d4a301c6058d63c3d632a35a59093cb4eb in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

Normal   Pulling    3m37s (x4 over 8m)     kubelet            Pulling image "docker.io/nginx:alpine"

Warning  Failed     3m7s (x4 over 7m29s)   kubelet            Error: ErrImagePull

Warning  Failed     3m7s (x2 over 5m59s)   kubelet            Failed to pull image "docker.io/nginx:alpine": reading manifest alpine in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

Normal   BackOff    2m42s (x7 over 7m29s)  kubelet            Back-off pulling image "docker.io/nginx:alpine"

Warning  Failed     2m42s (x7 over 7m29s)  kubelet            Error: ImagePullBackOff

addons_test.go:250: (dbg) Run:  kubectl --context addons-154736 logs nginx -n default

addons_test.go:250: (dbg) Non-zero exit: kubectl --context addons-154736 logs nginx -n default: exit status 1 (122.229831ms)

** stderr ** 

	Error from server (BadRequest): container "nginx" in pod "nginx" is waiting to start: trying and failing to pull image

** /stderr **

addons_test.go:250: kubectl --context addons-154736 logs nginx -n default: exit status 1

addons_test.go:251: failed waiting for ngnix pod: run=nginx within 8m0s: context deadline exceeded

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestAddons/parallel/Ingress]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect addons-154736

helpers_test.go:235: (dbg) docker inspect addons-154736:

-- stdout --

	[

	    {

	        "Id": "0927c77a91cb3abbb70268b3a742f5c0c803d1cbb42dd1efdc24f53bd33e9c94",

	        "Created": "2023-12-26T21:45:41.806387804Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 704120,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2023-12-26T21:45:42.123091502Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:3bfff26a1ae256fcdf8f10a333efdefbe26edc5c1669e1cc5c973c016e44d3c4",

	        "ResolvConfPath": "/var/lib/docker/containers/0927c77a91cb3abbb70268b3a742f5c0c803d1cbb42dd1efdc24f53bd33e9c94/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/0927c77a91cb3abbb70268b3a742f5c0c803d1cbb42dd1efdc24f53bd33e9c94/hostname",

	        "HostsPath": "/var/lib/docker/containers/0927c77a91cb3abbb70268b3a742f5c0c803d1cbb42dd1efdc24f53bd33e9c94/hosts",

	        "LogPath": "/var/lib/docker/containers/0927c77a91cb3abbb70268b3a742f5c0c803d1cbb42dd1efdc24f53bd33e9c94/0927c77a91cb3abbb70268b3a742f5c0c803d1cbb42dd1efdc24f53bd33e9c94-json.log",

	        "Name": "/addons-154736",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "unconfined",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "addons-154736:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "addons-154736",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 4194304000,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": [],

	            "BlkioDeviceWriteBps": [],

	            "BlkioDeviceReadIOps": [],

	            "BlkioDeviceWriteIOps": [],

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "MemoryReservation": 0,

	            "MemorySwap": 8388608000,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/c0eaaf8543365e6297970bf5096d74b7af77ea75fc0bb6e681d7f593d9e01e51-init/diff:/var/lib/docker/overlay2/45396a29879cab7c8a67d68e40c59b67c1c0ba964e9ed87a152af8cc5862c477/diff",

	                "MergedDir": "/var/lib/docker/overlay2/c0eaaf8543365e6297970bf5096d74b7af77ea75fc0bb6e681d7f593d9e01e51/merged",

	                "UpperDir": "/var/lib/docker/overlay2/c0eaaf8543365e6297970bf5096d74b7af77ea75fc0bb6e681d7f593d9e01e51/diff",

	                "WorkDir": "/var/lib/docker/overlay2/c0eaaf8543365e6297970bf5096d74b7af77ea75fc0bb6e681d7f593d9e01e51/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "addons-154736",

	                "Source": "/var/lib/docker/volumes/addons-154736/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "addons-154736",

	            "Domainname": "",

	            "User": "",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c",

	            "Volumes": null,

	            "WorkingDir": "/",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "addons-154736",

	                "name.minikube.sigs.k8s.io": "addons-154736",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "2c290e95bcf18514e9253c173e0261fcd2cebaf9efe8ca6024d46b1bc1ba866a",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33671"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33670"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33667"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33669"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33668"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/2c290e95bcf1",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "addons-154736": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "0927c77a91cb",

	                        "addons-154736"

	                    ],

	                    "NetworkID": "0ce741a8f930f44069a6bdf9f4ed33b0b28aabc7b6040abdd1f84433f7a93e9c",

	                    "EndpointID": "0c120efe77a5545a5dd5f788310b2f79bca21a0517ac182d7e7a20aa1f26e532",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p addons-154736 -n addons-154736

helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Ingress]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p addons-154736 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-154736 logs -n 25: (1.709737425s)

helpers_test.go:252: TestAddons/parallel/Ingress logs: 

-- stdout --

	==> Audit <==

	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|

	| Command |                                            Args                                             |        Profile         |  User   | Version |     Start Time      |      End Time       |

	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|

	| start   | -o=json --download-only                                                                     | download-only-988176   | jenkins | v1.32.0 | 26 Dec 23 21:44 UTC |                     |

	|         | -p download-only-988176                                                                     |                        |         |         |                     |                     |

	|         | --force --alsologtostderr                                                                   |                        |         |         |                     |                     |

	|         | --kubernetes-version=v1.16.0                                                                |                        |         |         |                     |                     |

	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |

	|         | --driver=docker                                                                             |                        |         |         |                     |                     |

	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |

	| start   | -o=json --download-only                                                                     | download-only-988176   | jenkins | v1.32.0 | 26 Dec 23 21:44 UTC |                     |

	|         | -p download-only-988176                                                                     |                        |         |         |                     |                     |

	|         | --force --alsologtostderr                                                                   |                        |         |         |                     |                     |

	|         | --kubernetes-version=v1.28.4                                                                |                        |         |         |                     |                     |

	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |

	|         | --driver=docker                                                                             |                        |         |         |                     |                     |

	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |

	| start   | -o=json --download-only                                                                     | download-only-988176   | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC |                     |

	|         | -p download-only-988176                                                                     |                        |         |         |                     |                     |

	|         | --force --alsologtostderr                                                                   |                        |         |         |                     |                     |

	|         | --kubernetes-version=v1.29.0-rc.2                                                           |                        |         |         |                     |                     |

	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |

	|         | --driver=docker                                                                             |                        |         |         |                     |                     |

	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |

	| delete  | --all                                                                                       | minikube               | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC | 26 Dec 23 21:45 UTC |

	| delete  | -p download-only-988176                                                                     | download-only-988176   | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC | 26 Dec 23 21:45 UTC |

	| delete  | -p download-only-988176                                                                     | download-only-988176   | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC | 26 Dec 23 21:45 UTC |

	| start   | --download-only -p                                                                          | download-docker-374836 | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC |                     |

	|         | download-docker-374836                                                                      |                        |         |         |                     |                     |

	|         | --alsologtostderr                                                                           |                        |         |         |                     |                     |

	|         | --driver=docker                                                                             |                        |         |         |                     |                     |

	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |

	| delete  | -p download-docker-374836                                                                   | download-docker-374836 | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC | 26 Dec 23 21:45 UTC |

	| start   | --download-only -p                                                                          | binary-mirror-438777   | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC |                     |

	|         | binary-mirror-438777                                                                        |                        |         |         |                     |                     |

	|         | --alsologtostderr                                                                           |                        |         |         |                     |                     |

	|         | --binary-mirror                                                                             |                        |         |         |                     |                     |

	|         | http://127.0.0.1:45525                                                                      |                        |         |         |                     |                     |

	|         | --driver=docker                                                                             |                        |         |         |                     |                     |

	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |

	| delete  | -p binary-mirror-438777                                                                     | binary-mirror-438777   | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC | 26 Dec 23 21:45 UTC |

	| addons  | enable dashboard -p                                                                         | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC |                     |

	|         | addons-154736                                                                               |                        |         |         |                     |                     |

	| addons  | disable dashboard -p                                                                        | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC |                     |

	|         | addons-154736                                                                               |                        |         |         |                     |                     |

	| start   | -p addons-154736 --wait=true                                                                | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC | 26 Dec 23 21:48 UTC |

	|         | --memory=4000 --alsologtostderr                                                             |                        |         |         |                     |                     |

	|         | --addons=registry                                                                           |                        |         |         |                     |                     |

	|         | --addons=metrics-server                                                                     |                        |         |         |                     |                     |

	|         | --addons=volumesnapshots                                                                    |                        |         |         |                     |                     |

	|         | --addons=csi-hostpath-driver                                                                |                        |         |         |                     |                     |

	|         | --addons=gcp-auth                                                                           |                        |         |         |                     |                     |

	|         | --addons=cloud-spanner                                                                      |                        |         |         |                     |                     |

	|         | --addons=inspektor-gadget                                                                   |                        |         |         |                     |                     |

	|         | --addons=storage-provisioner-rancher                                                        |                        |         |         |                     |                     |

	|         | --addons=nvidia-device-plugin                                                               |                        |         |         |                     |                     |

	|         | --addons=yakd --driver=docker                                                               |                        |         |         |                     |                     |

	|         |  --container-runtime=crio                                                                   |                        |         |         |                     |                     |

	|         | --addons=ingress                                                                            |                        |         |         |                     |                     |

	|         | --addons=ingress-dns                                                                        |                        |         |         |                     |                     |

	| addons  | enable headlamp                                                                             | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:48 UTC | 26 Dec 23 21:48 UTC |

	|         | -p addons-154736                                                                            |                        |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |

	| ip      | addons-154736 ip                                                                            | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:48 UTC | 26 Dec 23 21:48 UTC |

	| addons  | addons-154736 addons disable                                                                | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:48 UTC | 26 Dec 23 21:48 UTC |

	|         | registry --alsologtostderr                                                                  |                        |         |         |                     |                     |

	|         | -v=1                                                                                        |                        |         |         |                     |                     |

	| addons  | disable nvidia-device-plugin                                                                | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:48 UTC | 26 Dec 23 21:48 UTC |

	|         | -p addons-154736                                                                            |                        |         |         |                     |                     |

	| ssh     | addons-154736 ssh cat                                                                       | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:48 UTC | 26 Dec 23 21:48 UTC |

	|         | /opt/local-path-provisioner/pvc-e94447a0-cc9f-4ee2-b024-1e95c001aae0_default_test-pvc/file1 |                        |         |         |                     |                     |

	| addons  | addons-154736 addons disable                                                                | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:48 UTC | 26 Dec 23 21:48 UTC |

	|         | storage-provisioner-rancher                                                                 |                        |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |

	| addons  | disable cloud-spanner -p                                                                    | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:48 UTC | 26 Dec 23 21:48 UTC |

	|         | addons-154736                                                                               |                        |         |         |                     |                     |

	| addons  | disable inspektor-gadget -p                                                                 | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:48 UTC | 26 Dec 23 21:48 UTC |

	|         | addons-154736                                                                               |                        |         |         |                     |                     |

	| addons  | addons-154736 addons                                                                        | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:48 UTC | 26 Dec 23 21:48 UTC |

	|         | disable metrics-server                                                                      |                        |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |

	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2023/12/26 21:45:17

	Running on machine: ip-172-31-21-244

	Binary: Built with gc go1.21.5 for linux/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1226 21:45:17.357121  703653 out.go:296] Setting OutFile to fd 1 ...

	I1226 21:45:17.357260  703653 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 21:45:17.357268  703653 out.go:309] Setting ErrFile to fd 2...

	I1226 21:45:17.357273  703653 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 21:45:17.357532  703653 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17857-697646/.minikube/bin

	I1226 21:45:17.358030  703653 out.go:303] Setting JSON to false

	I1226 21:45:17.358813  703653 start.go:128] hostinfo: {"hostname":"ip-172-31-21-244","uptime":19651,"bootTime":1703607466,"procs":144,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}

	I1226 21:45:17.358889  703653 start.go:138] virtualization:  

	I1226 21:45:17.361650  703653 out.go:177] * [addons-154736] minikube v1.32.0 on Ubuntu 20.04 (arm64)

	I1226 21:45:17.364230  703653 out.go:177]   - MINIKUBE_LOCATION=17857

	I1226 21:45:17.365978  703653 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1226 21:45:17.364366  703653 notify.go:220] Checking for updates...

	I1226 21:45:17.369777  703653 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17857-697646/kubeconfig

	I1226 21:45:17.371642  703653 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17857-697646/.minikube

	I1226 21:45:17.373457  703653 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64

	I1226 21:45:17.375253  703653 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1226 21:45:17.377723  703653 driver.go:392] Setting default libvirt URI to qemu:///system

	I1226 21:45:17.401923  703653 docker.go:122] docker version: linux-24.0.7:Docker Engine - Community

	I1226 21:45:17.402036  703653 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1226 21:45:17.480034  703653 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-12-26 21:45:17.470030553 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1051-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi

tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dd1e886e55dd695541fdcd67420c2888645a495 Expected:3dd1e886e55dd695541fdcd67420c2888645a495} RuncCommit:{ID:v1.1.10-0-g18a0cb0 Expected:v1.1.10-0-g18a0cb0} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>

ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}

	I1226 21:45:17.480160  703653 docker.go:295] overlay module found

	I1226 21:45:17.482441  703653 out.go:177] * Using the docker driver based on user configuration

	I1226 21:45:17.484480  703653 start.go:298] selected driver: docker

	I1226 21:45:17.484501  703653 start.go:902] validating driver "docker" against <nil>

	I1226 21:45:17.484556  703653 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1226 21:45:17.485187  703653 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1226 21:45:17.559712  703653 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-12-26 21:45:17.550602015 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1051-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi

tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dd1e886e55dd695541fdcd67420c2888645a495 Expected:3dd1e886e55dd695541fdcd67420c2888645a495} RuncCommit:{ID:v1.1.10-0-g18a0cb0 Expected:v1.1.10-0-g18a0cb0} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>

ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}

	I1226 21:45:17.559868  703653 start_flags.go:309] no existing cluster config was found, will generate one from the flags 

	I1226 21:45:17.560121  703653 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1226 21:45:17.562089  703653 out.go:177] * Using Docker driver with root privileges

	I1226 21:45:17.564061  703653 cni.go:84] Creating CNI manager for ""

	I1226 21:45:17.564086  703653 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet

	I1226 21:45:17.564098  703653 start_flags.go:318] Found "CNI" CNI - setting NetworkPlugin=cni

	I1226 21:45:17.564115  703653 start_flags.go:323] config:

	{Name:addons-154736 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:addons-154736 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI

Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}

	I1226 21:45:17.566567  703653 out.go:177] * Starting control plane node addons-154736 in cluster addons-154736

	I1226 21:45:17.568294  703653 cache.go:121] Beginning downloading kic base image for docker with crio

	I1226 21:45:17.570474  703653 out.go:177] * Pulling base image v0.0.42-1703498848-17857 ...

	I1226 21:45:17.572562  703653 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio

	I1226 21:45:17.572616  703653 preload.go:148] Found local preload: /home/jenkins/minikube-integration/17857-697646/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-arm64.tar.lz4

	I1226 21:45:17.572637  703653 cache.go:56] Caching tarball of preloaded images

	I1226 21:45:17.572720  703653 preload.go:174] Found /home/jenkins/minikube-integration/17857-697646/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-arm64.tar.lz4 in cache, skipping download

	I1226 21:45:17.572729  703653 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on crio

	I1226 21:45:17.573075  703653 profile.go:148] Saving config to /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/config.json ...

	I1226 21:45:17.573094  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/config.json: {Name:mk543582001de673a7ac0933815d446a06676405 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:17.573254  703653 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local docker daemon

	I1226 21:45:17.589840  703653 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c to local cache

	I1226 21:45:17.589980  703653 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local cache directory

	I1226 21:45:17.590005  703653 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local cache directory, skipping pull

	I1226 21:45:17.590014  703653 image.go:105] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c exists in cache, skipping pull

	I1226 21:45:17.590022  703653 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c as a tarball

	I1226 21:45:17.590027  703653 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c from local cache

	I1226 21:45:33.563146  703653 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c from cached tarball

	I1226 21:45:33.563189  703653 cache.go:194] Successfully downloaded all kic artifacts

	I1226 21:45:33.563259  703653 start.go:365] acquiring machines lock for addons-154736: {Name:mk2d6ec3bfe0e7c6048525ebd8a1df5b118807f9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1226 21:45:33.563390  703653 start.go:369] acquired machines lock for "addons-154736" in 102.562µs

	I1226 21:45:33.563421  703653 start.go:93] Provisioning new machine with config: &{Name:addons-154736 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:addons-154736 Namespace:default APIServerName:minikubeCA A

PIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disabl

eMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1226 21:45:33.563501  703653 start.go:125] createHost starting for "" (driver="docker")

	I1226 21:45:33.565694  703653 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...

	I1226 21:45:33.565980  703653 start.go:159] libmachine.API.Create for "addons-154736" (driver="docker")

	I1226 21:45:33.566014  703653 client.go:168] LocalClient.Create starting

	I1226 21:45:33.566134  703653 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca.pem

	I1226 21:45:34.659916  703653 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/cert.pem

	I1226 21:45:35.203057  703653 cli_runner.go:164] Run: docker network inspect addons-154736 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1226 21:45:35.223431  703653 cli_runner.go:211] docker network inspect addons-154736 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1226 21:45:35.223524  703653 network_create.go:281] running [docker network inspect addons-154736] to gather additional debugging logs...

	I1226 21:45:35.223560  703653 cli_runner.go:164] Run: docker network inspect addons-154736

	W1226 21:45:35.241707  703653 cli_runner.go:211] docker network inspect addons-154736 returned with exit code 1

	I1226 21:45:35.241741  703653 network_create.go:284] error running [docker network inspect addons-154736]: docker network inspect addons-154736: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network addons-154736 not found

	I1226 21:45:35.241753  703653 network_create.go:286] output of [docker network inspect addons-154736]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network addons-154736 not found

	** /stderr **

	I1226 21:45:35.241866  703653 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 21:45:35.259937  703653 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40024e5ac0}

	I1226 21:45:35.259975  703653 network_create.go:124] attempt to create docker network addons-154736 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...

	I1226 21:45:35.260042  703653 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-154736 addons-154736

	I1226 21:45:35.335366  703653 network_create.go:108] docker network addons-154736 192.168.49.0/24 created

	I1226 21:45:35.335400  703653 kic.go:121] calculated static IP "192.168.49.2" for the "addons-154736" container

	I1226 21:45:35.335480  703653 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I1226 21:45:35.352573  703653 cli_runner.go:164] Run: docker volume create addons-154736 --label name.minikube.sigs.k8s.io=addons-154736 --label created_by.minikube.sigs.k8s.io=true

	I1226 21:45:35.370827  703653 oci.go:103] Successfully created a docker volume addons-154736

	I1226 21:45:35.370918  703653 cli_runner.go:164] Run: docker run --rm --name addons-154736-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-154736 --entrypoint /usr/bin/test -v addons-154736:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -d /var/lib

	I1226 21:45:37.529102  703653 cli_runner.go:217] Completed: docker run --rm --name addons-154736-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-154736 --entrypoint /usr/bin/test -v addons-154736:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -d /var/lib: (2.158128411s)

	I1226 21:45:37.529133  703653 oci.go:107] Successfully prepared a docker volume addons-154736

	I1226 21:45:37.529167  703653 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio

	I1226 21:45:37.529191  703653 kic.go:194] Starting extracting preloaded images to volume ...

	I1226 21:45:37.529267  703653 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17857-697646/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v addons-154736:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -I lz4 -xf /preloaded.tar -C /extractDir

	I1226 21:45:41.723596  703653 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17857-697646/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v addons-154736:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -I lz4 -xf /preloaded.tar -C /extractDir: (4.194288032s)

	I1226 21:45:41.723631  703653 kic.go:203] duration metric: took 4.194436 seconds to extract preloaded images to volume

	W1226 21:45:41.723767  703653 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.

	I1226 21:45:41.723910  703653 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"

	I1226 21:45:41.790451  703653 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-154736 --name addons-154736 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-154736 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-154736 --network addons-154736 --ip 192.168.49.2 --volume addons-154736:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c

	I1226 21:45:42.139875  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Running}}

	I1226 21:45:42.180243  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:45:42.207149  703653 cli_runner.go:164] Run: docker exec addons-154736 stat /var/lib/dpkg/alternatives/iptables

	I1226 21:45:42.298703  703653 oci.go:144] the created container "addons-154736" has a running status.

	I1226 21:45:42.298732  703653 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa...

	I1226 21:45:43.584121  703653 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)

	I1226 21:45:43.607127  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:45:43.625334  703653 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys

	I1226 21:45:43.625358  703653 kic_runner.go:114] Args: [docker exec --privileged addons-154736 chown docker:docker /home/docker/.ssh/authorized_keys]

	I1226 21:45:43.682322  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:45:43.701947  703653 machine.go:88] provisioning docker machine ...

	I1226 21:45:43.701980  703653 ubuntu.go:169] provisioning hostname "addons-154736"

	I1226 21:45:43.702051  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:45:43.727271  703653 main.go:141] libmachine: Using SSH client type: native

	I1226 21:45:43.727709  703653 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3beb50] 0x3c12c0 <nil>  [] 0s} 127.0.0.1 33671 <nil> <nil>}

	I1226 21:45:43.727730  703653 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-154736 && echo "addons-154736" | sudo tee /etc/hostname

	I1226 21:45:43.887415  703653 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-154736

	I1226 21:45:43.887494  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:45:43.907302  703653 main.go:141] libmachine: Using SSH client type: native

	I1226 21:45:43.907710  703653 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3beb50] 0x3c12c0 <nil>  [] 0s} 127.0.0.1 33671 <nil> <nil>}

	I1226 21:45:43.907728  703653 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-154736' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-154736/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-154736' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1226 21:45:44.045974  703653 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1226 21:45:44.046002  703653 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17857-697646/.minikube CaCertPath:/home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17857-697646/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17857-697646/.minikube}

	I1226 21:45:44.046068  703653 ubuntu.go:177] setting up certificates

	I1226 21:45:44.046078  703653 provision.go:83] configureAuth start

	I1226 21:45:44.046159  703653 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-154736

	I1226 21:45:44.065356  703653 provision.go:138] copyHostCerts

	I1226 21:45:44.065455  703653 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17857-697646/.minikube/ca.pem (1082 bytes)

	I1226 21:45:44.065605  703653 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17857-697646/.minikube/cert.pem (1123 bytes)

	I1226 21:45:44.065670  703653 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17857-697646/.minikube/key.pem (1679 bytes)

	I1226 21:45:44.065751  703653 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17857-697646/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca-key.pem org=jenkins.addons-154736 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube addons-154736]

	I1226 21:45:44.682633  703653 provision.go:172] copyRemoteCerts

	I1226 21:45:44.682703  703653 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1226 21:45:44.682742  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:45:44.700544  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:45:44.799116  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)

	I1226 21:45:44.827540  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1226 21:45:44.855809  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1226 21:45:44.884433  703653 provision.go:86] duration metric: configureAuth took 838.312591ms

	I1226 21:45:44.884503  703653 ubuntu.go:193] setting minikube options for container-runtime

	I1226 21:45:44.884750  703653 config.go:182] Loaded profile config "addons-154736": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4

	I1226 21:45:44.884864  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:45:44.902598  703653 main.go:141] libmachine: Using SSH client type: native

	I1226 21:45:44.903006  703653 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3beb50] 0x3c12c0 <nil>  [] 0s} 127.0.0.1 33671 <nil> <nil>}

	I1226 21:45:44.903028  703653 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I1226 21:45:45.207361  703653 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I1226 21:45:45.207438  703653 machine.go:91] provisioned docker machine in 1.505466578s

	I1226 21:45:45.207468  703653 client.go:171] LocalClient.Create took 11.641443787s

	I1226 21:45:45.207516  703653 start.go:167] duration metric: libmachine.API.Create for "addons-154736" took 11.641516072s

	I1226 21:45:45.207545  703653 start.go:300] post-start starting for "addons-154736" (driver="docker")

	I1226 21:45:45.207576  703653 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1226 21:45:45.207691  703653 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1226 21:45:45.207766  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:45:45.239347  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:45:45.349897  703653 ssh_runner.go:195] Run: cat /etc/os-release

	I1226 21:45:45.355640  703653 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1226 21:45:45.355681  703653 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1226 21:45:45.355694  703653 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1226 21:45:45.355701  703653 info.go:137] Remote host: Ubuntu 22.04.3 LTS

	I1226 21:45:45.355711  703653 filesync.go:126] Scanning /home/jenkins/minikube-integration/17857-697646/.minikube/addons for local assets ...

	I1226 21:45:45.355790  703653 filesync.go:126] Scanning /home/jenkins/minikube-integration/17857-697646/.minikube/files for local assets ...

	I1226 21:45:45.355834  703653 start.go:303] post-start completed in 148.256524ms

	I1226 21:45:45.356161  703653 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-154736

	I1226 21:45:45.377553  703653 profile.go:148] Saving config to /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/config.json ...

	I1226 21:45:45.377843  703653 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 21:45:45.377893  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:45:45.397872  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:45:45.494484  703653 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 21:45:45.500291  703653 start.go:128] duration metric: createHost completed in 11.93677223s

	I1226 21:45:45.500316  703653 start.go:83] releasing machines lock for "addons-154736", held for 11.93691191s

	I1226 21:45:45.500400  703653 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-154736

	I1226 21:45:45.518617  703653 ssh_runner.go:195] Run: cat /version.json

	I1226 21:45:45.518632  703653 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1226 21:45:45.518672  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:45:45.518688  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:45:45.540730  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:45:45.541414  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:45:45.773361  703653 ssh_runner.go:195] Run: systemctl --version

	I1226 21:45:45.779480  703653 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I1226 21:45:45.928374  703653 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I1226 21:45:45.934285  703653 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1226 21:45:45.960009  703653 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found

	I1226 21:45:45.960108  703653 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1226 21:45:46.007940  703653 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)

	I1226 21:45:46.008022  703653 start.go:475] detecting cgroup driver to use...

	I1226 21:45:46.008095  703653 detect.go:196] detected "cgroupfs" cgroup driver on host os

	I1226 21:45:46.008197  703653 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1226 21:45:46.027491  703653 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1226 21:45:46.041920  703653 docker.go:203] disabling cri-docker service (if available) ...

	I1226 21:45:46.042015  703653 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I1226 21:45:46.058996  703653 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I1226 21:45:46.076168  703653 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I1226 21:45:46.176076  703653 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I1226 21:45:46.283099  703653 docker.go:219] disabling docker service ...

	I1226 21:45:46.283188  703653 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I1226 21:45:46.304709  703653 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I1226 21:45:46.318373  703653 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I1226 21:45:46.415364  703653 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I1226 21:45:46.525204  703653 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I1226 21:45:46.538401  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I1226 21:45:46.558845  703653 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I1226 21:45:46.558912  703653 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1226 21:45:46.570719  703653 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I1226 21:45:46.570843  703653 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1226 21:45:46.582868  703653 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I1226 21:45:46.594679  703653 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I1226 21:45:46.607554  703653 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1226 21:45:46.618987  703653 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1226 21:45:46.629441  703653 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1226 21:45:46.640009  703653 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1226 21:45:46.737436  703653 ssh_runner.go:195] Run: sudo systemctl restart crio

	I1226 21:45:46.868766  703653 start.go:522] Will wait 60s for socket path /var/run/crio/crio.sock

	I1226 21:45:46.868855  703653 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I1226 21:45:46.873648  703653 start.go:543] Will wait 60s for crictl version

	I1226 21:45:46.873714  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:45:46.878246  703653 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1226 21:45:46.923846  703653 start.go:559] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.24.6

	RuntimeApiVersion:  v1

	I1226 21:45:46.923968  703653 ssh_runner.go:195] Run: crio --version

	I1226 21:45:46.972287  703653 ssh_runner.go:195] Run: crio --version

	I1226 21:45:47.024056  703653 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.6 ...

	I1226 21:45:47.026175  703653 cli_runner.go:164] Run: docker network inspect addons-154736 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 21:45:47.043826  703653 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts

	I1226 21:45:47.048434  703653 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1226 21:45:47.062328  703653 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio

	I1226 21:45:47.062400  703653 ssh_runner.go:195] Run: sudo crictl images --output json

	I1226 21:45:47.129771  703653 crio.go:496] all images are preloaded for cri-o runtime.

	I1226 21:45:47.129798  703653 crio.go:415] Images already preloaded, skipping extraction

	I1226 21:45:47.129855  703653 ssh_runner.go:195] Run: sudo crictl images --output json

	I1226 21:45:47.170543  703653 crio.go:496] all images are preloaded for cri-o runtime.

	I1226 21:45:47.170567  703653 cache_images.go:84] Images are preloaded, skipping loading

	I1226 21:45:47.170642  703653 ssh_runner.go:195] Run: crio config

	I1226 21:45:47.225638  703653 cni.go:84] Creating CNI manager for ""

	I1226 21:45:47.225661  703653 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet

	I1226 21:45:47.225693  703653 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1226 21:45:47.225714  703653 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-154736 NodeName:addons-154736 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuberne

tes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1226 21:45:47.225856  703653 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.49.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "addons-154736"

	  kubeletExtraArgs:

	    node-ip: 192.168.49.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.28.4

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1226 21:45:47.225917  703653 kubeadm.go:976] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=addons-154736 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2

	[Install]

	 config:

	{KubernetesVersion:v1.28.4 ClusterName:addons-154736 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1226 21:45:47.225985  703653 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4

	I1226 21:45:47.237056  703653 binaries.go:44] Found k8s binaries, skipping transfer

	I1226 21:45:47.237133  703653 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1226 21:45:47.247946  703653 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (423 bytes)

	I1226 21:45:47.269840  703653 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1226 21:45:47.291674  703653 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2094 bytes)

	I1226 21:45:47.313342  703653 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts

	I1226 21:45:47.317861  703653 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1226 21:45:47.331485  703653 certs.go:56] Setting up /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736 for IP: 192.168.49.2

	I1226 21:45:47.331518  703653 certs.go:190] acquiring lock for shared ca certs: {Name:mke6488a150c186a525017f74b8a69a9f5240d76 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:47.331655  703653 certs.go:204] generating minikubeCA CA: /home/jenkins/minikube-integration/17857-697646/.minikube/ca.key

	I1226 21:45:47.957856  703653 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17857-697646/.minikube/ca.crt ...

	I1226 21:45:47.957886  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/ca.crt: {Name:mk47f0115b5b2e0f9fb3d82c3586bf65061aba13 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:47.958103  703653 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17857-697646/.minikube/ca.key ...

	I1226 21:45:47.958116  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/ca.key: {Name:mkf78405cdbf4f9984f2752ec84f5767189bbbb7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:47.958203  703653 certs.go:204] generating proxyClientCA CA: /home/jenkins/minikube-integration/17857-697646/.minikube/proxy-client-ca.key

	I1226 21:45:48.793651  703653 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17857-697646/.minikube/proxy-client-ca.crt ...

	I1226 21:45:48.793685  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/proxy-client-ca.crt: {Name:mkfdb1f360b5d2e7d5f43ab0b751b43bd0785f9b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:48.793879  703653 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17857-697646/.minikube/proxy-client-ca.key ...

	I1226 21:45:48.793891  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/proxy-client-ca.key: {Name:mkdcc5cfb23c652bc0a238c143809b638efe2934 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:48.794001  703653 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/client.key

	I1226 21:45:48.794021  703653 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/client.crt with IP's: []

	I1226 21:45:49.130100  703653 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/client.crt ...

	I1226 21:45:49.130132  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/client.crt: {Name:mk5b103a47afc40825354234830fdd6d328e23cd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:49.130328  703653 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/client.key ...

	I1226 21:45:49.130341  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/client.key: {Name:mk8109095c1de71d7b1e565af62dedeafa19e192 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:49.130979  703653 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.key.dd3b5fb2

	I1226 21:45:49.131003  703653 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I1226 21:45:49.342573  703653 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.crt.dd3b5fb2 ...

	I1226 21:45:49.342606  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.crt.dd3b5fb2: {Name:mkbf4e612869b6431d860f33b33b959adfcdb9d9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:49.342798  703653 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.key.dd3b5fb2 ...

	I1226 21:45:49.342811  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.key.dd3b5fb2: {Name:mkd83808fc939bd68c9f62be01c7ab9dc98abd0d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:49.342902  703653 certs.go:337] copying /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.crt

	I1226 21:45:49.342981  703653 certs.go:341] copying /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.key

	I1226 21:45:49.343036  703653 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/proxy-client.key

	I1226 21:45:49.343051  703653 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/proxy-client.crt with IP's: []

	I1226 21:45:49.729468  703653 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/proxy-client.crt ...

	I1226 21:45:49.729499  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/proxy-client.crt: {Name:mk5f2f9075967085d62c91e8f08859c48d8fb037 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:49.729683  703653 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/proxy-client.key ...

	I1226 21:45:49.729697  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/proxy-client.key: {Name:mk6e3ac998613569553a1ffff7932a3627336a0d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:49.729906  703653 certs.go:437] found cert: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca-key.pem (1675 bytes)

	I1226 21:45:49.729951  703653 certs.go:437] found cert: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca.pem (1082 bytes)

	I1226 21:45:49.730001  703653 certs.go:437] found cert: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/home/jenkins/minikube-integration/17857-697646/.minikube/certs/cert.pem (1123 bytes)

	I1226 21:45:49.730030  703653 certs.go:437] found cert: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/home/jenkins/minikube-integration/17857-697646/.minikube/certs/key.pem (1679 bytes)

	I1226 21:45:49.730627  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1226 21:45:49.761140  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1226 21:45:49.791177  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1226 21:45:49.820829  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I1226 21:45:49.849585  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1226 21:45:49.878912  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1226 21:45:49.909268  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1226 21:45:49.941348  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1226 21:45:49.970836  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1226 21:45:49.999844  703653 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1226 21:45:50.029395  703653 ssh_runner.go:195] Run: openssl version

	I1226 21:45:50.037542  703653 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1226 21:45:50.050867  703653 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1226 21:45:50.056091  703653 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Dec 26 21:45 /usr/share/ca-certificates/minikubeCA.pem

	I1226 21:45:50.056176  703653 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1226 21:45:50.065485  703653 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1226 21:45:50.078013  703653 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I1226 21:45:50.083315  703653 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I1226 21:45:50.083437  703653 kubeadm.go:404] StartCluster: {Name:addons-154736 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:addons-154736 Namespace:default APIServerName:minikubeCA APIServerNames:[] APISe

rverIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:f

alse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}

	I1226 21:45:50.083527  703653 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I1226 21:45:50.083590  703653 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I1226 21:45:50.144212  703653 cri.go:89] found id: ""

	I1226 21:45:50.144288  703653 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1226 21:45:50.156065  703653 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1226 21:45:50.167528  703653 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver

	I1226 21:45:50.167619  703653 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1226 21:45:50.179275  703653 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1226 21:45:50.179343  703653 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I1226 21:45:50.239492  703653 kubeadm.go:322] [init] Using Kubernetes version: v1.28.4

	I1226 21:45:50.239794  703653 kubeadm.go:322] [preflight] Running pre-flight checks

	I1226 21:45:50.287034  703653 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:

	I1226 21:45:50.287162  703653 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1051-aws

	I1226 21:45:50.287219  703653 kubeadm.go:322] OS: Linux

	I1226 21:45:50.287279  703653 kubeadm.go:322] CGROUPS_CPU: enabled

	I1226 21:45:50.287349  703653 kubeadm.go:322] CGROUPS_CPUACCT: enabled

	I1226 21:45:50.287410  703653 kubeadm.go:322] CGROUPS_CPUSET: enabled

	I1226 21:45:50.287480  703653 kubeadm.go:322] CGROUPS_DEVICES: enabled

	I1226 21:45:50.287553  703653 kubeadm.go:322] CGROUPS_FREEZER: enabled

	I1226 21:45:50.287623  703653 kubeadm.go:322] CGROUPS_MEMORY: enabled

	I1226 21:45:50.287682  703653 kubeadm.go:322] CGROUPS_PIDS: enabled

	I1226 21:45:50.287752  703653 kubeadm.go:322] CGROUPS_HUGETLB: enabled

	I1226 21:45:50.287813  703653 kubeadm.go:322] CGROUPS_BLKIO: enabled

	I1226 21:45:50.370303  703653 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I1226 21:45:50.370463  703653 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I1226 21:45:50.370584  703653 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I1226 21:45:50.630713  703653 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1226 21:45:50.635156  703653 out.go:204]   - Generating certificates and keys ...

	I1226 21:45:50.635285  703653 kubeadm.go:322] [certs] Using existing ca certificate authority

	I1226 21:45:50.635356  703653 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I1226 21:45:50.944392  703653 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key

	I1226 21:45:51.488209  703653 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key

	I1226 21:45:51.868223  703653 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key

	I1226 21:45:52.038881  703653 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key

	I1226 21:45:52.370275  703653 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key

	I1226 21:45:52.370434  703653 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-154736 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]

	I1226 21:45:52.635129  703653 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key

	I1226 21:45:52.635292  703653 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-154736 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]

	I1226 21:45:53.661223  703653 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key

	I1226 21:45:54.290814  703653 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key

	I1226 21:45:54.651197  703653 kubeadm.go:322] [certs] Generating "sa" key and public key

	I1226 21:45:54.651394  703653 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I1226 21:45:55.134969  703653 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I1226 21:45:55.322944  703653 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I1226 21:45:55.759311  703653 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I1226 21:45:55.948385  703653 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I1226 21:45:55.948895  703653 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I1226 21:45:55.953472  703653 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I1226 21:45:55.955844  703653 out.go:204]   - Booting up control plane ...

	I1226 21:45:55.955952  703653 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I1226 21:45:55.956032  703653 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I1226 21:45:55.957069  703653 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I1226 21:45:55.967769  703653 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1226 21:45:55.968989  703653 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1226 21:45:55.969050  703653 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I1226 21:45:56.074927  703653 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I1226 21:46:03.077104  703653 kubeadm.go:322] [apiclient] All control plane components are healthy after 7.002309 seconds

	I1226 21:46:03.077227  703653 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I1226 21:46:03.091854  703653 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I1226 21:46:03.619549  703653 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs

	I1226 21:46:03.619738  703653 kubeadm.go:322] [mark-control-plane] Marking the node addons-154736 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I1226 21:46:04.130928  703653 kubeadm.go:322] [bootstrap-token] Using token: 08smwl.lifk3a8mo3dqg185

	I1226 21:46:04.132945  703653 out.go:204]   - Configuring RBAC rules ...

	I1226 21:46:04.133066  703653 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I1226 21:46:04.138717  703653 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I1226 21:46:04.147006  703653 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I1226 21:46:04.150888  703653 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I1226 21:46:04.154871  703653 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I1226 21:46:04.160999  703653 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I1226 21:46:04.172410  703653 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I1226 21:46:04.397107  703653 kubeadm.go:322] [addons] Applied essential addon: CoreDNS

	I1226 21:46:04.545271  703653 kubeadm.go:322] [addons] Applied essential addon: kube-proxy

	I1226 21:46:04.546497  703653 kubeadm.go:322] 

	I1226 21:46:04.546573  703653 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!

	I1226 21:46:04.546583  703653 kubeadm.go:322] 

	I1226 21:46:04.546657  703653 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:

	I1226 21:46:04.546666  703653 kubeadm.go:322] 

	I1226 21:46:04.546691  703653 kubeadm.go:322]   mkdir -p $HOME/.kube

	I1226 21:46:04.546750  703653 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I1226 21:46:04.546804  703653 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I1226 21:46:04.546813  703653 kubeadm.go:322] 

	I1226 21:46:04.546864  703653 kubeadm.go:322] Alternatively, if you are the root user, you can run:

	I1226 21:46:04.546872  703653 kubeadm.go:322] 

	I1226 21:46:04.546917  703653 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I1226 21:46:04.546925  703653 kubeadm.go:322] 

	I1226 21:46:04.546975  703653 kubeadm.go:322] You should now deploy a pod network to the cluster.

	I1226 21:46:04.547049  703653 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I1226 21:46:04.547137  703653 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I1226 21:46:04.547146  703653 kubeadm.go:322] 

	I1226 21:46:04.547225  703653 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities

	I1226 21:46:04.547301  703653 kubeadm.go:322] and service account keys on each node and then running the following as root:

	I1226 21:46:04.547309  703653 kubeadm.go:322] 

	I1226 21:46:04.547388  703653 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token 08smwl.lifk3a8mo3dqg185 \

	I1226 21:46:04.547489  703653 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:eb99bb3bfadffb0fd08fb657f91b723758be2a0ceabacd68fe612edc25108351 \

	I1226 21:46:04.547515  703653 kubeadm.go:322] 	--control-plane 

	I1226 21:46:04.547525  703653 kubeadm.go:322] 

	I1226 21:46:04.547605  703653 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:

	I1226 21:46:04.547613  703653 kubeadm.go:322] 

	I1226 21:46:04.547691  703653 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 08smwl.lifk3a8mo3dqg185 \

	I1226 21:46:04.547788  703653 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:eb99bb3bfadffb0fd08fb657f91b723758be2a0ceabacd68fe612edc25108351 

	I1226 21:46:04.550011  703653 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1051-aws\n", err: exit status 1

	I1226 21:46:04.550125  703653 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I1226 21:46:04.550144  703653 cni.go:84] Creating CNI manager for ""

	I1226 21:46:04.550153  703653 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet

	I1226 21:46:04.552156  703653 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I1226 21:46:04.553984  703653 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I1226 21:46:04.565752  703653 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.28.4/kubectl ...

	I1226 21:46:04.565773  703653 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I1226 21:46:04.619814  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I1226 21:46:05.498806  703653 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1226 21:46:05.498945  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:05.499035  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl label nodes minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=393f165ced08f66e4386491f243850f87982a22b minikube.k8s.io/name=addons-154736 minikube.k8s.io/updated_at=2023_12_26T21_46_05_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:05.656110  703653 ops.go:34] apiserver oom_adj: -16

	I1226 21:46:05.656189  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:06.157100  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:06.656948  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:07.157012  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:07.657245  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:08.156650  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:08.656541  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:09.157216  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:09.656418  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:10.156767  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:10.656764  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:11.156322  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:11.656675  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:12.156530  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:12.656297  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:13.156968  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:13.657245  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:14.156642  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:14.656931  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:15.156946  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:15.656910  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:16.157085  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:16.656471  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:17.156278  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:17.656294  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:17.768936  703653 kubeadm.go:1088] duration metric: took 12.270036305s to wait for elevateKubeSystemPrivileges.

	I1226 21:46:17.768962  703653 kubeadm.go:406] StartCluster complete in 27.685530957s

	I1226 21:46:17.768979  703653 settings.go:142] acquiring lock: {Name:mk1b89d623875ac96830001bdd0fc2b8d8c10aec Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:46:17.769094  703653 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/17857-697646/kubeconfig

	I1226 21:46:17.769489  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/kubeconfig: {Name:mk171fc32e21f516abb68bc5ebeb628b3c1d7f0b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:46:17.770221  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1226 21:46:17.770499  703653 config.go:182] Loaded profile config "addons-154736": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4

	I1226 21:46:17.770617  703653 addons.go:505] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volumesnapshots:true yakd:true]

	I1226 21:46:17.770691  703653 addons.go:69] Setting yakd=true in profile "addons-154736"

	I1226 21:46:17.770708  703653 addons.go:237] Setting addon yakd=true in "addons-154736"

	I1226 21:46:17.770740  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.771199  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.772718  703653 addons.go:69] Setting cloud-spanner=true in profile "addons-154736"

	I1226 21:46:17.772750  703653 addons.go:237] Setting addon cloud-spanner=true in "addons-154736"

	I1226 21:46:17.772735  703653 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-154736"

	I1226 21:46:17.772791  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.772832  703653 addons.go:237] Setting addon csi-hostpath-driver=true in "addons-154736"

	I1226 21:46:17.772893  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.773203  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.773403  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.772728  703653 addons.go:69] Setting metrics-server=true in profile "addons-154736"

	I1226 21:46:17.773824  703653 addons.go:237] Setting addon metrics-server=true in "addons-154736"

	I1226 21:46:17.773873  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.774269  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.779281  703653 addons.go:69] Setting default-storageclass=true in profile "addons-154736"

	I1226 21:46:17.779314  703653 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-154736"

	I1226 21:46:17.779643  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.792607  703653 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-154736"

	I1226 21:46:17.792651  703653 addons.go:237] Setting addon nvidia-device-plugin=true in "addons-154736"

	I1226 21:46:17.792699  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.793150  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.804697  703653 addons.go:69] Setting gcp-auth=true in profile "addons-154736"

	I1226 21:46:17.804964  703653 mustload.go:65] Loading cluster: addons-154736

	I1226 21:46:17.805721  703653 addons.go:69] Setting registry=true in profile "addons-154736"

	I1226 21:46:17.805750  703653 addons.go:237] Setting addon registry=true in "addons-154736"

	I1226 21:46:17.805792  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.806207  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.806448  703653 config.go:182] Loaded profile config "addons-154736": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4

	I1226 21:46:17.806745  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.828753  703653 addons.go:69] Setting storage-provisioner=true in profile "addons-154736"

	I1226 21:46:17.828787  703653 addons.go:237] Setting addon storage-provisioner=true in "addons-154736"

	I1226 21:46:17.828833  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.829266  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.804878  703653 addons.go:69] Setting ingress=true in profile "addons-154736"

	I1226 21:46:17.840652  703653 addons.go:237] Setting addon ingress=true in "addons-154736"

	I1226 21:46:17.840738  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.843946  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.851917  703653 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-154736"

	I1226 21:46:17.851955  703653 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-154736"

	I1226 21:46:17.852399  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.804889  703653 addons.go:69] Setting ingress-dns=true in profile "addons-154736"

	I1226 21:46:17.852637  703653 addons.go:237] Setting addon ingress-dns=true in "addons-154736"

	I1226 21:46:17.852715  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.853125  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.874589  703653 addons.go:69] Setting volumesnapshots=true in profile "addons-154736"

	I1226 21:46:17.874671  703653 addons.go:237] Setting addon volumesnapshots=true in "addons-154736"

	I1226 21:46:17.874749  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.878996  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.804896  703653 addons.go:69] Setting inspektor-gadget=true in profile "addons-154736"

	I1226 21:46:17.895266  703653 addons.go:237] Setting addon inspektor-gadget=true in "addons-154736"

	I1226 21:46:17.895344  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.895877  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:18.007568  703653 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.4

	I1226 21:46:18.026335  703653 addons.go:429] installing /etc/kubernetes/addons/yakd-ns.yaml

	I1226 21:46:18.026501  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)

	I1226 21:46:18.026615  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.046125  703653 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.13

	I1226 21:46:18.026045  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:18.062757  703653 addons.go:429] installing /etc/kubernetes/addons/deployment.yaml

	I1226 21:46:18.066821  703653 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.14.3

	I1226 21:46:18.064795  703653 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	I1226 21:46:18.064803  703653 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.6.4

	I1226 21:46:18.064807  703653 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.5

	I1226 21:46:18.064821  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)

	I1226 21:46:18.067197  703653 addons.go:237] Setting addon default-storageclass=true in "addons-154736"

	I1226 21:46:18.073344  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:18.073857  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:18.076019  703653 addons.go:429] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I1226 21:46:18.076045  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I1226 21:46:18.076108  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.074344  703653 addons.go:429] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I1226 21:46:18.076137  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)

	I1226 21:46:18.076187  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.104644  703653 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	I1226 21:46:18.074535  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.094767  703653 addons.go:237] Setting addon storage-provisioner-rancher=true in "addons-154736"

	I1226 21:46:18.106659  703653 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2

	I1226 21:46:18.111864  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:18.113291  703653 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	I1226 21:46:18.125892  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:18.126055  703653 addons.go:429] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	I1226 21:46:18.126072  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)

	I1226 21:46:18.126126  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.125904  703653 out.go:177]   - Using image docker.io/registry:2.8.3

	I1226 21:46:18.156725  703653 addons.go:429] installing /etc/kubernetes/addons/registry-rc.yaml

	I1226 21:46:18.156754  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)

	I1226 21:46:18.156821  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.167971  703653 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	I1226 21:46:18.172167  703653 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	I1226 21:46:18.174496  703653 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	I1226 21:46:18.176642  703653 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	I1226 21:46:18.179637  703653 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	I1226 21:46:18.182306  703653 addons.go:429] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I1226 21:46:18.182372  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I1226 21:46:18.182473  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.193072  703653 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I1226 21:46:18.165581  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I1226 21:46:18.196363  703653 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.23.1

	I1226 21:46:18.196409  703653 addons.go:429] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I1226 21:46:18.202329  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I1226 21:46:18.202409  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.202582  703653 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.9.5

	I1226 21:46:18.204409  703653 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0

	I1226 21:46:18.202750  703653 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1226 21:46:18.210421  703653 addons.go:429] installing /etc/kubernetes/addons/ig-namespace.yaml

	I1226 21:46:18.210452  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)

	I1226 21:46:18.210518  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.238353  703653 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0

	I1226 21:46:18.240718  703653 addons.go:429] installing /etc/kubernetes/addons/ingress-deploy.yaml

	I1226 21:46:18.240741  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16103 bytes)

	I1226 21:46:18.240812  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.259800  703653 addons.go:429] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1226 21:46:18.259864  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1226 21:46:18.259969  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.284670  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.284999  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.322452  703653 addons.go:429] installing /etc/kubernetes/addons/storageclass.yaml

	I1226 21:46:18.322479  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1226 21:46:18.322539  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.383702  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.385611  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.397710  703653 out.go:177]   - Using image docker.io/busybox:stable

	I1226 21:46:18.399834  703653 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	I1226 21:46:18.402027  703653 addons.go:429] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I1226 21:46:18.402047  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)

	I1226 21:46:18.402115  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.418660  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.440650  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.469494  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.480016  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.481628  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.493844  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.529486  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.536621  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.560292  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.719345  703653 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-154736" context rescaled to 1 replicas

	I1226 21:46:18.719381  703653 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1226 21:46:18.721615  703653 out.go:177] * Verifying Kubernetes components...

	I1226 21:46:18.723683  703653 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1226 21:46:18.823973  703653 addons.go:429] installing /etc/kubernetes/addons/yakd-sa.yaml

	I1226 21:46:18.823993  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)

	I1226 21:46:18.843133  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I1226 21:46:18.886287  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1226 21:46:18.890874  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1226 21:46:18.894516  703653 addons.go:429] installing /etc/kubernetes/addons/registry-svc.yaml

	I1226 21:46:18.894586  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)

	I1226 21:46:18.927177  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/deployment.yaml

	I1226 21:46:18.970962  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I1226 21:46:18.986951  703653 addons.go:429] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I1226 21:46:18.987022  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)

	I1226 21:46:19.021253  703653 addons.go:429] installing /etc/kubernetes/addons/registry-proxy.yaml

	I1226 21:46:19.021322  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)

	I1226 21:46:19.028642  703653 addons.go:429] installing /etc/kubernetes/addons/yakd-crb.yaml

	I1226 21:46:19.028712  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)

	I1226 21:46:19.060764  703653 addons.go:429] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I1226 21:46:19.060835  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I1226 21:46:19.064691  703653 addons.go:429] installing /etc/kubernetes/addons/rbac-hostpath.yaml

	I1226 21:46:19.064761  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)

	I1226 21:46:19.067867  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml

	I1226 21:46:19.074108  703653 addons.go:429] installing /etc/kubernetes/addons/ig-serviceaccount.yaml

	I1226 21:46:19.074185  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)

	I1226 21:46:19.149129  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	I1226 21:46:19.173549  703653 addons.go:429] installing /etc/kubernetes/addons/yakd-svc.yaml

	I1226 21:46:19.173622  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)

	I1226 21:46:19.181331  703653 addons.go:429] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I1226 21:46:19.181402  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I1226 21:46:19.204375  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml

	I1226 21:46:19.247997  703653 addons.go:429] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I1226 21:46:19.248067  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I1226 21:46:19.252641  703653 addons.go:429] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I1226 21:46:19.252714  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)

	I1226 21:46:19.257178  703653 addons.go:429] installing /etc/kubernetes/addons/ig-role.yaml

	I1226 21:46:19.257247  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)

	I1226 21:46:19.375270  703653 addons.go:429] installing /etc/kubernetes/addons/yakd-dp.yaml

	I1226 21:46:19.375338  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)

	I1226 21:46:19.411800  703653 addons.go:429] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I1226 21:46:19.411874  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I1226 21:46:19.474697  703653 addons.go:429] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I1226 21:46:19.474770  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I1226 21:46:19.478562  703653 addons.go:429] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I1226 21:46:19.478631  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)

	I1226 21:46:19.487788  703653 addons.go:429] installing /etc/kubernetes/addons/ig-rolebinding.yaml

	I1226 21:46:19.487864  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)

	I1226 21:46:19.607392  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I1226 21:46:19.643328  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml

	I1226 21:46:19.662535  703653 addons.go:429] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I1226 21:46:19.662607  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I1226 21:46:19.682945  703653 addons.go:429] installing /etc/kubernetes/addons/ig-clusterrole.yaml

	I1226 21:46:19.683021  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)

	I1226 21:46:19.721905  703653 addons.go:429] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I1226 21:46:19.721979  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)

	I1226 21:46:19.783208  703653 addons.go:429] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I1226 21:46:19.783276  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I1226 21:46:19.813062  703653 addons.go:429] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml

	I1226 21:46:19.813122  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)

	I1226 21:46:19.875998  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I1226 21:46:19.892038  703653 addons.go:429] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I1226 21:46:19.892108  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)

	I1226 21:46:19.898813  703653 addons.go:429] installing /etc/kubernetes/addons/ig-crd.yaml

	I1226 21:46:19.898880  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)

	I1226 21:46:19.970604  703653 addons.go:429] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I1226 21:46:19.970675  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)

	I1226 21:46:19.979157  703653 addons.go:429] installing /etc/kubernetes/addons/ig-daemonset.yaml

	I1226 21:46:19.979228  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)

	I1226 21:46:20.068804  703653 addons.go:429] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I1226 21:46:20.068877  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)

	I1226 21:46:20.071774  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml

	I1226 21:46:20.223830  703653 addons.go:429] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I1226 21:46:20.223899  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)

	I1226 21:46:20.393097  703653 addons.go:429] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I1226 21:46:20.393163  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)

	I1226 21:46:20.525129  703653 addons.go:429] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I1226 21:46:20.525203  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I1226 21:46:20.653419  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I1226 21:46:20.842620  703653 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.646185588s)

	I1226 21:46:20.842696  703653 start.go:929] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap

	I1226 21:46:20.842737  703653 ssh_runner.go:235] Completed: sudo systemctl is-active --quiet service kubelet: (2.119032448s)

	I1226 21:46:20.843712  703653 node_ready.go:35] waiting up to 6m0s for node "addons-154736" to be "Ready" ...

	I1226 21:46:22.115492  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (3.272322247s)

	I1226 21:46:22.929290  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:23.873940  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (4.987579254s)

	I1226 21:46:23.874031  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (4.983094048s)

	I1226 21:46:23.874054  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (4.946818712s)

	I1226 21:46:23.899655  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (4.928558019s)

	W1226 21:46:23.935588  703653 out.go:239] ! Enabling 'storage-provisioner-rancher' returned an error: running callbacks: [Error making local-path the default storage class: Error while marking storage class local-path as default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]

	I1226 21:46:24.549723  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (5.481784866s)

	I1226 21:46:24.550248  703653 addons.go:473] Verifying addon ingress=true in "addons-154736"

	I1226 21:46:24.550339  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (5.34541146s)

	I1226 21:46:24.550369  703653 addons.go:473] Verifying addon registry=true in "addons-154736"

	I1226 21:46:24.552781  703653 out.go:177] * Verifying ingress addon...

	I1226 21:46:24.555640  703653 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I1226 21:46:24.552845  703653 out.go:177] * Verifying registry addon...

	I1226 21:46:24.549972  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (4.90658226s)

	I1226 21:46:24.550052  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (4.673983728s)

	I1226 21:46:24.550108  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (4.478251658s)

	I1226 21:46:24.549829  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (5.400630337s)

	I1226 21:46:24.549929  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (4.942445076s)

	I1226 21:46:24.557896  703653 addons.go:473] Verifying addon metrics-server=true in "addons-154736"

	I1226 21:46:24.558715  703653 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I1226 21:46:24.560838  703653 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-154736 service yakd-dashboard -n yakd-dashboard

	W1226 21:46:24.559008  703653 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I1226 21:46:24.562704  703653 retry.go:31] will retry after 132.401694ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I1226 21:46:24.569656  703653 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=registry

	I1226 21:46:24.569680  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:24.574284  703653 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I1226 21:46:24.574358  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:24.695895  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I1226 21:46:24.956686  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (4.303171454s)

	I1226 21:46:24.956765  703653 addons.go:473] Verifying addon csi-hostpath-driver=true in "addons-154736"

	I1226 21:46:24.960028  703653 out.go:177] * Verifying csi-hostpath-driver addon...

	I1226 21:46:24.963091  703653 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I1226 21:46:24.975073  703653 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I1226 21:46:24.975149  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:25.071087  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:25.079722  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:25.350710  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:25.467870  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:25.561828  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:25.571223  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:25.970056  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:26.065018  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:26.068043  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:26.205366  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.509380595s)

	I1226 21:46:26.468713  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:26.570044  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:26.584924  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:26.924708  703653 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I1226 21:46:26.924807  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:26.956235  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:26.968334  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:27.062289  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:27.065379  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:27.146887  703653 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I1226 21:46:27.172562  703653 addons.go:237] Setting addon gcp-auth=true in "addons-154736"

	I1226 21:46:27.172661  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:27.173152  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:27.207957  703653 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I1226 21:46:27.208012  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:27.246139  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:27.365287  703653 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0

	I1226 21:46:27.367384  703653 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0

	I1226 21:46:27.369310  703653 addons.go:429] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I1226 21:46:27.369365  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I1226 21:46:27.429064  703653 addons.go:429] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I1226 21:46:27.429087  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I1226 21:46:27.469042  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:27.489750  703653 addons.go:429] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I1226 21:46:27.489813  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5432 bytes)

	I1226 21:46:27.541813  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I1226 21:46:27.562086  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:27.564702  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:27.847272  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:27.968383  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:28.062452  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:28.067190  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:28.469043  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:28.612064  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:28.613425  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:28.694641  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.152734381s)

	I1226 21:46:28.697723  703653 addons.go:473] Verifying addon gcp-auth=true in "addons-154736"

	I1226 21:46:28.699657  703653 out.go:177] * Verifying gcp-auth addon...

	I1226 21:46:28.702193  703653 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I1226 21:46:28.713134  703653 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I1226 21:46:28.713169  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:28.968083  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:29.062578  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:29.065752  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:29.206575  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:29.467801  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:29.562917  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:29.566551  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:29.706567  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:29.847539  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:29.969640  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:30.065196  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:30.065821  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:30.207650  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:30.468600  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:30.559955  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:30.563229  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:30.706713  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:30.967667  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:31.060215  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:31.063555  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:31.206014  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:31.467822  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:31.560684  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:31.564582  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:31.706453  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:31.848194  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:31.967625  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:32.071768  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:32.074574  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:32.206257  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:32.467742  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:32.560210  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:32.564370  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:32.706417  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:32.968484  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:33.059977  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:33.063079  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:33.206191  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:33.469654  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:33.560128  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:33.563933  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:33.706915  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:33.968138  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:34.060699  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:34.062966  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:34.205994  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:34.347763  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:34.467659  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:34.560545  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:34.564030  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:34.706956  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:34.967462  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:35.060365  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:35.063174  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:35.206350  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:35.467439  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:35.560949  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:35.563816  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:35.706116  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:35.967771  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:36.060270  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:36.062972  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:36.206749  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:36.347898  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:36.468162  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:36.562270  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:36.565356  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:36.706459  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:36.969062  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:37.060019  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:37.062458  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:37.205865  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:37.468108  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:37.560701  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:37.563249  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:37.706501  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:37.967330  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:38.061409  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:38.064071  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:38.206358  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:38.467649  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:38.560270  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:38.563682  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:38.706163  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:38.847114  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:38.968020  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:39.061302  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:39.062938  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:39.206046  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:39.468201  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:39.560687  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:39.563258  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:39.705944  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:39.967732  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:40.060511  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:40.063552  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:40.206079  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:40.467704  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:40.559890  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:40.562420  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:40.706020  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:40.847265  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:40.967615  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:41.059557  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:41.063115  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:41.206147  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:41.468171  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:41.561080  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:41.563399  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:41.705797  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:41.968183  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:42.060346  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:42.065795  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:42.206857  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:42.467804  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:42.559940  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:42.563378  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:42.706060  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:42.847516  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:42.967877  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:43.061125  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:43.063696  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:43.206173  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:43.468000  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:43.560123  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:43.564203  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:43.706221  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:43.967655  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:44.060179  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:44.063269  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:44.206390  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:44.468741  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:44.560372  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:44.562859  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:44.706366  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:44.847638  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:44.967909  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:45.061583  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:45.064665  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:45.211106  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:45.467461  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:45.560089  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:45.562275  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:45.706638  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:45.970355  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:46.059861  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:46.063618  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:46.206118  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:46.467955  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:46.560833  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:46.563482  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:46.706762  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:46.967932  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:47.060026  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:47.062487  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:47.205482  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:47.348084  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:47.476263  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:47.560890  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:47.564350  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:47.706703  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:47.969547  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:48.060729  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:48.063500  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:48.206175  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:48.468027  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:48.562588  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:48.565212  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:48.706331  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:48.968883  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:49.062420  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:49.067064  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:49.205752  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:49.468835  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:49.560426  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:49.566168  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:49.706795  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:49.847821  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:49.967554  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:50.060438  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:50.063784  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:50.206837  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:50.468711  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:50.568015  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:50.570291  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:50.706000  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:50.968506  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:51.060136  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:51.064069  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:51.205554  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:51.468398  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:51.562146  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:51.562949  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:51.706465  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:51.848005  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:51.967993  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:52.060615  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:52.063507  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:52.206665  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:52.489848  703653 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I1226 21:46:52.489871  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:52.570538  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:52.575568  703653 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry

	I1226 21:46:52.575599  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:52.783948  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:52.858988  703653 node_ready.go:49] node "addons-154736" has status "Ready":"True"

	I1226 21:46:52.859014  703653 node_ready.go:38] duration metric: took 32.015238708s waiting for node "addons-154736" to be "Ready" ...

	I1226 21:46:52.859025  703653 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1226 21:46:52.873732  703653 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-gbz9g" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:52.970570  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:53.062030  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:53.066822  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:53.208151  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:53.479541  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:53.561590  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:53.564565  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:53.706740  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:53.970560  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:54.062379  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:54.070050  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:54.206168  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:54.427418  703653 pod_ready.go:92] pod "coredns-5dd5756b68-gbz9g" in "kube-system" namespace has status "Ready":"True"

	I1226 21:46:54.427443  703653 pod_ready.go:81] duration metric: took 1.55363774s waiting for pod "coredns-5dd5756b68-gbz9g" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.427484  703653 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-154736" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.441610  703653 pod_ready.go:92] pod "etcd-addons-154736" in "kube-system" namespace has status "Ready":"True"

	I1226 21:46:54.441633  703653 pod_ready.go:81] duration metric: took 14.134232ms waiting for pod "etcd-addons-154736" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.441673  703653 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-154736" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.475840  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:54.482080  703653 pod_ready.go:92] pod "kube-apiserver-addons-154736" in "kube-system" namespace has status "Ready":"True"

	I1226 21:46:54.482105  703653 pod_ready.go:81] duration metric: took 40.41664ms waiting for pod "kube-apiserver-addons-154736" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.482143  703653 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-154736" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.503272  703653 pod_ready.go:92] pod "kube-controller-manager-addons-154736" in "kube-system" namespace has status "Ready":"True"

	I1226 21:46:54.503299  703653 pod_ready.go:81] duration metric: took 21.139593ms waiting for pod "kube-controller-manager-addons-154736" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.503315  703653 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-4r79z" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.510754  703653 pod_ready.go:92] pod "kube-proxy-4r79z" in "kube-system" namespace has status "Ready":"True"

	I1226 21:46:54.510779  703653 pod_ready.go:81] duration metric: took 7.429869ms waiting for pod "kube-proxy-4r79z" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.510791  703653 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-154736" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.560768  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:54.569594  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:54.706488  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:54.849037  703653 pod_ready.go:92] pod "kube-scheduler-addons-154736" in "kube-system" namespace has status "Ready":"True"

	I1226 21:46:54.849064  703653 pod_ready.go:81] duration metric: took 338.264308ms waiting for pod "kube-scheduler-addons-154736" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.849077  703653 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.969242  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:55.061146  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:55.067005  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:55.207290  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:55.470788  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:55.564909  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:55.570773  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:55.706289  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:55.976219  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:56.067117  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:56.070953  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:56.207571  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:56.471026  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:56.561105  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:56.565253  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:56.707338  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:56.856778  703653 pod_ready.go:102] pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace has status "Ready":"False"

	I1226 21:46:56.969325  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:57.062863  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:57.066909  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:57.206843  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:57.469685  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:57.560698  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:57.565874  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:57.706369  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:57.971579  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:58.067484  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:58.070866  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:58.206809  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:58.469998  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:58.560651  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:58.566168  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:58.705958  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:58.860185  703653 pod_ready.go:102] pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace has status "Ready":"False"

	I1226 21:46:58.976070  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:59.072436  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:59.074569  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:59.205965  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:59.475382  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:59.561133  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:59.563634  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:59.706415  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:59.969341  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:00.072603  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:00.073664  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:00.210007  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:00.471336  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:00.561063  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:00.570171  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:00.708851  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:00.970634  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:01.065099  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:01.069820  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:01.207701  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:01.377053  703653 pod_ready.go:102] pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:01.471027  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:01.561179  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:01.567931  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:01.707290  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:01.969516  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:02.062572  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:02.067470  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:02.206698  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:02.473756  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:02.562936  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:02.568913  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:02.714007  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:02.974098  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:03.060756  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:03.065070  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:03.207705  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:03.469972  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:03.566258  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:03.569802  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:03.707702  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:03.857703  703653 pod_ready.go:102] pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:03.974229  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:04.065539  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:04.068208  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:04.206996  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:04.470685  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:04.560769  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:04.573550  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:04.707771  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:04.970025  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:05.061588  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:05.077281  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:05.206268  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:05.470787  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:05.562031  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:05.565526  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:05.706928  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:05.974070  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:06.060856  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:06.065192  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:06.205889  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:06.357938  703653 pod_ready.go:102] pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:06.474136  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:06.561022  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:06.569230  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:06.706481  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:06.970270  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:07.062297  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:07.065987  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:07.206895  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:07.470017  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:07.560625  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:07.563890  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:07.706085  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:07.969070  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:08.062278  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:08.067967  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:08.206596  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:08.515424  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:08.566521  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:08.574832  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:08.713605  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:08.856198  703653 pod_ready.go:102] pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:08.969419  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:09.061431  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:09.067912  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:09.206807  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:09.469389  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:09.560738  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:09.565395  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:09.706554  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:09.972022  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:10.061966  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:10.065576  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:10.206308  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:10.469790  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:10.561193  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:10.564481  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:10.707575  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:10.857077  703653 pod_ready.go:102] pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:10.968937  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:11.061350  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:11.067239  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:11.206695  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:11.474233  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:11.561359  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:11.564561  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:11.706552  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:11.969464  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:12.061431  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:12.065839  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:12.205791  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:12.486311  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:12.561067  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:12.564620  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:12.708399  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:12.873072  703653 pod_ready.go:102] pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:12.971333  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:13.094658  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:13.096399  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:13.208739  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:13.356187  703653 pod_ready.go:92] pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace has status "Ready":"True"

	I1226 21:47:13.356216  703653 pod_ready.go:81] duration metric: took 18.507131159s waiting for pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace to be "Ready" ...

	I1226 21:47:13.356229  703653 pod_ready.go:78] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace to be "Ready" ...

	I1226 21:47:13.469532  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:13.561073  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:13.566388  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:13.706438  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:13.970252  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:14.061999  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:14.070026  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:14.207712  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:14.471132  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:14.567489  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:14.570427  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:14.707552  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:14.970629  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:15.062212  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:15.070838  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:15.207228  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:15.363858  703653 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:15.472669  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:15.563808  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:15.568650  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:15.706794  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:15.969450  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:16.064243  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:16.065309  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:16.207222  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:16.473523  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:16.568060  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:16.569013  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:16.706515  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:16.973407  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:17.066957  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:17.072279  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:17.206427  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:17.364884  703653 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:17.468992  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:17.567084  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:17.570624  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:17.706523  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:17.969537  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:18.060154  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:18.064503  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:18.222664  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:18.469733  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:18.571327  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:18.573773  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:18.709089  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:18.968889  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:19.069311  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:19.073568  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:19.207943  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:19.482855  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:19.575162  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:19.575483  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:19.705784  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:19.863199  703653 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:19.970830  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:20.061874  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:20.065796  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:20.206850  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:20.473637  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:20.561375  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:20.565460  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:20.706454  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:20.968707  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:21.061491  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:21.065619  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:21.206526  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:21.469410  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:21.567855  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:21.568668  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:21.714494  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:21.902192  703653 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:21.968787  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:22.061541  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:22.066095  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:22.206091  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:22.492888  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:22.562627  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:22.589676  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:22.718269  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:22.971014  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:23.060948  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:23.070832  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:23.206897  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:23.469906  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:23.566160  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:23.569918  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:23.707051  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:23.970360  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:24.061380  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:24.065995  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:24.207026  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:24.365402  703653 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:24.469724  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:24.561066  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:24.565718  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:24.708651  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:24.974549  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:25.062214  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:25.065091  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:25.205842  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:25.475004  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:25.560266  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:25.564620  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:25.706207  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:25.969910  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:26.061138  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:26.064142  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:26.205918  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:26.469544  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:26.559990  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:26.564544  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:26.706927  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:26.872638  703653 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:26.989402  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:27.061512  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:27.065575  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:27.206308  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:27.470363  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:27.565960  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:27.571508  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:27.709823  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:27.983523  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:28.064834  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:28.069810  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:28.206858  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:28.469981  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:28.561866  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:28.567347  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:28.706372  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:28.969840  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:29.060913  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:29.065572  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:29.216288  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:29.410195  703653 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:29.469260  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:29.565518  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:29.567101  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:29.706298  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:29.969149  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:30.062598  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:30.071250  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:30.206184  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:30.469173  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:30.560713  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:30.563786  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:30.705967  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:30.970274  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:31.061099  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:31.064599  703653 kapi.go:107] duration metric: took 1m6.505878547s to wait for kubernetes.io/minikube-addons=registry ...

	I1226 21:47:31.206762  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:31.469586  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:31.561988  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:31.706767  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:31.864032  703653 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:31.977033  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:32.061252  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:32.206052  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:32.469257  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:32.560678  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:32.706429  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:32.972790  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:33.060407  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:33.208205  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:33.478798  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:33.561123  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:33.713322  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:33.865637  703653 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:33.969626  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:34.068821  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:34.206745  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:34.468862  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:34.561874  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:34.706720  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:34.970112  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:35.061384  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:35.206359  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:35.470876  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:35.560734  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:35.707315  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:35.969191  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:36.061593  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:36.206118  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:36.366788  703653 pod_ready.go:92] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"True"

	I1226 21:47:36.366814  703653 pod_ready.go:81] duration metric: took 23.010576239s waiting for pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace to be "Ready" ...

	I1226 21:47:36.366838  703653 pod_ready.go:38] duration metric: took 43.50780045s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1226 21:47:36.366858  703653 api_server.go:52] waiting for apiserver process to appear ...

	I1226 21:47:36.366895  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I1226 21:47:36.366967  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I1226 21:47:36.437260  703653 cri.go:89] found id: "c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8"

	I1226 21:47:36.437371  703653 cri.go:89] found id: ""

	I1226 21:47:36.437394  703653 logs.go:284] 1 containers: [c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8]

	I1226 21:47:36.437504  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:36.444644  703653 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I1226 21:47:36.444799  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I1226 21:47:36.470712  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:36.568139  703653 cri.go:89] found id: "a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a"

	I1226 21:47:36.568223  703653 cri.go:89] found id: ""

	I1226 21:47:36.568258  703653 logs.go:284] 1 containers: [a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a]

	I1226 21:47:36.568371  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:36.574008  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:36.589803  703653 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I1226 21:47:36.589967  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I1226 21:47:36.709373  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:36.777925  703653 cri.go:89] found id: "0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a"

	I1226 21:47:36.777994  703653 cri.go:89] found id: ""

	I1226 21:47:36.778023  703653 logs.go:284] 1 containers: [0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a]

	I1226 21:47:36.778115  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:36.786332  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I1226 21:47:36.786481  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I1226 21:47:36.865357  703653 cri.go:89] found id: "a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43"

	I1226 21:47:36.865381  703653 cri.go:89] found id: ""

	I1226 21:47:36.865389  703653 logs.go:284] 1 containers: [a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43]

	I1226 21:47:36.865446  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:36.871193  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I1226 21:47:36.871273  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I1226 21:47:36.939797  703653 cri.go:89] found id: "fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d"

	I1226 21:47:36.939824  703653 cri.go:89] found id: ""

	I1226 21:47:36.939833  703653 logs.go:284] 1 containers: [fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d]

	I1226 21:47:36.939889  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:36.950417  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I1226 21:47:36.950495  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I1226 21:47:36.971592  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:37.019700  703653 cri.go:89] found id: "5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee"

	I1226 21:47:37.019732  703653 cri.go:89] found id: ""

	I1226 21:47:37.019741  703653 logs.go:284] 1 containers: [5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee]

	I1226 21:47:37.019810  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:37.044883  703653 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I1226 21:47:37.044974  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I1226 21:47:37.061353  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:37.108196  703653 cri.go:89] found id: "5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445"

	I1226 21:47:37.108272  703653 cri.go:89] found id: ""

	I1226 21:47:37.108293  703653 logs.go:284] 1 containers: [5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445]

	I1226 21:47:37.108380  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:37.114078  703653 logs.go:123] Gathering logs for kube-apiserver [c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8] ...

	I1226 21:47:37.114151  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8"

	I1226 21:47:37.195220  703653 logs.go:123] Gathering logs for etcd [a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a] ...

	I1226 21:47:37.195296  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a"

	I1226 21:47:37.218174  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:37.275411  703653 logs.go:123] Gathering logs for kube-scheduler [a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43] ...

	I1226 21:47:37.275488  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43"

	I1226 21:47:37.362244  703653 logs.go:123] Gathering logs for kube-proxy [fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d] ...

	I1226 21:47:37.363123  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d"

	I1226 21:47:37.424432  703653 logs.go:123] Gathering logs for container status ...

	I1226 21:47:37.424460  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1226 21:47:37.470454  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:37.495685  703653 logs.go:123] Gathering logs for kubelet ...

	I1226 21:47:37.495714  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W1226 21:47:37.555728  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:18 addons-154736 kubelet[1365]: W1226 21:46:18.444235    1365 reflector.go:535] object-"kube-system"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	W1226 21:47:37.555951  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:18 addons-154736 kubelet[1365]: E1226 21:46:18.444308    1365 reflector.go:147] object-"kube-system"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	I1226 21:47:37.563330  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	W1226 21:47:37.577596  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.432342    1365 reflector.go:535] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:37.577823  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.432378    1365 reflector.go:147] object-"default"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:37.578130  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.434011    1365 reflector.go:535] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:37.578343  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.434040    1365 reflector.go:147] object-"default"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:37.579459  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.447831    1365 reflector.go:535] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:47:37.579665  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.447865    1365 reflector.go:147] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:47:37.581033  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.510344    1365 reflector.go:535] object-"kube-system"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	W1226 21:47:37.581221  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.510378    1365 reflector.go:147] object-"kube-system"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	I1226 21:47:37.618607  703653 logs.go:123] Gathering logs for describe nodes ...

	I1226 21:47:37.618646  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I1226 21:47:37.707887  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:37.883827  703653 logs.go:123] Gathering logs for kube-controller-manager [5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee] ...

	I1226 21:47:37.883860  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee"

	I1226 21:47:37.970815  703653 logs.go:123] Gathering logs for kindnet [5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445] ...

	I1226 21:47:37.970891  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445"

	I1226 21:47:37.972427  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:38.083080  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:38.112927  703653 logs.go:123] Gathering logs for CRI-O ...

	I1226 21:47:38.112956  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"

	I1226 21:47:38.210766  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:38.227495  703653 logs.go:123] Gathering logs for dmesg ...

	I1226 21:47:38.227530  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1226 21:47:38.260459  703653 logs.go:123] Gathering logs for coredns [0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a] ...

	I1226 21:47:38.260489  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a"

	I1226 21:47:38.314608  703653 out.go:309] Setting ErrFile to fd 2...

	I1226 21:47:38.314638  703653 out.go:343] TERM=,COLORTERM=, which probably does not support color

	W1226 21:47:38.314684  703653 out.go:239] X Problems detected in kubelet:

	W1226 21:47:38.314697  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.434040    1365 reflector.go:147] object-"default"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:38.314705  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.447831    1365 reflector.go:535] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:47:38.314715  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.447865    1365 reflector.go:147] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:47:38.314726  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.510344    1365 reflector.go:535] object-"kube-system"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	W1226 21:47:38.314733  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.510378    1365 reflector.go:147] object-"kube-system"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	I1226 21:47:38.314742  703653 out.go:309] Setting ErrFile to fd 2...

	I1226 21:47:38.314748  703653 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 21:47:38.469819  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:38.562425  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:38.705829  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:38.969304  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:39.072021  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:39.206688  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:39.470181  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:39.570020  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:39.707394  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:39.984670  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:40.065219  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:40.206859  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:40.469223  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:40.561358  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:40.706599  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:40.969985  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:41.061660  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:41.206767  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:41.470553  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:41.561113  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:41.705515  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:41.969382  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:42.061119  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:42.206342  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:42.470436  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:42.563875  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:42.706690  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:42.969264  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:43.065780  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:43.210316  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:43.470323  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:43.561501  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:43.706578  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:43.969896  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:44.062275  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:44.206718  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:44.472904  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:44.560083  703653 kapi.go:107] duration metric: took 1m20.004440781s to wait for app.kubernetes.io/name=ingress-nginx ...

	I1226 21:47:44.705661  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:44.969639  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:45.209224  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:45.471716  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:45.707461  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:45.970535  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:46.206918  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:46.468572  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:46.710653  703653 kapi.go:107] duration metric: took 1m18.008457405s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I1226 21:47:46.713128  703653 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-154736 cluster.

	I1226 21:47:46.715469  703653 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I1226 21:47:46.717459  703653 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I1226 21:47:46.968908  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:47.469921  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:47.970474  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:48.315876  703653 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1226 21:47:48.333253  703653 api_server.go:72] duration metric: took 1m29.613843192s to wait for apiserver process to appear ...

	I1226 21:47:48.333327  703653 api_server.go:88] waiting for apiserver healthz status ...

	I1226 21:47:48.333374  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I1226 21:47:48.333520  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I1226 21:47:48.387443  703653 cri.go:89] found id: "c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8"

	I1226 21:47:48.387505  703653 cri.go:89] found id: ""

	I1226 21:47:48.387528  703653 logs.go:284] 1 containers: [c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8]

	I1226 21:47:48.387614  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:48.392971  703653 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I1226 21:47:48.393076  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I1226 21:47:48.441764  703653 cri.go:89] found id: "a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a"

	I1226 21:47:48.441787  703653 cri.go:89] found id: ""

	I1226 21:47:48.441795  703653 logs.go:284] 1 containers: [a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a]

	I1226 21:47:48.441857  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:48.446560  703653 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I1226 21:47:48.446637  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I1226 21:47:48.469918  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:48.497664  703653 cri.go:89] found id: "0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a"

	I1226 21:47:48.497689  703653 cri.go:89] found id: ""

	I1226 21:47:48.497698  703653 logs.go:284] 1 containers: [0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a]

	I1226 21:47:48.497770  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:48.503260  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I1226 21:47:48.503397  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I1226 21:47:48.549508  703653 cri.go:89] found id: "a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43"

	I1226 21:47:48.549586  703653 cri.go:89] found id: ""

	I1226 21:47:48.549618  703653 logs.go:284] 1 containers: [a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43]

	I1226 21:47:48.549705  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:48.561880  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I1226 21:47:48.562111  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I1226 21:47:48.610492  703653 cri.go:89] found id: "fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d"

	I1226 21:47:48.610522  703653 cri.go:89] found id: ""

	I1226 21:47:48.610531  703653 logs.go:284] 1 containers: [fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d]

	I1226 21:47:48.610598  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:48.615237  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I1226 21:47:48.615369  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I1226 21:47:48.659894  703653 cri.go:89] found id: "5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee"

	I1226 21:47:48.659921  703653 cri.go:89] found id: ""

	I1226 21:47:48.659929  703653 logs.go:284] 1 containers: [5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee]

	I1226 21:47:48.659986  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:48.664547  703653 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I1226 21:47:48.664625  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I1226 21:47:48.716253  703653 cri.go:89] found id: "5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445"

	I1226 21:47:48.716328  703653 cri.go:89] found id: ""

	I1226 21:47:48.716364  703653 logs.go:284] 1 containers: [5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445]

	I1226 21:47:48.716458  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:48.721160  703653 logs.go:123] Gathering logs for kube-scheduler [a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43] ...

	I1226 21:47:48.721186  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43"

	I1226 21:47:48.796955  703653 logs.go:123] Gathering logs for kube-controller-manager [5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee] ...

	I1226 21:47:48.796993  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee"

	I1226 21:47:48.939771  703653 logs.go:123] Gathering logs for kindnet [5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445] ...

	I1226 21:47:48.939808  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445"

	I1226 21:47:48.973717  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:49.030173  703653 logs.go:123] Gathering logs for container status ...

	I1226 21:47:49.030203  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1226 21:47:49.125812  703653 logs.go:123] Gathering logs for dmesg ...

	I1226 21:47:49.125848  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1226 21:47:49.171784  703653 logs.go:123] Gathering logs for kube-apiserver [c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8] ...

	I1226 21:47:49.171827  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8"

	I1226 21:47:49.261006  703653 logs.go:123] Gathering logs for etcd [a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a] ...

	I1226 21:47:49.261045  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a"

	I1226 21:47:49.385558  703653 logs.go:123] Gathering logs for coredns [0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a] ...

	I1226 21:47:49.385596  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a"

	I1226 21:47:49.470012  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:49.494852  703653 logs.go:123] Gathering logs for kubelet ...

	I1226 21:47:49.494954  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W1226 21:47:49.548364  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.432342    1365 reflector.go:535] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:49.549166  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.432378    1365 reflector.go:147] object-"default"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:49.549563  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.434011    1365 reflector.go:535] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:49.549818  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.434040    1365 reflector.go:147] object-"default"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:49.551333  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.447831    1365 reflector.go:535] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:47:49.551609  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.447865    1365 reflector.go:147] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:47:49.553338  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.510344    1365 reflector.go:535] object-"kube-system"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	W1226 21:47:49.553576  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.510378    1365 reflector.go:147] object-"kube-system"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	I1226 21:47:49.605108  703653 logs.go:123] Gathering logs for describe nodes ...

	I1226 21:47:49.605192  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I1226 21:47:49.830170  703653 logs.go:123] Gathering logs for kube-proxy [fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d] ...

	I1226 21:47:49.830254  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d"

	I1226 21:47:49.887319  703653 logs.go:123] Gathering logs for CRI-O ...

	I1226 21:47:49.887347  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"

	I1226 21:47:49.972589  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:50.005922  703653 out.go:309] Setting ErrFile to fd 2...

	I1226 21:47:50.005963  703653 out.go:343] TERM=,COLORTERM=, which probably does not support color

	W1226 21:47:50.006045  703653 out.go:239] X Problems detected in kubelet:

	W1226 21:47:50.006055  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.434040    1365 reflector.go:147] object-"default"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:50.006062  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.447831    1365 reflector.go:535] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:47:50.006073  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.447865    1365 reflector.go:147] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:47:50.006081  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.510344    1365 reflector.go:535] object-"kube-system"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	W1226 21:47:50.006087  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.510378    1365 reflector.go:147] object-"kube-system"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	I1226 21:47:50.006236  703653 out.go:309] Setting ErrFile to fd 2...

	I1226 21:47:50.006245  703653 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 21:47:50.469306  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:50.969161  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:51.469541  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:51.976072  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:52.468916  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:52.971505  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:53.471156  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:53.972400  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:54.470053  703653 kapi.go:107] duration metric: took 1m29.506960429s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I1226 21:47:54.472743  703653 out.go:177] * Enabled addons: nvidia-device-plugin, storage-provisioner, cloud-spanner, default-storageclass, metrics-server, inspektor-gadget, ingress-dns, yakd, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver

	I1226 21:47:54.474676  703653 addons.go:508] enable addons completed in 1m36.704070199s: enabled=[nvidia-device-plugin storage-provisioner cloud-spanner default-storageclass metrics-server inspektor-gadget ingress-dns yakd volumesnapshots registry ingress gcp-auth csi-hostpath-driver]

	I1226 21:48:00.012117  703653 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...

	I1226 21:48:00.054028  703653 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:

	ok

	I1226 21:48:00.105602  703653 api_server.go:141] control plane version: v1.28.4

	I1226 21:48:00.105631  703653 api_server.go:131] duration metric: took 11.77228382s to wait for apiserver health ...

	I1226 21:48:00.105641  703653 system_pods.go:43] waiting for kube-system pods to appear ...

	I1226 21:48:00.105664  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I1226 21:48:00.105734  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I1226 21:48:00.205318  703653 cri.go:89] found id: "c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8"

	I1226 21:48:00.205391  703653 cri.go:89] found id: ""

	I1226 21:48:00.205415  703653 logs.go:284] 1 containers: [c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8]

	I1226 21:48:00.205524  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:48:00.215039  703653 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I1226 21:48:00.215144  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I1226 21:48:00.324722  703653 cri.go:89] found id: "a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a"

	I1226 21:48:00.324761  703653 cri.go:89] found id: ""

	I1226 21:48:00.324771  703653 logs.go:284] 1 containers: [a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a]

	I1226 21:48:00.324844  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:48:00.334077  703653 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I1226 21:48:00.334167  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I1226 21:48:00.430622  703653 cri.go:89] found id: "0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a"

	I1226 21:48:00.430677  703653 cri.go:89] found id: ""

	I1226 21:48:00.430686  703653 logs.go:284] 1 containers: [0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a]

	I1226 21:48:00.430760  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:48:00.436429  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I1226 21:48:00.436554  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I1226 21:48:00.495777  703653 cri.go:89] found id: "a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43"

	I1226 21:48:00.495803  703653 cri.go:89] found id: ""

	I1226 21:48:00.495812  703653 logs.go:284] 1 containers: [a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43]

	I1226 21:48:00.495875  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:48:00.501338  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I1226 21:48:00.501419  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I1226 21:48:00.552860  703653 cri.go:89] found id: "fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d"

	I1226 21:48:00.552885  703653 cri.go:89] found id: ""

	I1226 21:48:00.552895  703653 logs.go:284] 1 containers: [fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d]

	I1226 21:48:00.552952  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:48:00.558338  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I1226 21:48:00.558413  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I1226 21:48:00.612356  703653 cri.go:89] found id: "5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee"

	I1226 21:48:00.612377  703653 cri.go:89] found id: ""

	I1226 21:48:00.612385  703653 logs.go:284] 1 containers: [5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee]

	I1226 21:48:00.612449  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:48:00.619281  703653 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I1226 21:48:00.619395  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I1226 21:48:00.662127  703653 cri.go:89] found id: "5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445"

	I1226 21:48:00.662151  703653 cri.go:89] found id: ""

	I1226 21:48:00.662159  703653 logs.go:284] 1 containers: [5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445]

	I1226 21:48:00.662229  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:48:00.667001  703653 logs.go:123] Gathering logs for kubelet ...

	I1226 21:48:00.667025  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W1226 21:48:00.702904  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.432342    1365 reflector.go:535] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:48:00.703173  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.432378    1365 reflector.go:147] object-"default"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:48:00.703487  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.434011    1365 reflector.go:535] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:48:00.703673  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.434040    1365 reflector.go:147] object-"default"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:48:00.705704  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.447831    1365 reflector.go:535] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:48:00.705960  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.447865    1365 reflector.go:147] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:48:00.707327  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.510344    1365 reflector.go:535] object-"kube-system"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	W1226 21:48:00.707535  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.510378    1365 reflector.go:147] object-"kube-system"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	I1226 21:48:00.754783  703653 logs.go:123] Gathering logs for describe nodes ...

	I1226 21:48:00.754810  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I1226 21:48:00.898722  703653 logs.go:123] Gathering logs for coredns [0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a] ...

	I1226 21:48:00.898807  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a"

	I1226 21:48:00.944475  703653 logs.go:123] Gathering logs for kube-scheduler [a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43] ...

	I1226 21:48:00.944507  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43"

	I1226 21:48:00.998551  703653 logs.go:123] Gathering logs for kindnet [5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445] ...

	I1226 21:48:00.998580  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445"

	I1226 21:48:01.044214  703653 logs.go:123] Gathering logs for CRI-O ...

	I1226 21:48:01.044242  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"

	I1226 21:48:01.140135  703653 logs.go:123] Gathering logs for container status ...

	I1226 21:48:01.140173  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1226 21:48:01.217748  703653 logs.go:123] Gathering logs for dmesg ...

	I1226 21:48:01.217781  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1226 21:48:01.240763  703653 logs.go:123] Gathering logs for kube-apiserver [c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8] ...

	I1226 21:48:01.240795  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8"

	I1226 21:48:01.318123  703653 logs.go:123] Gathering logs for etcd [a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a] ...

	I1226 21:48:01.318163  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a"

	I1226 21:48:01.403342  703653 logs.go:123] Gathering logs for kube-proxy [fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d] ...

	I1226 21:48:01.403377  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d"

	I1226 21:48:01.445673  703653 logs.go:123] Gathering logs for kube-controller-manager [5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee] ...

	I1226 21:48:01.445704  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee"

	I1226 21:48:01.544040  703653 out.go:309] Setting ErrFile to fd 2...

	I1226 21:48:01.544074  703653 out.go:343] TERM=,COLORTERM=, which probably does not support color

	W1226 21:48:01.544133  703653 out.go:239] X Problems detected in kubelet:

	W1226 21:48:01.544145  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.434040    1365 reflector.go:147] object-"default"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:48:01.544153  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.447831    1365 reflector.go:535] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:48:01.544165  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.447865    1365 reflector.go:147] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:48:01.544171  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.510344    1365 reflector.go:535] object-"kube-system"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	W1226 21:48:01.544178  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.510378    1365 reflector.go:147] object-"kube-system"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	I1226 21:48:01.544187  703653 out.go:309] Setting ErrFile to fd 2...

	I1226 21:48:01.544193  703653 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 21:48:11.554926  703653 system_pods.go:59] 18 kube-system pods found

	I1226 21:48:11.554969  703653 system_pods.go:61] "coredns-5dd5756b68-gbz9g" [7756995c-c766-475d-9528-a269947fb962] Running

	I1226 21:48:11.554976  703653 system_pods.go:61] "csi-hostpath-attacher-0" [27b8fdc0-b1a5-4537-90ed-94f695dc725c] Running

	I1226 21:48:11.554981  703653 system_pods.go:61] "csi-hostpath-resizer-0" [12956ad9-043f-423a-a709-e31bcd813e2c] Running

	I1226 21:48:11.554987  703653 system_pods.go:61] "csi-hostpathplugin-6v6w7" [16d70f46-43bf-4ddd-84fa-27b4cb888c4d] Running

	I1226 21:48:11.554993  703653 system_pods.go:61] "etcd-addons-154736" [547ecee7-8f0e-4964-9a05-a236594fe216] Running

	I1226 21:48:11.554998  703653 system_pods.go:61] "kindnet-5jgmg" [eca9c6b5-b0b8-4bdc-adf8-082992994bf6] Running

	I1226 21:48:11.555010  703653 system_pods.go:61] "kube-apiserver-addons-154736" [34c16ef5-ca23-4cb1-bec3-39f588dca777] Running

	I1226 21:48:11.555016  703653 system_pods.go:61] "kube-controller-manager-addons-154736" [b82dbbab-8430-449d-bdc0-1958eaf7e227] Running

	I1226 21:48:11.555028  703653 system_pods.go:61] "kube-ingress-dns-minikube" [e6c2ffcd-377b-48c7-b5ca-3ac9d28f4f89] Running / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])

	I1226 21:48:11.555034  703653 system_pods.go:61] "kube-proxy-4r79z" [4d99dd25-dcc5-4774-9ed5-ad626aabfced] Running

	I1226 21:48:11.555050  703653 system_pods.go:61] "kube-scheduler-addons-154736" [6a9cd5cd-d4ac-42d2-a4c7-e14e0a947899] Running

	I1226 21:48:11.555058  703653 system_pods.go:61] "metrics-server-7c66d45ddc-pz8ht" [ff2fdb32-af66-480d-ad25-175b65c5b1d4] Running

	I1226 21:48:11.555066  703653 system_pods.go:61] "nvidia-device-plugin-daemonset-9xfxt" [74fad637-1854-48ce-b606-8a09c28e7cfe] Running

	I1226 21:48:11.555071  703653 system_pods.go:61] "registry-g2w98" [21fa161c-0f99-4fb5-9573-259bd78d21a5] Running

	I1226 21:48:11.555078  703653 system_pods.go:61] "registry-proxy-h7qrg" [274f34a4-99a0-4df2-8e40-73229ad88336] Running

	I1226 21:48:11.555083  703653 system_pods.go:61] "snapshot-controller-58dbcc7b99-rtlzb" [b1add7d4-2504-43e0-83c8-40fc2c220da7] Running

	I1226 21:48:11.555088  703653 system_pods.go:61] "snapshot-controller-58dbcc7b99-wl4bb" [a7f38ca6-3848-4c5b-a7a3-b01da5e90140] Running

	I1226 21:48:11.555092  703653 system_pods.go:61] "storage-provisioner" [f0bcfc9d-7cd8-489e-9d2f-49edc5ce7b5d] Running

	I1226 21:48:11.555099  703653 system_pods.go:74] duration metric: took 11.449451529s to wait for pod list to return data ...

	I1226 21:48:11.555111  703653 default_sa.go:34] waiting for default service account to be created ...

	I1226 21:48:11.557677  703653 default_sa.go:45] found service account: "default"

	I1226 21:48:11.557702  703653 default_sa.go:55] duration metric: took 2.583966ms for default service account to be created ...

	I1226 21:48:11.557712  703653 system_pods.go:116] waiting for k8s-apps to be running ...

	I1226 21:48:11.567787  703653 system_pods.go:86] 18 kube-system pods found

	I1226 21:48:11.567826  703653 system_pods.go:89] "coredns-5dd5756b68-gbz9g" [7756995c-c766-475d-9528-a269947fb962] Running

	I1226 21:48:11.567834  703653 system_pods.go:89] "csi-hostpath-attacher-0" [27b8fdc0-b1a5-4537-90ed-94f695dc725c] Running

	I1226 21:48:11.567840  703653 system_pods.go:89] "csi-hostpath-resizer-0" [12956ad9-043f-423a-a709-e31bcd813e2c] Running

	I1226 21:48:11.567846  703653 system_pods.go:89] "csi-hostpathplugin-6v6w7" [16d70f46-43bf-4ddd-84fa-27b4cb888c4d] Running

	I1226 21:48:11.567851  703653 system_pods.go:89] "etcd-addons-154736" [547ecee7-8f0e-4964-9a05-a236594fe216] Running

	I1226 21:48:11.567856  703653 system_pods.go:89] "kindnet-5jgmg" [eca9c6b5-b0b8-4bdc-adf8-082992994bf6] Running

	I1226 21:48:11.567860  703653 system_pods.go:89] "kube-apiserver-addons-154736" [34c16ef5-ca23-4cb1-bec3-39f588dca777] Running

	I1226 21:48:11.567867  703653 system_pods.go:89] "kube-controller-manager-addons-154736" [b82dbbab-8430-449d-bdc0-1958eaf7e227] Running

	I1226 21:48:11.567876  703653 system_pods.go:89] "kube-ingress-dns-minikube" [e6c2ffcd-377b-48c7-b5ca-3ac9d28f4f89] Running / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])

	I1226 21:48:11.567890  703653 system_pods.go:89] "kube-proxy-4r79z" [4d99dd25-dcc5-4774-9ed5-ad626aabfced] Running

	I1226 21:48:11.567899  703653 system_pods.go:89] "kube-scheduler-addons-154736" [6a9cd5cd-d4ac-42d2-a4c7-e14e0a947899] Running

	I1226 21:48:11.567904  703653 system_pods.go:89] "metrics-server-7c66d45ddc-pz8ht" [ff2fdb32-af66-480d-ad25-175b65c5b1d4] Running

	I1226 21:48:11.567910  703653 system_pods.go:89] "nvidia-device-plugin-daemonset-9xfxt" [74fad637-1854-48ce-b606-8a09c28e7cfe] Running

	I1226 21:48:11.567917  703653 system_pods.go:89] "registry-g2w98" [21fa161c-0f99-4fb5-9573-259bd78d21a5] Running

	I1226 21:48:11.567922  703653 system_pods.go:89] "registry-proxy-h7qrg" [274f34a4-99a0-4df2-8e40-73229ad88336] Running

	I1226 21:48:11.567926  703653 system_pods.go:89] "snapshot-controller-58dbcc7b99-rtlzb" [b1add7d4-2504-43e0-83c8-40fc2c220da7] Running

	I1226 21:48:11.567931  703653 system_pods.go:89] "snapshot-controller-58dbcc7b99-wl4bb" [a7f38ca6-3848-4c5b-a7a3-b01da5e90140] Running

	I1226 21:48:11.567938  703653 system_pods.go:89] "storage-provisioner" [f0bcfc9d-7cd8-489e-9d2f-49edc5ce7b5d] Running

	I1226 21:48:11.567948  703653 system_pods.go:126] duration metric: took 10.227696ms to wait for k8s-apps to be running ...

	I1226 21:48:11.567960  703653 system_svc.go:44] waiting for kubelet service to be running ....

	I1226 21:48:11.568025  703653 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1226 21:48:11.582548  703653 system_svc.go:56] duration metric: took 14.580186ms WaitForService to wait for kubelet.

	I1226 21:48:11.582578  703653 kubeadm.go:581] duration metric: took 1m52.863172985s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I1226 21:48:11.582598  703653 node_conditions.go:102] verifying NodePressure condition ...

	I1226 21:48:11.586209  703653 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki

	I1226 21:48:11.586240  703653 node_conditions.go:123] node cpu capacity is 2

	I1226 21:48:11.586252  703653 node_conditions.go:105] duration metric: took 3.649229ms to run NodePressure ...

	I1226 21:48:11.586264  703653 start.go:228] waiting for startup goroutines ...

	I1226 21:48:11.586271  703653 start.go:233] waiting for cluster config update ...

	I1226 21:48:11.586284  703653 start.go:242] writing updated cluster config ...

	I1226 21:48:11.586574  703653 ssh_runner.go:195] Run: rm -f paused

	I1226 21:48:11.914611  703653 start.go:600] kubectl: 1.29.0, cluster: 1.28.4 (minor skew: 1)

	I1226 21:48:11.917788  703653 out.go:177] * Done! kubectl is now configured to use "addons-154736" cluster and "default" namespace by default

	==> CRI-O <==

	Dec 26 21:55:18 addons-154736 crio[897]: time="2023-12-26 21:55:18.486405855Z" level=info msg="Image docker.io/nginx:alpine not found" id=f7bdba2b-2092-4536-8063-cd1d2f8579f0 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:55:18 addons-154736 crio[897]: time="2023-12-26 21:55:18.487300521Z" level=info msg="Pulling image: docker.io/nginx:alpine" id=2cc72c56-db56-4a69-b1ab-1dd3fe583efc name=/runtime.v1.ImageService/PullImage

	Dec 26 21:55:18 addons-154736 crio[897]: time="2023-12-26 21:55:18.489340885Z" level=info msg="Trying to access \"docker.io/library/nginx:alpine\""

	Dec 26 21:55:29 addons-154736 crio[897]: time="2023-12-26 21:55:29.486675710Z" level=info msg="Checking image status: docker.io/nginx:latest" id=df47c617-8688-42fc-a9d4-cc6550adccd3 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:55:29 addons-154736 crio[897]: time="2023-12-26 21:55:29.486900345Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:8aea65d81da202cf886d7766c7f2691bb9e363c6b5d9b1f5d9ddaaa4bc1e90c2,RepoTags:[docker.io/library/nginx:latest],RepoDigests:[docker.io/library/nginx@sha256:2bdc49f2f8ae8d8dc50ed00f2ee56d00385c6f8bc8a8b320d0a294d9e3b49026 docker.io/library/nginx@sha256:73a06b3a2577448f9acc23502a0cb4d41919da9cc5035e66b0a9a09715397684],Size_:196113558,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=df47c617-8688-42fc-a9d4-cc6550adccd3 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:55:44 addons-154736 crio[897]: time="2023-12-26 21:55:44.487371609Z" level=info msg="Checking image status: docker.io/nginx:latest" id=167ca2a6-35c9-41d9-b172-18ba27fde065 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:55:44 addons-154736 crio[897]: time="2023-12-26 21:55:44.487600215Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:8aea65d81da202cf886d7766c7f2691bb9e363c6b5d9b1f5d9ddaaa4bc1e90c2,RepoTags:[docker.io/library/nginx:latest],RepoDigests:[docker.io/library/nginx@sha256:2bdc49f2f8ae8d8dc50ed00f2ee56d00385c6f8bc8a8b320d0a294d9e3b49026 docker.io/library/nginx@sha256:73a06b3a2577448f9acc23502a0cb4d41919da9cc5035e66b0a9a09715397684],Size_:196113558,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=167ca2a6-35c9-41d9-b172-18ba27fde065 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:55:58 addons-154736 crio[897]: time="2023-12-26 21:55:58.487183464Z" level=info msg="Checking image status: docker.io/nginx:latest" id=2218b318-eda8-483a-bc1b-1596be1e7c1e name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:55:58 addons-154736 crio[897]: time="2023-12-26 21:55:58.487407951Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:8aea65d81da202cf886d7766c7f2691bb9e363c6b5d9b1f5d9ddaaa4bc1e90c2,RepoTags:[docker.io/library/nginx:latest],RepoDigests:[docker.io/library/nginx@sha256:2bdc49f2f8ae8d8dc50ed00f2ee56d00385c6f8bc8a8b320d0a294d9e3b49026 docker.io/library/nginx@sha256:73a06b3a2577448f9acc23502a0cb4d41919da9cc5035e66b0a9a09715397684],Size_:196113558,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=2218b318-eda8-483a-bc1b-1596be1e7c1e name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:55:58 addons-154736 crio[897]: time="2023-12-26 21:55:58.488926357Z" level=info msg="Pulling image: docker.io/nginx:latest" id=3378fbcf-6532-44db-aabc-e82fb5299276 name=/runtime.v1.ImageService/PullImage

	Dec 26 21:55:58 addons-154736 crio[897]: time="2023-12-26 21:55:58.491290233Z" level=info msg="Trying to access \"docker.io/library/nginx:latest\""

	Dec 26 21:56:00 addons-154736 crio[897]: time="2023-12-26 21:56:00.489222771Z" level=info msg="Checking image status: docker.io/nginx:alpine" id=c949f247-f9c2-4660-8847-07a9e2a62a50 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:56:00 addons-154736 crio[897]: time="2023-12-26 21:56:00.489597408Z" level=info msg="Image docker.io/nginx:alpine not found" id=c949f247-f9c2-4660-8847-07a9e2a62a50 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:56:04 addons-154736 crio[897]: time="2023-12-26 21:56:04.528336492Z" level=info msg="Checking image status: registry.k8s.io/pause:3.9" id=fd6d83ee-186e-4060-818c-2c3082007e75 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:56:04 addons-154736 crio[897]: time="2023-12-26 21:56:04.528700004Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:829e9de338bd5fdd3f16f68f83a9fb288fbc8453e881e5d5cfd0f6f2ff72b43e,RepoTags:[registry.k8s.io/pause:3.9],RepoDigests:[registry.k8s.io/pause@sha256:3ec98b8452dc8ae265a6917dfb81587ac78849e520d5dbba6de524851d20eca6 registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097],Size_:520014,Uid:&Int64Value{Value:65535,},Username:,Spec:nil,},Info:map[string]string{},}" id=fd6d83ee-186e-4060-818c-2c3082007e75 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:56:14 addons-154736 crio[897]: time="2023-12-26 21:56:14.486738386Z" level=info msg="Checking image status: docker.io/nginx:alpine" id=6db9d0f3-8531-4796-9550-d72e60434936 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:56:14 addons-154736 crio[897]: time="2023-12-26 21:56:14.486999967Z" level=info msg="Image docker.io/nginx:alpine not found" id=6db9d0f3-8531-4796-9550-d72e60434936 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:56:29 addons-154736 crio[897]: time="2023-12-26 21:56:29.486908065Z" level=info msg="Checking image status: docker.io/nginx:alpine" id=89bc51ff-54a5-467e-a9bb-1a5fa980ac45 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:56:29 addons-154736 crio[897]: time="2023-12-26 21:56:29.487165306Z" level=info msg="Image docker.io/nginx:alpine not found" id=89bc51ff-54a5-467e-a9bb-1a5fa980ac45 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:56:42 addons-154736 crio[897]: time="2023-12-26 21:56:42.486635188Z" level=info msg="Checking image status: docker.io/nginx:alpine" id=86d3ea47-e5d0-43ef-9da0-949ba58fbdd7 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:56:42 addons-154736 crio[897]: time="2023-12-26 21:56:42.486935357Z" level=info msg="Image docker.io/nginx:alpine not found" id=86d3ea47-e5d0-43ef-9da0-949ba58fbdd7 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:56:56 addons-154736 crio[897]: time="2023-12-26 21:56:56.487317175Z" level=info msg="Checking image status: docker.io/nginx:alpine" id=e72d72e5-97dc-460b-9e1f-02f3d96f755f name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:56:56 addons-154736 crio[897]: time="2023-12-26 21:56:56.487539168Z" level=info msg="Image docker.io/nginx:alpine not found" id=e72d72e5-97dc-460b-9e1f-02f3d96f755f name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:56:57 addons-154736 crio[897]: time="2023-12-26 21:56:57.486980106Z" level=info msg="Checking image status: docker.io/nginx:latest" id=c9cddc1d-2945-409d-87f2-c961ff98295a name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:56:57 addons-154736 crio[897]: time="2023-12-26 21:56:57.487212248Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:8aea65d81da202cf886d7766c7f2691bb9e363c6b5d9b1f5d9ddaaa4bc1e90c2,RepoTags:[docker.io/library/nginx:latest],RepoDigests:[docker.io/library/nginx@sha256:2bdc49f2f8ae8d8dc50ed00f2ee56d00385c6f8bc8a8b320d0a294d9e3b49026 docker.io/library/nginx@sha256:73a06b3a2577448f9acc23502a0cb4d41919da9cc5035e66b0a9a09715397684],Size_:196113558,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=c9cddc1d-2945-409d-87f2-c961ff98295a name=/runtime.v1.ImageService/ImageStatus

	==> container status <==

	CONTAINER           IMAGE                                                                                                                                        CREATED             STATE               NAME                                     ATTEMPT             POD ID              POD

	5fe6705eae1fb       1499ed4fbd0aa6ea742ab6bce25603aa33556e1ac0e2f24a4901a675247e538a                                                                             3 minutes ago       Exited              minikube-ingress-dns                     6                   01202b99ec6d0       kube-ingress-dns-minikube

	abb80e1df162f       ghcr.io/headlamp-k8s/headlamp@sha256:0fe50c48c186b89ff3d341dba427174d8232a64c3062af5de854a3a7cb2105ce                                        8 minutes ago       Running             headlamp                                 0                   7ca1bd6e6c1a2       headlamp-7ddfbb94ff-qntlc

	d649a08406e0b       registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f                          9 minutes ago       Running             csi-snapshotter                          0                   9824742ac2b4d       csi-hostpathplugin-6v6w7

	a2e9c531dfae6       registry.k8s.io/sig-storage/csi-provisioner@sha256:98ffd09c0784203d200e0f8c241501de31c8df79644caac7eed61bd6391e5d49                          9 minutes ago       Running             csi-provisioner                          0                   9824742ac2b4d       csi-hostpathplugin-6v6w7

	c46e1aaf747f5       registry.k8s.io/sig-storage/livenessprobe@sha256:8b00c6e8f52639ed9c6f866085893ab688e57879741b3089e3cfa9998502e158                            9 minutes ago       Running             liveness-probe                           0                   9824742ac2b4d       csi-hostpathplugin-6v6w7

	5736264be5277       registry.k8s.io/sig-storage/hostpathplugin@sha256:7b1dfc90a367222067fc468442fdf952e20fc5961f25c1ad654300ddc34d7083                           9 minutes ago       Running             hostpath                                 0                   9824742ac2b4d       csi-hostpathplugin-6v6w7

	426fb5db606fa       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:63b520448091bc94aa4dba00d6b3b3c25e410c4fb73aa46feae5b25f9895abaa                                 9 minutes ago       Running             gcp-auth                                 0                   9bd4cf657b01b       gcp-auth-d4c87556c-c9kbx

	165279e6203ce       registry.k8s.io/ingress-nginx/controller@sha256:1ca66aa9f7f8fdecbecc88e4b89f0f4e7a1f1e952d0d5e52df2524e526259f6b                             9 minutes ago       Running             controller                               0                   4a0fbbb610f9c       ingress-nginx-controller-69cff4fd79-rqdlh

	c9f32bcae8b00       registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:511b8c8ac828194a753909d26555ff08bc12f497dd8daeb83fe9d593693a26c1                9 minutes ago       Running             node-driver-registrar                    0                   9824742ac2b4d       csi-hostpathplugin-6v6w7

	b684e7784c70e       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:67202a0258c6f81d073f265f449a732c89cc1112a8e80ea27317294df6dce2b5                   9 minutes ago       Exited              patch                                    0                   4ea53d7234716       ingress-nginx-admission-patch-gwrdr

	af22d1e4dbcc7       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:67202a0258c6f81d073f265f449a732c89cc1112a8e80ea27317294df6dce2b5                   9 minutes ago       Exited              create                                   0                   d92ec2169085e       ingress-nginx-admission-create-jtzt2

	1bc6c433ebb20       registry.k8s.io/sig-storage/csi-external-health-monitor-controller@sha256:80b9ba94aa2afe24553d69bd165a6a51552d1582d68618ec00d3b804a7d9193c   9 minutes ago       Running             csi-external-health-monitor-controller   0                   9824742ac2b4d       csi-hostpathplugin-6v6w7

	9ebfe5e4c3c95       registry.k8s.io/sig-storage/csi-attacher@sha256:4b5609c78455de45821910065281a368d5f760b41250f90cbde5110543bdc326                             9 minutes ago       Running             csi-attacher                             0                   6403bae626ef6       csi-hostpath-attacher-0

	de059b46043d6       registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7                              9 minutes ago       Running             csi-resizer                              0                   95e515ab13810       csi-hostpath-resizer-0

	7d0d63bb665e8       docker.io/rancher/local-path-provisioner@sha256:689a2489a24e74426e4a4666e611c988202c5fa995908b0c60133aca3eb87d98                             9 minutes ago       Running             local-path-provisioner                   0                   3c9b34a725c2d       local-path-provisioner-78b46b4d5c-nwr5l

	ce1e295decd3a       registry.k8s.io/sig-storage/snapshot-controller@sha256:5d668e35c15df6e87e2530da25d557f543182cedbdb39d421b87076463ee9857                      9 minutes ago       Running             volume-snapshot-controller               0                   01b7c76bc0451       snapshot-controller-58dbcc7b99-wl4bb

	8716dbfa389d1       registry.k8s.io/sig-storage/snapshot-controller@sha256:5d668e35c15df6e87e2530da25d557f543182cedbdb39d421b87076463ee9857                      10 minutes ago      Running             volume-snapshot-controller               0                   d160ae65c8530       snapshot-controller-58dbcc7b99-rtlzb

	aea4da7d2eeb6       docker.io/marcnuri/yakd@sha256:a3f540278e4c11373e15605311851dd9c64d208f4d63e727bccc0e39f9329310                                              10 minutes ago      Running             yakd                                     0                   4f2b49cd1d1cc       yakd-dashboard-9947fc6bf-5ggjq

	2ca195417d20c       ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6                                                                             10 minutes ago      Running             storage-provisioner                      0                   c3b7a1e4b36d7       storage-provisioner

	0b9784687fdf8       97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108                                                                             10 minutes ago      Running             coredns                                  0                   eb0ca42f98aa6       coredns-5dd5756b68-gbz9g

	fc7c1d4cc434f       3ca3ca488cf13fde14cfc4b3ffde0c53a8c161b030f4a444a797fba6aef38c39                                                                             10 minutes ago      Running             kube-proxy                               0                   ecfe1e6ef509b       kube-proxy-4r79z

	5f14597475dee       04b4eaa3d3db8abea4b9ea4d10a0926ebb31db5a31b673aa1cf7a4b3af4add26                                                                             10 minutes ago      Running             kindnet-cni                              0                   9ab992efa85d9       kindnet-5jgmg

	c5b1b0ac08cda       04b4c447bb9d4840af3bf7e836397379d65df87c86e55dcd27f31a8d11df2419                                                                             11 minutes ago      Running             kube-apiserver                           0                   931df03571461       kube-apiserver-addons-154736

	5f4d17cd1a759       9961cbceaf234d59b7dcf8a197a024f3e3ce4b7fe2b67c2378efd3d209ca994b                                                                             11 minutes ago      Running             kube-controller-manager                  0                   2627c20b7662e       kube-controller-manager-addons-154736

	a1a3df534703e       05c284c929889d88306fdb3dd14ee2d0132543740f9e247685243214fc3d2c54                                                                             11 minutes ago      Running             kube-scheduler                           0                   ec5babc1f5d4e       kube-scheduler-addons-154736

	a00bf48419309       9cdd6470f48c8b127530b7ce6ea4b3524137984481e48bcde619735890840ace                                                                             11 minutes ago      Running             etcd                                     0                   7d1113e33d739       etcd-addons-154736

	==> coredns [0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a] <==

	[INFO] 10.244.0.17:56311 - 15111 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002393906s

	[INFO] 10.244.0.17:51530 - 56241 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000175454s

	[INFO] 10.244.0.17:51530 - 12478 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000167824s

	[INFO] 10.244.0.17:39191 - 1431 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000152177s

	[INFO] 10.244.0.17:39191 - 26810 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000257677s

	[INFO] 10.244.0.17:48634 - 5977 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000094922s

	[INFO] 10.244.0.17:48634 - 31128 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000201201s

	[INFO] 10.244.0.17:42129 - 3593 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000112933s

	[INFO] 10.244.0.17:42129 - 27143 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000175676s

	[INFO] 10.244.0.17:38550 - 52237 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001772128s

	[INFO] 10.244.0.17:38550 - 50184 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001680774s

	[INFO] 10.244.0.17:43293 - 31812 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000078431s

	[INFO] 10.244.0.17:43293 - 9529 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000118701s

	[INFO] 10.244.0.20:60042 - 54775 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000264445s

	[INFO] 10.244.0.20:36194 - 51775 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.00017314s

	[INFO] 10.244.0.20:34311 - 42203 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000161137s

	[INFO] 10.244.0.20:47094 - 4881 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.00011441s

	[INFO] 10.244.0.20:40589 - 5895 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000281774s

	[INFO] 10.244.0.20:42712 - 53585 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000328559s

	[INFO] 10.244.0.20:45825 - 51530 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002334691s

	[INFO] 10.244.0.20:60259 - 40603 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002397369s

	[INFO] 10.244.0.20:47110 - 43627 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.000740267s

	[INFO] 10.244.0.20:50917 - 58925 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 344 0.004757339s

	[INFO] 10.244.0.22:47955 - 2 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000184398s

	[INFO] 10.244.0.22:42660 - 3 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000128588s

	==> describe nodes <==

	Name:               addons-154736

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=addons-154736

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=393f165ced08f66e4386491f243850f87982a22b

	                    minikube.k8s.io/name=addons-154736

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_12_26T21_46_05_0700

	                    minikube.k8s.io/version=v1.32.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	                    topology.hostpath.csi/node=addons-154736

	Annotations:        csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-154736"}

	                    kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Tue, 26 Dec 2023 21:46:01 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  addons-154736

	  AcquireTime:     <unset>

	  RenewTime:       Tue, 26 Dec 2023 21:56:58 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Tue, 26 Dec 2023 21:54:13 +0000   Tue, 26 Dec 2023 21:45:58 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Tue, 26 Dec 2023 21:54:13 +0000   Tue, 26 Dec 2023 21:45:58 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Tue, 26 Dec 2023 21:54:13 +0000   Tue, 26 Dec 2023 21:45:58 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Tue, 26 Dec 2023 21:54:13 +0000   Tue, 26 Dec 2023 21:46:52 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.49.2

	  Hostname:    addons-154736

	Capacity:

	  cpu:                2

	  ephemeral-storage:  203034800Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             8022496Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  203034800Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             8022496Ki

	  pods:               110

	System Info:

	  Machine ID:                 cfc7b39add434585b250c10345c20f17

	  System UUID:                04713493-cfac-4455-8894-dae1076e6bc4

	  Boot ID:                    f8f887b2-8c20-433d-a967-90e814370f09

	  Kernel Version:             5.15.0-1051-aws

	  OS Image:                   Ubuntu 22.04.3 LTS

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  cri-o://1.24.6

	  Kubelet Version:            v1.28.4

	  Kube-Proxy Version:         v1.28.4

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (21 in total)

	  Namespace                   Name                                         CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                         ------------  ----------  ---------------  -------------  ---

	  default                     nginx                                        0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m2s

	  default                     task-pv-pod-restore                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m42s

	  gcp-auth                    gcp-auth-d4c87556c-c9kbx                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  headlamp                    headlamp-7ddfbb94ff-qntlc                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m48s

	  ingress-nginx               ingress-nginx-controller-69cff4fd79-rqdlh    100m (5%!)(MISSING)     0 (0%!)(MISSING)      90Mi (1%!)(MISSING)        0 (0%!)(MISSING)         10m

	  kube-system                 coredns-5dd5756b68-gbz9g                     100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     10m

	  kube-system                 csi-hostpath-attacher-0                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  kube-system                 csi-hostpath-resizer-0                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  kube-system                 csi-hostpathplugin-6v6w7                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  kube-system                 etcd-addons-154736                           100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         10m

	  kube-system                 kindnet-5jgmg                                100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      10m

	  kube-system                 kube-apiserver-addons-154736                 250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  kube-system                 kube-controller-manager-addons-154736        200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  kube-system                 kube-ingress-dns-minikube                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  kube-system                 kube-proxy-4r79z                             0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  kube-system                 kube-scheduler-addons-154736                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  kube-system                 snapshot-controller-58dbcc7b99-rtlzb         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  kube-system                 snapshot-controller-58dbcc7b99-wl4bb         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  kube-system                 storage-provisioner                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  local-path-storage          local-path-provisioner-78b46b4d5c-nwr5l      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  yakd-dashboard              yakd-dashboard-9947fc6bf-5ggjq               0 (0%!)(MISSING)        0 (0%!)(MISSING)      128Mi (1%!)(MISSING)       256Mi (3%!)(MISSING)     10m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                950m (47%!)(MISSING)  100m (5%!)(MISSING)

	  memory             438Mi (5%!)(MISSING)  476Mi (6%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age   From             Message

	  ----    ------                   ----  ----             -------

	  Normal  Starting                 10m   kube-proxy       

	  Normal  Starting                 10m   kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  10m   kubelet          Node addons-154736 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    10m   kubelet          Node addons-154736 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     10m   kubelet          Node addons-154736 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           10m   node-controller  Node addons-154736 event: Registered Node addons-154736 in Controller

	  Normal  NodeReady                10m   kubelet          Node addons-154736 status is now: NodeReady

	==> dmesg <==

	[  +0.001114] FS-Cache: O-key=[8] '635f3b0000000000'

	[  +0.000763] FS-Cache: N-cookie c=00000030 [p=00000027 fl=2 nc=0 na=1]

	[  +0.001031] FS-Cache: N-cookie d=00000000b9607d6a{9p.inode} n=000000000db3c1b7

	[  +0.001157] FS-Cache: N-key=[8] '635f3b0000000000'

	[  +0.002874] FS-Cache: Duplicate cookie detected

	[  +0.000764] FS-Cache: O-cookie c=0000002a [p=00000027 fl=226 nc=0 na=1]

	[  +0.001117] FS-Cache: O-cookie d=00000000b9607d6a{9p.inode} n=000000007ac7c815

	[  +0.001084] FS-Cache: O-key=[8] '635f3b0000000000'

	[  +0.000742] FS-Cache: N-cookie c=00000031 [p=00000027 fl=2 nc=0 na=1]

	[  +0.001038] FS-Cache: N-cookie d=00000000b9607d6a{9p.inode} n=00000000328509c1

	[  +0.001125] FS-Cache: N-key=[8] '635f3b0000000000'

	[  +2.220713] FS-Cache: Duplicate cookie detected

	[  +0.000749] FS-Cache: O-cookie c=00000028 [p=00000027 fl=226 nc=0 na=1]

	[  +0.001122] FS-Cache: O-cookie d=00000000b9607d6a{9p.inode} n=00000000ebeba0e0

	[  +0.001200] FS-Cache: O-key=[8] '615f3b0000000000'

	[  +0.000765] FS-Cache: N-cookie c=00000033 [p=00000027 fl=2 nc=0 na=1]

	[  +0.000989] FS-Cache: N-cookie d=00000000b9607d6a{9p.inode} n=000000008353ea7f

	[  +0.001072] FS-Cache: N-key=[8] '615f3b0000000000'

	[  +0.309997] FS-Cache: Duplicate cookie detected

	[  +0.000749] FS-Cache: O-cookie c=0000002d [p=00000027 fl=226 nc=0 na=1]

	[  +0.001114] FS-Cache: O-cookie d=00000000b9607d6a{9p.inode} n=00000000e02b88cc

	[  +0.001198] FS-Cache: O-key=[8] '695f3b0000000000'

	[  +0.000739] FS-Cache: N-cookie c=00000034 [p=00000027 fl=2 nc=0 na=1]

	[  +0.001020] FS-Cache: N-cookie d=00000000b9607d6a{9p.inode} n=000000000db3c1b7

	[  +0.001131] FS-Cache: N-key=[8] '695f3b0000000000'

	==> etcd [a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a] <==

	{"level":"info","ts":"2023-12-26T21:46:19.449152Z","caller":"traceutil/trace.go:171","msg":"trace[612606180] range","detail":"{range_begin:/registry/serviceaccounts/kube-public/; range_end:/registry/serviceaccounts/kube-public0; response_count:1; response_revision:340; }","duration":"167.415706ms","start":"2023-12-26T21:46:19.281716Z","end":"2023-12-26T21:46:19.449131Z","steps":["trace[612606180] 'agreement among raft nodes before linearized reading'  (duration: 153.1419ms)"],"step_count":1}

	{"level":"warn","ts":"2023-12-26T21:46:19.435203Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"153.620929ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/kube-proxy\" ","response":"range_response_count:1 size:185"}

	{"level":"info","ts":"2023-12-26T21:46:19.450364Z","caller":"traceutil/trace.go:171","msg":"trace[1514450604] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/kube-proxy; range_end:; response_count:1; response_revision:340; }","duration":"168.7533ms","start":"2023-12-26T21:46:19.281574Z","end":"2023-12-26T21:46:19.450327Z","steps":["trace[1514450604] 'agreement among raft nodes before linearized reading'  (duration: 153.599177ms)"],"step_count":1}

	{"level":"warn","ts":"2023-12-26T21:46:19.435236Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"153.87264ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/replicaset-controller\" ","response":"range_response_count:1 size:207"}

	{"level":"info","ts":"2023-12-26T21:46:19.450684Z","caller":"traceutil/trace.go:171","msg":"trace[844122797] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/replicaset-controller; range_end:; response_count:1; response_revision:340; }","duration":"169.314879ms","start":"2023-12-26T21:46:19.28136Z","end":"2023-12-26T21:46:19.450675Z","steps":["trace[844122797] 'agreement among raft nodes before linearized reading'  (duration: 153.860891ms)"],"step_count":1}

	{"level":"warn","ts":"2023-12-26T21:46:22.668146Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"232.19351ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/addons-154736\" ","response":"range_response_count:1 size:5743"}

	{"level":"info","ts":"2023-12-26T21:46:22.673597Z","caller":"traceutil/trace.go:171","msg":"trace[511291353] range","detail":"{range_begin:/registry/minions/addons-154736; range_end:; response_count:1; response_revision:378; }","duration":"237.638785ms","start":"2023-12-26T21:46:22.435901Z","end":"2023-12-26T21:46:22.673539Z","steps":["trace[511291353] 'agreement among raft nodes before linearized reading'  (duration: 36.731458ms)","trace[511291353] 'range keys from in-memory index tree'  (duration: 195.457558ms)"],"step_count":2}

	{"level":"warn","ts":"2023-12-26T21:46:22.673853Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"201.04778ms","expected-duration":"100ms","prefix":"","request":"header:<ID:8128026081072486522 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/daemonsets/kube-system/nvidia-device-plugin-daemonset\" mod_revision:363 > success:<request_put:<key:\"/registry/daemonsets/kube-system/nvidia-device-plugin-daemonset\" value_size:3174 >> failure:<request_range:<key:\"/registry/daemonsets/kube-system/nvidia-device-plugin-daemonset\" > >>","response":"size:16"}

	{"level":"info","ts":"2023-12-26T21:46:22.673947Z","caller":"traceutil/trace.go:171","msg":"trace[1935977781] linearizableReadLoop","detail":"{readStateIndex:388; appliedIndex:387; }","duration":"201.322071ms","start":"2023-12-26T21:46:22.472609Z","end":"2023-12-26T21:46:22.673932Z","steps":["trace[1935977781] 'read index received'  (duration: 419.797µs)","trace[1935977781] 'applied index is now lower than readState.Index'  (duration: 200.901019ms)"],"step_count":2}

	{"level":"info","ts":"2023-12-26T21:46:22.674917Z","caller":"traceutil/trace.go:171","msg":"trace[231094946] transaction","detail":"{read_only:false; response_revision:379; number_of_response:1; }","duration":"238.601307ms","start":"2023-12-26T21:46:22.436303Z","end":"2023-12-26T21:46:22.674904Z","steps":["trace[231094946] 'process raft request'  (duration: 36.42707ms)","trace[231094946] 'compare'  (duration: 194.925385ms)"],"step_count":2}

	{"level":"warn","ts":"2023-12-26T21:46:22.679418Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"243.401262ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/resourcequotas/local-path-storage/\" range_end:\"/registry/resourcequotas/local-path-storage0\" ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2023-12-26T21:46:22.685778Z","caller":"traceutil/trace.go:171","msg":"trace[1635112425] range","detail":"{range_begin:/registry/resourcequotas/local-path-storage/; range_end:/registry/resourcequotas/local-path-storage0; response_count:0; response_revision:379; }","duration":"249.765309ms","start":"2023-12-26T21:46:22.435992Z","end":"2023-12-26T21:46:22.685757Z","steps":["trace[1635112425] 'agreement among raft nodes before linearized reading'  (duration: 238.070382ms)"],"step_count":1}

	{"level":"warn","ts":"2023-12-26T21:46:22.687437Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"251.139407ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/limitranges/default/\" range_end:\"/registry/limitranges/default0\" ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2023-12-26T21:46:22.692198Z","caller":"traceutil/trace.go:171","msg":"trace[1516003958] range","detail":"{range_begin:/registry/limitranges/default/; range_end:/registry/limitranges/default0; response_count:0; response_revision:379; }","duration":"255.897058ms","start":"2023-12-26T21:46:22.43628Z","end":"2023-12-26T21:46:22.692177Z","steps":["trace[1516003958] 'agreement among raft nodes before linearized reading'  (duration: 237.777523ms)"],"step_count":1}

	{"level":"warn","ts":"2023-12-26T21:46:22.693456Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"257.419763ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/resourcequotas/yakd-dashboard/\" range_end:\"/registry/resourcequotas/yakd-dashboard0\" ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2023-12-26T21:46:22.737829Z","caller":"traceutil/trace.go:171","msg":"trace[1066999797] range","detail":"{range_begin:/registry/resourcequotas/yakd-dashboard/; range_end:/registry/resourcequotas/yakd-dashboard0; response_count:0; response_revision:382; }","duration":"301.7929ms","start":"2023-12-26T21:46:22.436018Z","end":"2023-12-26T21:46:22.737811Z","steps":["trace[1066999797] 'agreement among raft nodes before linearized reading'  (duration: 238.041861ms)","trace[1066999797] 'get authentication metadata'  (duration: 19.369681ms)"],"step_count":2}

	{"level":"warn","ts":"2023-12-26T21:46:22.737927Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2023-12-26T21:46:22.436015Z","time spent":"301.894427ms","remote":"127.0.0.1:36046","response type":"/etcdserverpb.KV/Range","request count":0,"request size":84,"response count":0,"response size":29,"request content":"key:\"/registry/resourcequotas/yakd-dashboard/\" range_end:\"/registry/resourcequotas/yakd-dashboard0\" "}

	{"level":"warn","ts":"2023-12-26T21:46:22.69355Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"257.58278ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/kube-system\" ","response":"range_response_count:1 size:351"}

	{"level":"info","ts":"2023-12-26T21:46:22.738143Z","caller":"traceutil/trace.go:171","msg":"trace[1020394058] range","detail":"{range_begin:/registry/namespaces/kube-system; range_end:; response_count:1; response_revision:382; }","duration":"302.170483ms","start":"2023-12-26T21:46:22.435963Z","end":"2023-12-26T21:46:22.738133Z","steps":["trace[1020394058] 'agreement among raft nodes before linearized reading'  (duration: 238.109658ms)","trace[1020394058] 'get authentication metadata'  (duration: 19.456522ms)"],"step_count":2}

	{"level":"warn","ts":"2023-12-26T21:46:22.738223Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2023-12-26T21:46:22.435959Z","time spent":"302.253221ms","remote":"127.0.0.1:36074","response type":"/etcdserverpb.KV/Range","request count":0,"request size":34,"response count":1,"response size":375,"request content":"key:\"/registry/namespaces/kube-system\" "}

	{"level":"info","ts":"2023-12-26T21:46:22.687855Z","caller":"traceutil/trace.go:171","msg":"trace[1234581384] transaction","detail":"{read_only:false; response_revision:380; number_of_response:1; }","duration":"164.055398ms","start":"2023-12-26T21:46:22.523789Z","end":"2023-12-26T21:46:22.687845Z","steps":["trace[1234581384] 'process raft request'  (duration: 162.503228ms)"],"step_count":1}

	{"level":"warn","ts":"2023-12-26T21:46:22.736988Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2023-12-26T21:46:22.436272Z","time spent":"300.69471ms","remote":"127.0.0.1:36104","response type":"/etcdserverpb.KV/Range","request count":0,"request size":64,"response count":0,"response size":29,"request content":"key:\"/registry/limitranges/default/\" range_end:\"/registry/limitranges/default0\" "}

	{"level":"info","ts":"2023-12-26T21:55:58.409445Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":1780}

	{"level":"info","ts":"2023-12-26T21:55:58.439808Z","caller":"mvcc/kvstore_compaction.go:66","msg":"finished scheduled compaction","compact-revision":1780,"took":"29.861837ms","hash":107786079}

	{"level":"info","ts":"2023-12-26T21:55:58.439863Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":107786079,"revision":1780,"compact-revision":-1}

	==> gcp-auth [426fb5db606fa75ce6945ac23ec91db80974534187f20b743958f83105dfbf01] <==

	2023/12/26 21:47:46 GCP Auth Webhook started!

	2023/12/26 21:48:13 Ready to marshal response ...

	2023/12/26 21:48:13 Ready to write response ...

	2023/12/26 21:48:13 Ready to marshal response ...

	2023/12/26 21:48:13 Ready to write response ...

	2023/12/26 21:48:13 Ready to marshal response ...

	2023/12/26 21:48:13 Ready to write response ...

	2023/12/26 21:48:24 Ready to marshal response ...

	2023/12/26 21:48:24 Ready to write response ...

	2023/12/26 21:48:30 Ready to marshal response ...

	2023/12/26 21:48:30 Ready to write response ...

	2023/12/26 21:48:30 Ready to marshal response ...

	2023/12/26 21:48:30 Ready to write response ...

	2023/12/26 21:48:39 Ready to marshal response ...

	2023/12/26 21:48:39 Ready to write response ...

	2023/12/26 21:48:44 Ready to marshal response ...

	2023/12/26 21:48:44 Ready to write response ...

	2023/12/26 21:48:59 Ready to marshal response ...

	2023/12/26 21:48:59 Ready to write response ...

	2023/12/26 21:49:19 Ready to marshal response ...

	2023/12/26 21:49:19 Ready to write response ...

	==> kernel <==

	 21:57:01 up  5:39,  0 users,  load average: 0.20, 0.55, 1.21

	Linux addons-154736 5.15.0-1051-aws #56~20.04.1-Ubuntu SMP Tue Nov 28 15:43:06 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux

	PRETTY_NAME="Ubuntu 22.04.3 LTS"

	==> kindnet [5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445] <==

	I1226 21:54:52.339188       1 main.go:227] handling current node

	I1226 21:55:02.348797       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:55:02.348825       1 main.go:227] handling current node

	I1226 21:55:12.357795       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:55:12.357824       1 main.go:227] handling current node

	I1226 21:55:22.366465       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:55:22.366844       1 main.go:227] handling current node

	I1226 21:55:32.378028       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:55:32.378056       1 main.go:227] handling current node

	I1226 21:55:42.382491       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:55:42.382523       1 main.go:227] handling current node

	I1226 21:55:52.395433       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:55:52.395472       1 main.go:227] handling current node

	I1226 21:56:02.399915       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:56:02.399945       1 main.go:227] handling current node

	I1226 21:56:12.412124       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:56:12.412153       1 main.go:227] handling current node

	I1226 21:56:22.416830       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:56:22.416857       1 main.go:227] handling current node

	I1226 21:56:32.428967       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:56:32.428997       1 main.go:227] handling current node

	I1226 21:56:42.434151       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:56:42.434189       1 main.go:227] handling current node

	I1226 21:56:52.445696       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:56:52.445731       1 main.go:227] handling current node

	==> kube-apiserver [c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8] <==

	E1226 21:47:18.183194       1 controller.go:146] Error updating APIService "v1beta1.metrics.k8s.io" with err: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable

	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]

	E1226 21:47:18.183278       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.101.226.217:443/apis/metrics.k8s.io/v1beta1: Get "https://10.101.226.217:443/apis/metrics.k8s.io/v1beta1": context deadline exceeded

	I1226 21:47:18.226035       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager

	E1226 21:47:18.235616       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.metrics.k8s.io": the object has been modified; please apply your changes to the latest version and try again

	I1226 21:47:18.249146       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager

	I1226 21:48:01.090044       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager

	I1226 21:48:13.391328       1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs={"IPv4":"10.100.241.164"}

	I1226 21:48:47.250109       1 handler.go:232] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager

	I1226 21:48:47.272806       1 handler.go:232] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager

	W1226 21:48:48.323602       1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io

	I1226 21:48:57.771535       1 controller.go:624] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io

	I1226 21:48:58.917884       1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io

	I1226 21:48:59.228975       1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.97.161.33"}

	I1226 21:49:19.227715       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Nothing (removed from the queue).

	I1226 21:51:01.378469       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1226 21:51:01.378621       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1226 21:51:01.378765       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1226 21:51:01.378829       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1226 21:51:01.378947       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1226 21:51:01.379002       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1226 21:56:01.379493       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1226 21:56:01.379564       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1226 21:56:01.380091       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1226 21:56:01.380146       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	==> kube-controller-manager [5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee] <==

	I1226 21:49:19.442102       1 event.go:307] "Event occurred" object="default/hpvc-restore" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="Waiting for a volume to be created either by the external provisioner 'hostpath.csi.k8s.io' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered."

	W1226 21:49:22.322988       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:49:22.323018       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:50:08.035478       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:50:08.035517       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:50:43.390905       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:50:43.390938       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:51:20.739347       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:51:20.739382       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:51:55.552410       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:51:55.552446       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:52:31.808159       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:52:31.808199       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:53:02.112640       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:53:02.112676       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:53:35.339875       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:53:35.339909       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:54:32.830341       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:54:32.830378       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:55:17.216364       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:55:17.216397       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:55:55.408594       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:55:55.408634       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:56:42.221032       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:56:42.221164       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	==> kube-proxy [fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d] <==

	I1226 21:46:23.640742       1 server_others.go:69] "Using iptables proxy"

	I1226 21:46:23.780851       1 node.go:141] Successfully retrieved node IP: 192.168.49.2

	I1226 21:46:23.961749       1 server.go:632] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"

	I1226 21:46:23.964285       1 server_others.go:152] "Using iptables Proxier"

	I1226 21:46:23.964388       1 server_others.go:421] "Detect-local-mode set to ClusterCIDR, but no cluster CIDR for family" ipFamily="IPv6"

	I1226 21:46:23.964453       1 server_others.go:438] "Defaulting to no-op detect-local"

	I1226 21:46:23.964548       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I1226 21:46:23.964814       1 server.go:846] "Version info" version="v1.28.4"

	I1226 21:46:23.965035       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1226 21:46:23.965823       1 config.go:188] "Starting service config controller"

	I1226 21:46:23.966279       1 shared_informer.go:311] Waiting for caches to sync for service config

	I1226 21:46:23.966348       1 config.go:97] "Starting endpoint slice config controller"

	I1226 21:46:23.966380       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I1226 21:46:23.966960       1 config.go:315] "Starting node config controller"

	I1226 21:46:23.967020       1 shared_informer.go:311] Waiting for caches to sync for node config

	I1226 21:46:24.068617       1 shared_informer.go:318] Caches are synced for node config

	I1226 21:46:24.068805       1 shared_informer.go:318] Caches are synced for service config

	I1226 21:46:24.068877       1 shared_informer.go:318] Caches are synced for endpoint slice config

	==> kube-scheduler [a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43] <==

	W1226 21:46:01.499821       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E1226 21:46:01.499861       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W1226 21:46:01.499951       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1226 21:46:01.499994       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W1226 21:46:01.500095       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1226 21:46:01.500137       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W1226 21:46:01.500229       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E1226 21:46:01.500269       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	W1226 21:46:01.500416       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E1226 21:46:01.500460       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W1226 21:46:01.500581       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1226 21:46:01.500641       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W1226 21:46:01.500744       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E1226 21:46:01.500787       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W1226 21:46:01.500885       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1226 21:46:01.500922       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W1226 21:46:01.501014       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1226 21:46:01.501056       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W1226 21:46:01.501147       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1226 21:46:01.501185       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	W1226 21:46:01.501259       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E1226 21:46:01.501297       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	W1226 21:46:02.462665       1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E1226 21:46:02.462706       1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	I1226 21:46:05.170353       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	==> kubelet <==

	Dec 26 21:56:04 addons-154736 kubelet[1365]: E1226 21:56:04.702559    1365 container_manager_linux.go:514] "Failed to find cgroups of kubelet" err="cpu and memory cgroup hierarchy not unified.  cpu: /docker/0927c77a91cb3abbb70268b3a742f5c0c803d1cbb42dd1efdc24f53bd33e9c94, memory: /docker/0927c77a91cb3abbb70268b3a742f5c0c803d1cbb42dd1efdc24f53bd33e9c94/system.slice/kubelet.service"

	Dec 26 21:56:04 addons-154736 kubelet[1365]: E1226 21:56:04.712000    1365 manager.go:1106] Failed to create existing container: /crio-e0e51a4b6edc7ce00a271701cfc3682cb172087a8a07a3eee24537d16438244d: Error finding container e0e51a4b6edc7ce00a271701cfc3682cb172087a8a07a3eee24537d16438244d: Status 404 returned error can't find the container with id e0e51a4b6edc7ce00a271701cfc3682cb172087a8a07a3eee24537d16438244d

	Dec 26 21:56:04 addons-154736 kubelet[1365]: E1226 21:56:04.712307    1365 manager.go:1106] Failed to create existing container: /docker/0927c77a91cb3abbb70268b3a742f5c0c803d1cbb42dd1efdc24f53bd33e9c94/crio-e0e51a4b6edc7ce00a271701cfc3682cb172087a8a07a3eee24537d16438244d: Error finding container e0e51a4b6edc7ce00a271701cfc3682cb172087a8a07a3eee24537d16438244d: Status 404 returned error can't find the container with id e0e51a4b6edc7ce00a271701cfc3682cb172087a8a07a3eee24537d16438244d

	Dec 26 21:56:04 addons-154736 kubelet[1365]: E1226 21:56:04.712573    1365 manager.go:1106] Failed to create existing container: /docker/0927c77a91cb3abbb70268b3a742f5c0c803d1cbb42dd1efdc24f53bd33e9c94/crio-d929e20c5935e81c71048d8651d982f22977ffc67f098b4b6530407ffeaa3f0f: Error finding container d929e20c5935e81c71048d8651d982f22977ffc67f098b4b6530407ffeaa3f0f: Status 404 returned error can't find the container with id d929e20c5935e81c71048d8651d982f22977ffc67f098b4b6530407ffeaa3f0f

	Dec 26 21:56:04 addons-154736 kubelet[1365]: E1226 21:56:04.712877    1365 manager.go:1106] Failed to create existing container: /crio-9de0ffc80a888993dda0cf8d7dfbc8404cd150a9b2fabac624d21d9e640d3e38: Error finding container 9de0ffc80a888993dda0cf8d7dfbc8404cd150a9b2fabac624d21d9e640d3e38: Status 404 returned error can't find the container with id 9de0ffc80a888993dda0cf8d7dfbc8404cd150a9b2fabac624d21d9e640d3e38

	Dec 26 21:56:04 addons-154736 kubelet[1365]: E1226 21:56:04.713105    1365 manager.go:1106] Failed to create existing container: /crio-d929e20c5935e81c71048d8651d982f22977ffc67f098b4b6530407ffeaa3f0f: Error finding container d929e20c5935e81c71048d8651d982f22977ffc67f098b4b6530407ffeaa3f0f: Status 404 returned error can't find the container with id d929e20c5935e81c71048d8651d982f22977ffc67f098b4b6530407ffeaa3f0f

	Dec 26 21:56:04 addons-154736 kubelet[1365]: E1226 21:56:04.713322    1365 manager.go:1106] Failed to create existing container: /crio-88bbfca1fd18479c52e5a80c7f33f86b611a658500dfd5677be53da7cb2a5271: Error finding container 88bbfca1fd18479c52e5a80c7f33f86b611a658500dfd5677be53da7cb2a5271: Status 404 returned error can't find the container with id 88bbfca1fd18479c52e5a80c7f33f86b611a658500dfd5677be53da7cb2a5271

	Dec 26 21:56:04 addons-154736 kubelet[1365]: E1226 21:56:04.731977    1365 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/dcc17bb60317014cee8eee7b8a545d5404ff37d371eefccd11eb56d576a69c26/diff" to get inode usage: stat /var/lib/containers/storage/overlay/dcc17bb60317014cee8eee7b8a545d5404ff37d371eefccd11eb56d576a69c26/diff: no such file or directory, extraDiskErr: <nil>

	Dec 26 21:56:12 addons-154736 kubelet[1365]: I1226 21:56:12.486473    1365 scope.go:117] "RemoveContainer" containerID="5fe6705eae1fbc89ec665967bdfcef33c4d35b3192b0d5e54fd47a92656d5772"

	Dec 26 21:56:12 addons-154736 kubelet[1365]: E1226 21:56:12.486738    1365 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"minikube-ingress-dns\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=minikube-ingress-dns pod=kube-ingress-dns-minikube_kube-system(e6c2ffcd-377b-48c7-b5ca-3ac9d28f4f89)\"" pod="kube-system/kube-ingress-dns-minikube" podUID="e6c2ffcd-377b-48c7-b5ca-3ac9d28f4f89"

	Dec 26 21:56:14 addons-154736 kubelet[1365]: E1226 21:56:14.487577    1365 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx:alpine\\\"\"" pod="default/nginx" podUID="89cc57b4-3f60-4a69-b7d3-dbc25226b9c0"

	Dec 26 21:56:27 addons-154736 kubelet[1365]: I1226 21:56:27.485893    1365 scope.go:117] "RemoveContainer" containerID="5fe6705eae1fbc89ec665967bdfcef33c4d35b3192b0d5e54fd47a92656d5772"

	Dec 26 21:56:27 addons-154736 kubelet[1365]: E1226 21:56:27.486177    1365 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"minikube-ingress-dns\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=minikube-ingress-dns pod=kube-ingress-dns-minikube_kube-system(e6c2ffcd-377b-48c7-b5ca-3ac9d28f4f89)\"" pod="kube-system/kube-ingress-dns-minikube" podUID="e6c2ffcd-377b-48c7-b5ca-3ac9d28f4f89"

	Dec 26 21:56:29 addons-154736 kubelet[1365]: E1226 21:56:29.487406    1365 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx:alpine\\\"\"" pod="default/nginx" podUID="89cc57b4-3f60-4a69-b7d3-dbc25226b9c0"

	Dec 26 21:56:41 addons-154736 kubelet[1365]: I1226 21:56:41.486682    1365 scope.go:117] "RemoveContainer" containerID="5fe6705eae1fbc89ec665967bdfcef33c4d35b3192b0d5e54fd47a92656d5772"

	Dec 26 21:56:41 addons-154736 kubelet[1365]: E1226 21:56:41.486972    1365 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"minikube-ingress-dns\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=minikube-ingress-dns pod=kube-ingress-dns-minikube_kube-system(e6c2ffcd-377b-48c7-b5ca-3ac9d28f4f89)\"" pod="kube-system/kube-ingress-dns-minikube" podUID="e6c2ffcd-377b-48c7-b5ca-3ac9d28f4f89"

	Dec 26 21:56:42 addons-154736 kubelet[1365]: E1226 21:56:42.487946    1365 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx:alpine\\\"\"" pod="default/nginx" podUID="89cc57b4-3f60-4a69-b7d3-dbc25226b9c0"

	Dec 26 21:56:42 addons-154736 kubelet[1365]: E1226 21:56:42.951400    1365 remote_image.go:180] "PullImage from image service failed" err="rpc error: code = Unknown desc = loading manifest for target platform: reading manifest sha256:73a06b3a2577448f9acc23502a0cb4d41919da9cc5035e66b0a9a09715397684 in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" image="docker.io/nginx:latest"

	Dec 26 21:56:42 addons-154736 kubelet[1365]: E1226 21:56:42.951459    1365 kuberuntime_image.go:53] "Failed to pull image" err="loading manifest for target platform: reading manifest sha256:73a06b3a2577448f9acc23502a0cb4d41919da9cc5035e66b0a9a09715397684 in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" image="docker.io/nginx:latest"

	Dec 26 21:56:42 addons-154736 kubelet[1365]: E1226 21:56:42.951565    1365 kuberuntime_manager.go:1261] container &Container{Name:task-pv-container,Image:docker.io/nginx,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:http-server,HostPort:0,ContainerPort:80,Protocol:TCP,HostIP:,},},Env:[]EnvVar{EnvVar{Name:GOOGLE_APPLICATION_CREDENTIALS,Value:/google-app-creds.json,ValueFrom:nil,},EnvVar{Name:PROJECT_ID,Value:this_is_fake,ValueFrom:nil,},EnvVar{Name:GCP_PROJECT,Value:this_is_fake,ValueFrom:nil,},EnvVar{Name:GCLOUD_PROJECT,Value:this_is_fake,ValueFrom:nil,},EnvVar{Name:GOOGLE_CLOUD_PROJECT,Value:this_is_fake,ValueFrom:nil,},EnvVar{Name:CLOUDSDK_CORE_PROJECT,Value:this_is_fake,ValueFrom:nil,},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:task-pv-storage,ReadOnly:false,MountPath:/usr/share/nginx/html,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:kube-api-access-

6gjg5,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},VolumeMount{Name:gcp-creds,ReadOnly:true,MountPath:/google-app-creds.json,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:Always,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod task-pv-pod-restore_default(207a63c3-f7e0-4270-aa76-3681a7e5658c): ErrImagePull: loading manifest for target platform: reading manifest sha256:73a06b3a2577448f9acc23502a0cb4d41919da9cc5035e66b0a9a09715397684 in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	Dec 26 21:56:42 addons-154736 kubelet[1365]: E1226 21:56:42.951607    1365 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"task-pv-container\" with ErrImagePull: \"loading manifest for target platform: reading manifest sha256:73a06b3a2577448f9acc23502a0cb4d41919da9cc5035e66b0a9a09715397684 in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit\"" pod="default/task-pv-pod-restore" podUID="207a63c3-f7e0-4270-aa76-3681a7e5658c"

	Dec 26 21:56:56 addons-154736 kubelet[1365]: I1226 21:56:56.486545    1365 scope.go:117] "RemoveContainer" containerID="5fe6705eae1fbc89ec665967bdfcef33c4d35b3192b0d5e54fd47a92656d5772"

	Dec 26 21:56:56 addons-154736 kubelet[1365]: E1226 21:56:56.486780    1365 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"minikube-ingress-dns\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=minikube-ingress-dns pod=kube-ingress-dns-minikube_kube-system(e6c2ffcd-377b-48c7-b5ca-3ac9d28f4f89)\"" pod="kube-system/kube-ingress-dns-minikube" podUID="e6c2ffcd-377b-48c7-b5ca-3ac9d28f4f89"

	Dec 26 21:56:56 addons-154736 kubelet[1365]: E1226 21:56:56.487956    1365 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx:alpine\\\"\"" pod="default/nginx" podUID="89cc57b4-3f60-4a69-b7d3-dbc25226b9c0"

	Dec 26 21:56:57 addons-154736 kubelet[1365]: E1226 21:56:57.487461    1365 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"task-pv-container\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx\\\"\"" pod="default/task-pv-pod-restore" podUID="207a63c3-f7e0-4270-aa76-3681a7e5658c"

	==> storage-provisioner [2ca195417d20cd7d770bd0d4ca4ba2c4f87c603396ace0f89dc95113a10a3c0f] <==

	I1226 21:46:53.461435       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1226 21:46:53.482276       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1226 21:46:53.482442       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1226 21:46:53.499286       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1226 21:46:53.499560       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-154736_8b77c78b-51e5-498d-bad2-c4833c8e2aec!

	I1226 21:46:53.501777       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"1f84c5a7-4067-41c5-b8c4-76d4700df79e", APIVersion:"v1", ResourceVersion:"884", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-154736_8b77c78b-51e5-498d-bad2-c4833c8e2aec became leader

	I1226 21:46:53.600700       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-154736_8b77c78b-51e5-498d-bad2-c4833c8e2aec!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-154736 -n addons-154736

helpers_test.go:261: (dbg) Run:  kubectl --context addons-154736 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: nginx task-pv-pod-restore ingress-nginx-admission-create-jtzt2 ingress-nginx-admission-patch-gwrdr

helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Ingress]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context addons-154736 describe pod nginx task-pv-pod-restore ingress-nginx-admission-create-jtzt2 ingress-nginx-admission-patch-gwrdr

helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-154736 describe pod nginx task-pv-pod-restore ingress-nginx-admission-create-jtzt2 ingress-nginx-admission-patch-gwrdr: exit status 1 (117.874829ms)

-- stdout --

	Name:             nginx

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             addons-154736/192.168.49.2

	Start Time:       Tue, 26 Dec 2023 21:48:59 +0000

	Labels:           run=nginx

	Annotations:      <none>

	Status:           Pending

	IP:               10.244.0.27

	IPs:

	  IP:  10.244.0.27

	Containers:

	  nginx:

	    Container ID:   

	    Image:          docker.io/nginx:alpine

	    Image ID:       

	    Port:           80/TCP

	    Host Port:      0/TCP

	    State:          Waiting

	      Reason:       ImagePullBackOff

	    Ready:          False

	    Restart Count:  0

	    Environment:

	      GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json

	      PROJECT_ID:                      this_is_fake

	      GCP_PROJECT:                     this_is_fake

	      GCLOUD_PROJECT:                  this_is_fake

	      GOOGLE_CLOUD_PROJECT:            this_is_fake

	      CLOUDSDK_CORE_PROJECT:           this_is_fake

	    Mounts:

	      /google-app-creds.json from gcp-creds (ro)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-mttn4 (ro)

	Conditions:

	  Type              Status

	  Initialized       True 

	  Ready             False 

	  ContainersReady   False 

	  PodScheduled      True 

	Volumes:

	  kube-api-access-mttn4:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	  gcp-creds:

	    Type:          HostPath (bare host directory volume)

	    Path:          /var/lib/minikube/google_application_credentials.json

	    HostPathType:  File

	QoS Class:         BestEffort

	Node-Selectors:    <none>

	Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                   node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason     Age                    From               Message

	  ----     ------     ----                   ----               -------

	  Normal   Scheduled  8m3s                   default-scheduler  Successfully assigned default/nginx to addons-154736

	  Warning  Failed     7m32s                  kubelet            Failed to pull image "docker.io/nginx:alpine": initializing source docker://nginx:alpine: reading manifest alpine in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Warning  Failed     4m30s                  kubelet            Failed to pull image "docker.io/nginx:alpine": loading manifest for target platform: reading manifest sha256:7913e8fa2e6a5f0160a5e6b7ea48b7d4a301c6058d63c3d632a35a59093cb4eb in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Normal   Pulling    3m40s (x4 over 8m3s)   kubelet            Pulling image "docker.io/nginx:alpine"

	  Warning  Failed     3m10s (x4 over 7m32s)  kubelet            Error: ErrImagePull

	  Warning  Failed     3m10s (x2 over 6m2s)   kubelet            Failed to pull image "docker.io/nginx:alpine": reading manifest alpine in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Normal   BackOff    2m45s (x7 over 7m32s)  kubelet            Back-off pulling image "docker.io/nginx:alpine"

	  Warning  Failed     2m45s (x7 over 7m32s)  kubelet            Error: ImagePullBackOff

	Name:             task-pv-pod-restore

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             addons-154736/192.168.49.2

	Start Time:       Tue, 26 Dec 2023 21:49:19 +0000

	Labels:           app=task-pv-pod-restore

	Annotations:      <none>

	Status:           Pending

	IP:               10.244.0.28

	IPs:

	  IP:  10.244.0.28

	Containers:

	  task-pv-container:

	    Container ID:   

	    Image:          docker.io/nginx

	    Image ID:       

	    Port:           80/TCP

	    Host Port:      0/TCP

	    State:          Waiting

	      Reason:       ErrImagePull

	    Ready:          False

	    Restart Count:  0

	    Environment:

	      GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json

	      PROJECT_ID:                      this_is_fake

	      GCP_PROJECT:                     this_is_fake

	      GCLOUD_PROJECT:                  this_is_fake

	      GOOGLE_CLOUD_PROJECT:            this_is_fake

	      CLOUDSDK_CORE_PROJECT:           this_is_fake

	    Mounts:

	      /google-app-creds.json from gcp-creds (ro)

	      /usr/share/nginx/html from task-pv-storage (rw)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-6gjg5 (ro)

	Conditions:

	  Type              Status

	  Initialized       True 

	  Ready             False 

	  ContainersReady   False 

	  PodScheduled      True 

	Volumes:

	  task-pv-storage:

	    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)

	    ClaimName:  hpvc-restore

	    ReadOnly:   false

	  kube-api-access-6gjg5:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	  gcp-creds:

	    Type:          HostPath (bare host directory volume)

	    Path:          /var/lib/minikube/google_application_credentials.json

	    HostPathType:  File

	QoS Class:         BestEffort

	Node-Selectors:    <none>

	Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                   node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason     Age                    From               Message

	  ----     ------     ----                   ----               -------

	  Normal   Scheduled  7m43s                  default-scheduler  Successfully assigned default/task-pv-pod-restore to addons-154736

	  Warning  Failed     4m (x2 over 5m31s)     kubelet            Failed to pull image "docker.io/nginx": reading manifest latest in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Normal   Pulling    3m19s (x4 over 7m42s)  kubelet            Pulling image "docker.io/nginx"

	  Warning  Failed     2m25s (x2 over 6m32s)  kubelet            Failed to pull image "docker.io/nginx": loading manifest for target platform: reading manifest sha256:73a06b3a2577448f9acc23502a0cb4d41919da9cc5035e66b0a9a09715397684 in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Warning  Failed     2m25s (x4 over 6m32s)  kubelet            Error: ErrImagePull

	  Normal   BackOff    105s (x7 over 6m32s)   kubelet            Back-off pulling image "docker.io/nginx"

	  Warning  Failed     105s (x7 over 6m32s)   kubelet            Error: ImagePullBackOff

-- /stdout --

** stderr ** 

	Error from server (NotFound): pods "ingress-nginx-admission-create-jtzt2" not found

	Error from server (NotFound): pods "ingress-nginx-admission-patch-gwrdr" not found

** /stderr **

helpers_test.go:279: kubectl --context addons-154736 describe pod nginx task-pv-pod-restore ingress-nginx-admission-create-jtzt2 ingress-nginx-admission-patch-gwrdr: exit status 1

--- FAIL: TestAddons/parallel/Ingress (484.42s)

=== RUN   TestAddons/parallel/CSI

=== PAUSE TestAddons/parallel/CSI

=== CONT  TestAddons/parallel/CSI

addons_test.go:561: csi-hostpath-driver pods stabilized in 13.876768ms

addons_test.go:564: (dbg) Run:  kubectl --context addons-154736 create -f testdata/csi-hostpath-driver/pvc.yaml

addons_test.go:569: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc -o jsonpath={.status.phase} -n default

addons_test.go:574: (dbg) Run:  kubectl --context addons-154736 create -f testdata/csi-hostpath-driver/pv-pod.yaml

addons_test.go:579: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...

helpers_test.go:344: "task-pv-pod" [5242d5bf-535d-44a6-a04e-c85d958aa248] Pending

helpers_test.go:344: "task-pv-pod" [5242d5bf-535d-44a6-a04e-c85d958aa248] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])

helpers_test.go:344: "task-pv-pod" [5242d5bf-535d-44a6-a04e-c85d958aa248] Running

addons_test.go:579: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 13.003333568s

addons_test.go:584: (dbg) Run:  kubectl --context addons-154736 create -f testdata/csi-hostpath-driver/snapshot.yaml

addons_test.go:589: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...

helpers_test.go:419: (dbg) Run:  kubectl --context addons-154736 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default

helpers_test.go:419: (dbg) Run:  kubectl --context addons-154736 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default

addons_test.go:594: (dbg) Run:  kubectl --context addons-154736 delete pod task-pv-pod

addons_test.go:600: (dbg) Run:  kubectl --context addons-154736 delete pvc hpvc

addons_test.go:606: (dbg) Run:  kubectl --context addons-154736 create -f testdata/csi-hostpath-driver/pvc-restore.yaml

addons_test.go:611: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

helpers_test.go:394: (dbg) Run:  kubectl --context addons-154736 get pvc hpvc-restore -o jsonpath={.status.phase} -n default

addons_test.go:616: (dbg) Run:  kubectl --context addons-154736 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml

addons_test.go:621: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...

helpers_test.go:344: "task-pv-pod-restore" [207a63c3-f7e0-4270-aa76-3681a7e5658c] Pending

helpers_test.go:344: "task-pv-pod-restore" [207a63c3-f7e0-4270-aa76-3681a7e5658c] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])

helpers_test.go:329: TestAddons/parallel/CSI: WARNING: pod list for "default" "app=task-pv-pod-restore" returned: client rate limiter Wait returned an error: context deadline exceeded

addons_test.go:621: ***** TestAddons/parallel/CSI: pod "app=task-pv-pod-restore" failed to start within 6m0s: context deadline exceeded ****

addons_test.go:621: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-154736 -n addons-154736

addons_test.go:621: TestAddons/parallel/CSI: showing logs for failed pods as of 2023-12-26 21:55:20.127985879 +0000 UTC m=+640.780960734

addons_test.go:621: (dbg) Run:  kubectl --context addons-154736 describe po task-pv-pod-restore -n default

addons_test.go:621: (dbg) kubectl --context addons-154736 describe po task-pv-pod-restore -n default:

Name:             task-pv-pod-restore

Namespace:        default

Priority:         0

Service Account:  default

Node:             addons-154736/192.168.49.2

Start Time:       Tue, 26 Dec 2023 21:49:19 +0000

Labels:           app=task-pv-pod-restore

Annotations:      <none>

Status:           Pending

IP:               10.244.0.28

IPs:

IP:  10.244.0.28

Containers:

task-pv-container:

Container ID:   

Image:          docker.io/nginx

Image ID:       

Port:           80/TCP

Host Port:      0/TCP

State:          Waiting

Reason:       ImagePullBackOff

Ready:          False

Restart Count:  0

Environment:

GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json

PROJECT_ID:                      this_is_fake

GCP_PROJECT:                     this_is_fake

GCLOUD_PROJECT:                  this_is_fake

GOOGLE_CLOUD_PROJECT:            this_is_fake

CLOUDSDK_CORE_PROJECT:           this_is_fake

Mounts:

/google-app-creds.json from gcp-creds (ro)

/usr/share/nginx/html from task-pv-storage (rw)

/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-6gjg5 (ro)

Conditions:

Type              Status

Initialized       True 

Ready             False 

ContainersReady   False 

PodScheduled      True 

Volumes:

task-pv-storage:

Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)

ClaimName:  hpvc-restore

ReadOnly:   false

kube-api-access-6gjg5:

Type:                    Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds:  3607

ConfigMapName:           kube-root-ca.crt

ConfigMapOptional:       <nil>

DownwardAPI:             true

gcp-creds:

Type:          HostPath (bare host directory volume)

Path:          /var/lib/minikube/google_application_credentials.json

HostPathType:  File

QoS Class:         BestEffort

Node-Selectors:    <none>

Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

Events:

Type     Reason     Age                    From               Message

----     ------     ----                   ----               -------

Normal   Scheduled  6m1s                   default-scheduler  Successfully assigned default/task-pv-pod-restore to addons-154736

Warning  Failed     2m18s (x2 over 3m49s)  kubelet            Failed to pull image "docker.io/nginx": reading manifest latest in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

Normal   Pulling    97s (x4 over 6m)       kubelet            Pulling image "docker.io/nginx"

Warning  Failed     43s (x2 over 4m50s)    kubelet            Failed to pull image "docker.io/nginx": loading manifest for target platform: reading manifest sha256:73a06b3a2577448f9acc23502a0cb4d41919da9cc5035e66b0a9a09715397684 in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

Warning  Failed     43s (x4 over 4m50s)    kubelet            Error: ErrImagePull

Normal   BackOff    3s (x7 over 4m50s)     kubelet            Back-off pulling image "docker.io/nginx"

Warning  Failed     3s (x7 over 4m50s)     kubelet            Error: ImagePullBackOff

addons_test.go:621: (dbg) Run:  kubectl --context addons-154736 logs task-pv-pod-restore -n default

addons_test.go:621: (dbg) Non-zero exit: kubectl --context addons-154736 logs task-pv-pod-restore -n default: exit status 1 (115.810582ms)

** stderr ** 

	Error from server (BadRequest): container "task-pv-container" in pod "task-pv-pod-restore" is waiting to start: trying and failing to pull image

** /stderr **

addons_test.go:621: kubectl --context addons-154736 logs task-pv-pod-restore -n default: exit status 1

addons_test.go:622: failed waiting for pod task-pv-pod-restore: app=task-pv-pod-restore within 6m0s: context deadline exceeded

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestAddons/parallel/CSI]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect addons-154736

helpers_test.go:235: (dbg) docker inspect addons-154736:

-- stdout --

	[

	    {

	        "Id": "0927c77a91cb3abbb70268b3a742f5c0c803d1cbb42dd1efdc24f53bd33e9c94",

	        "Created": "2023-12-26T21:45:41.806387804Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 704120,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2023-12-26T21:45:42.123091502Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:3bfff26a1ae256fcdf8f10a333efdefbe26edc5c1669e1cc5c973c016e44d3c4",

	        "ResolvConfPath": "/var/lib/docker/containers/0927c77a91cb3abbb70268b3a742f5c0c803d1cbb42dd1efdc24f53bd33e9c94/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/0927c77a91cb3abbb70268b3a742f5c0c803d1cbb42dd1efdc24f53bd33e9c94/hostname",

	        "HostsPath": "/var/lib/docker/containers/0927c77a91cb3abbb70268b3a742f5c0c803d1cbb42dd1efdc24f53bd33e9c94/hosts",

	        "LogPath": "/var/lib/docker/containers/0927c77a91cb3abbb70268b3a742f5c0c803d1cbb42dd1efdc24f53bd33e9c94/0927c77a91cb3abbb70268b3a742f5c0c803d1cbb42dd1efdc24f53bd33e9c94-json.log",

	        "Name": "/addons-154736",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "unconfined",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "addons-154736:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "addons-154736",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 4194304000,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": [],

	            "BlkioDeviceWriteBps": [],

	            "BlkioDeviceReadIOps": [],

	            "BlkioDeviceWriteIOps": [],

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "MemoryReservation": 0,

	            "MemorySwap": 8388608000,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/c0eaaf8543365e6297970bf5096d74b7af77ea75fc0bb6e681d7f593d9e01e51-init/diff:/var/lib/docker/overlay2/45396a29879cab7c8a67d68e40c59b67c1c0ba964e9ed87a152af8cc5862c477/diff",

	                "MergedDir": "/var/lib/docker/overlay2/c0eaaf8543365e6297970bf5096d74b7af77ea75fc0bb6e681d7f593d9e01e51/merged",

	                "UpperDir": "/var/lib/docker/overlay2/c0eaaf8543365e6297970bf5096d74b7af77ea75fc0bb6e681d7f593d9e01e51/diff",

	                "WorkDir": "/var/lib/docker/overlay2/c0eaaf8543365e6297970bf5096d74b7af77ea75fc0bb6e681d7f593d9e01e51/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            },

	            {

	                "Type": "volume",

	                "Name": "addons-154736",

	                "Source": "/var/lib/docker/volumes/addons-154736/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            }

	        ],

	        "Config": {

	            "Hostname": "addons-154736",

	            "Domainname": "",

	            "User": "",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8443/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c",

	            "Volumes": null,

	            "WorkingDir": "/",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "addons-154736",

	                "name.minikube.sigs.k8s.io": "addons-154736",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "2c290e95bcf18514e9253c173e0261fcd2cebaf9efe8ca6024d46b1bc1ba866a",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33671"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33670"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33667"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33669"

	                    }

	                ],

	                "8443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33668"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/2c290e95bcf1",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "addons-154736": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "0927c77a91cb",

	                        "addons-154736"

	                    ],

	                    "NetworkID": "0ce741a8f930f44069a6bdf9f4ed33b0b28aabc7b6040abdd1f84433f7a93e9c",

	                    "EndpointID": "0c120efe77a5545a5dd5f788310b2f79bca21a0517ac182d7e7a20aa1f26e532",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p addons-154736 -n addons-154736

helpers_test.go:244: <<< TestAddons/parallel/CSI FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/CSI]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p addons-154736 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p addons-154736 logs -n 25: (1.677931878s)

helpers_test.go:252: TestAddons/parallel/CSI logs: 

-- stdout --

	==> Audit <==

	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|

	| Command |                                            Args                                             |        Profile         |  User   | Version |     Start Time      |      End Time       |

	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|

	| start   | -o=json --download-only                                                                     | download-only-988176   | jenkins | v1.32.0 | 26 Dec 23 21:44 UTC |                     |

	|         | -p download-only-988176                                                                     |                        |         |         |                     |                     |

	|         | --force --alsologtostderr                                                                   |                        |         |         |                     |                     |

	|         | --kubernetes-version=v1.16.0                                                                |                        |         |         |                     |                     |

	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |

	|         | --driver=docker                                                                             |                        |         |         |                     |                     |

	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |

	| start   | -o=json --download-only                                                                     | download-only-988176   | jenkins | v1.32.0 | 26 Dec 23 21:44 UTC |                     |

	|         | -p download-only-988176                                                                     |                        |         |         |                     |                     |

	|         | --force --alsologtostderr                                                                   |                        |         |         |                     |                     |

	|         | --kubernetes-version=v1.28.4                                                                |                        |         |         |                     |                     |

	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |

	|         | --driver=docker                                                                             |                        |         |         |                     |                     |

	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |

	| start   | -o=json --download-only                                                                     | download-only-988176   | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC |                     |

	|         | -p download-only-988176                                                                     |                        |         |         |                     |                     |

	|         | --force --alsologtostderr                                                                   |                        |         |         |                     |                     |

	|         | --kubernetes-version=v1.29.0-rc.2                                                           |                        |         |         |                     |                     |

	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |

	|         | --driver=docker                                                                             |                        |         |         |                     |                     |

	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |

	| delete  | --all                                                                                       | minikube               | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC | 26 Dec 23 21:45 UTC |

	| delete  | -p download-only-988176                                                                     | download-only-988176   | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC | 26 Dec 23 21:45 UTC |

	| delete  | -p download-only-988176                                                                     | download-only-988176   | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC | 26 Dec 23 21:45 UTC |

	| start   | --download-only -p                                                                          | download-docker-374836 | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC |                     |

	|         | download-docker-374836                                                                      |                        |         |         |                     |                     |

	|         | --alsologtostderr                                                                           |                        |         |         |                     |                     |

	|         | --driver=docker                                                                             |                        |         |         |                     |                     |

	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |

	| delete  | -p download-docker-374836                                                                   | download-docker-374836 | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC | 26 Dec 23 21:45 UTC |

	| start   | --download-only -p                                                                          | binary-mirror-438777   | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC |                     |

	|         | binary-mirror-438777                                                                        |                        |         |         |                     |                     |

	|         | --alsologtostderr                                                                           |                        |         |         |                     |                     |

	|         | --binary-mirror                                                                             |                        |         |         |                     |                     |

	|         | http://127.0.0.1:45525                                                                      |                        |         |         |                     |                     |

	|         | --driver=docker                                                                             |                        |         |         |                     |                     |

	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |

	| delete  | -p binary-mirror-438777                                                                     | binary-mirror-438777   | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC | 26 Dec 23 21:45 UTC |

	| addons  | enable dashboard -p                                                                         | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC |                     |

	|         | addons-154736                                                                               |                        |         |         |                     |                     |

	| addons  | disable dashboard -p                                                                        | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC |                     |

	|         | addons-154736                                                                               |                        |         |         |                     |                     |

	| start   | -p addons-154736 --wait=true                                                                | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:45 UTC | 26 Dec 23 21:48 UTC |

	|         | --memory=4000 --alsologtostderr                                                             |                        |         |         |                     |                     |

	|         | --addons=registry                                                                           |                        |         |         |                     |                     |

	|         | --addons=metrics-server                                                                     |                        |         |         |                     |                     |

	|         | --addons=volumesnapshots                                                                    |                        |         |         |                     |                     |

	|         | --addons=csi-hostpath-driver                                                                |                        |         |         |                     |                     |

	|         | --addons=gcp-auth                                                                           |                        |         |         |                     |                     |

	|         | --addons=cloud-spanner                                                                      |                        |         |         |                     |                     |

	|         | --addons=inspektor-gadget                                                                   |                        |         |         |                     |                     |

	|         | --addons=storage-provisioner-rancher                                                        |                        |         |         |                     |                     |

	|         | --addons=nvidia-device-plugin                                                               |                        |         |         |                     |                     |

	|         | --addons=yakd --driver=docker                                                               |                        |         |         |                     |                     |

	|         |  --container-runtime=crio                                                                   |                        |         |         |                     |                     |

	|         | --addons=ingress                                                                            |                        |         |         |                     |                     |

	|         | --addons=ingress-dns                                                                        |                        |         |         |                     |                     |

	| addons  | enable headlamp                                                                             | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:48 UTC | 26 Dec 23 21:48 UTC |

	|         | -p addons-154736                                                                            |                        |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |

	| ip      | addons-154736 ip                                                                            | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:48 UTC | 26 Dec 23 21:48 UTC |

	| addons  | addons-154736 addons disable                                                                | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:48 UTC | 26 Dec 23 21:48 UTC |

	|         | registry --alsologtostderr                                                                  |                        |         |         |                     |                     |

	|         | -v=1                                                                                        |                        |         |         |                     |                     |

	| addons  | disable nvidia-device-plugin                                                                | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:48 UTC | 26 Dec 23 21:48 UTC |

	|         | -p addons-154736                                                                            |                        |         |         |                     |                     |

	| ssh     | addons-154736 ssh cat                                                                       | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:48 UTC | 26 Dec 23 21:48 UTC |

	|         | /opt/local-path-provisioner/pvc-e94447a0-cc9f-4ee2-b024-1e95c001aae0_default_test-pvc/file1 |                        |         |         |                     |                     |

	| addons  | addons-154736 addons disable                                                                | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:48 UTC | 26 Dec 23 21:48 UTC |

	|         | storage-provisioner-rancher                                                                 |                        |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |

	| addons  | disable cloud-spanner -p                                                                    | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:48 UTC | 26 Dec 23 21:48 UTC |

	|         | addons-154736                                                                               |                        |         |         |                     |                     |

	| addons  | disable inspektor-gadget -p                                                                 | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:48 UTC | 26 Dec 23 21:48 UTC |

	|         | addons-154736                                                                               |                        |         |         |                     |                     |

	| addons  | addons-154736 addons                                                                        | addons-154736          | jenkins | v1.32.0 | 26 Dec 23 21:48 UTC | 26 Dec 23 21:48 UTC |

	|         | disable metrics-server                                                                      |                        |         |         |                     |                     |

	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |

	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2023/12/26 21:45:17

	Running on machine: ip-172-31-21-244

	Binary: Built with gc go1.21.5 for linux/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1226 21:45:17.357121  703653 out.go:296] Setting OutFile to fd 1 ...

	I1226 21:45:17.357260  703653 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 21:45:17.357268  703653 out.go:309] Setting ErrFile to fd 2...

	I1226 21:45:17.357273  703653 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 21:45:17.357532  703653 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17857-697646/.minikube/bin

	I1226 21:45:17.358030  703653 out.go:303] Setting JSON to false

	I1226 21:45:17.358813  703653 start.go:128] hostinfo: {"hostname":"ip-172-31-21-244","uptime":19651,"bootTime":1703607466,"procs":144,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}

	I1226 21:45:17.358889  703653 start.go:138] virtualization:  

	I1226 21:45:17.361650  703653 out.go:177] * [addons-154736] minikube v1.32.0 on Ubuntu 20.04 (arm64)

	I1226 21:45:17.364230  703653 out.go:177]   - MINIKUBE_LOCATION=17857

	I1226 21:45:17.365978  703653 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1226 21:45:17.364366  703653 notify.go:220] Checking for updates...

	I1226 21:45:17.369777  703653 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17857-697646/kubeconfig

	I1226 21:45:17.371642  703653 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17857-697646/.minikube

	I1226 21:45:17.373457  703653 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64

	I1226 21:45:17.375253  703653 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1226 21:45:17.377723  703653 driver.go:392] Setting default libvirt URI to qemu:///system

	I1226 21:45:17.401923  703653 docker.go:122] docker version: linux-24.0.7:Docker Engine - Community

	I1226 21:45:17.402036  703653 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1226 21:45:17.480034  703653 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-12-26 21:45:17.470030553 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1051-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi

tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dd1e886e55dd695541fdcd67420c2888645a495 Expected:3dd1e886e55dd695541fdcd67420c2888645a495} RuncCommit:{ID:v1.1.10-0-g18a0cb0 Expected:v1.1.10-0-g18a0cb0} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>

ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}

	I1226 21:45:17.480160  703653 docker.go:295] overlay module found

	I1226 21:45:17.482441  703653 out.go:177] * Using the docker driver based on user configuration

	I1226 21:45:17.484480  703653 start.go:298] selected driver: docker

	I1226 21:45:17.484501  703653 start.go:902] validating driver "docker" against <nil>

	I1226 21:45:17.484556  703653 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1226 21:45:17.485187  703653 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1226 21:45:17.559712  703653 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:28 OomKillDisable:true NGoroutines:38 SystemTime:2023-12-26 21:45:17.550602015 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1051-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi

tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dd1e886e55dd695541fdcd67420c2888645a495 Expected:3dd1e886e55dd695541fdcd67420c2888645a495} RuncCommit:{ID:v1.1.10-0-g18a0cb0 Expected:v1.1.10-0-g18a0cb0} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>

ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}

	I1226 21:45:17.559868  703653 start_flags.go:309] no existing cluster config was found, will generate one from the flags 

	I1226 21:45:17.560121  703653 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1226 21:45:17.562089  703653 out.go:177] * Using Docker driver with root privileges

	I1226 21:45:17.564061  703653 cni.go:84] Creating CNI manager for ""

	I1226 21:45:17.564086  703653 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet

	I1226 21:45:17.564098  703653 start_flags.go:318] Found "CNI" CNI - setting NetworkPlugin=cni

	I1226 21:45:17.564115  703653 start_flags.go:323] config:

	{Name:addons-154736 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:addons-154736 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI

Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}

	I1226 21:45:17.566567  703653 out.go:177] * Starting control plane node addons-154736 in cluster addons-154736

	I1226 21:45:17.568294  703653 cache.go:121] Beginning downloading kic base image for docker with crio

	I1226 21:45:17.570474  703653 out.go:177] * Pulling base image v0.0.42-1703498848-17857 ...

	I1226 21:45:17.572562  703653 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio

	I1226 21:45:17.572616  703653 preload.go:148] Found local preload: /home/jenkins/minikube-integration/17857-697646/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-arm64.tar.lz4

	I1226 21:45:17.572637  703653 cache.go:56] Caching tarball of preloaded images

	I1226 21:45:17.572720  703653 preload.go:174] Found /home/jenkins/minikube-integration/17857-697646/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-arm64.tar.lz4 in cache, skipping download

	I1226 21:45:17.572729  703653 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on crio

	I1226 21:45:17.573075  703653 profile.go:148] Saving config to /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/config.json ...

	I1226 21:45:17.573094  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/config.json: {Name:mk543582001de673a7ac0933815d446a06676405 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:17.573254  703653 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local docker daemon

	I1226 21:45:17.589840  703653 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c to local cache

	I1226 21:45:17.589980  703653 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local cache directory

	I1226 21:45:17.590005  703653 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local cache directory, skipping pull

	I1226 21:45:17.590014  703653 image.go:105] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c exists in cache, skipping pull

	I1226 21:45:17.590022  703653 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c as a tarball

	I1226 21:45:17.590027  703653 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c from local cache

	I1226 21:45:33.563146  703653 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c from cached tarball

	I1226 21:45:33.563189  703653 cache.go:194] Successfully downloaded all kic artifacts

	I1226 21:45:33.563259  703653 start.go:365] acquiring machines lock for addons-154736: {Name:mk2d6ec3bfe0e7c6048525ebd8a1df5b118807f9 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1226 21:45:33.563390  703653 start.go:369] acquired machines lock for "addons-154736" in 102.562µs

	I1226 21:45:33.563421  703653 start.go:93] Provisioning new machine with config: &{Name:addons-154736 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:addons-154736 Namespace:default APIServerName:minikubeCA A

PIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disabl

eMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1226 21:45:33.563501  703653 start.go:125] createHost starting for "" (driver="docker")

	I1226 21:45:33.565694  703653 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...

	I1226 21:45:33.565980  703653 start.go:159] libmachine.API.Create for "addons-154736" (driver="docker")

	I1226 21:45:33.566014  703653 client.go:168] LocalClient.Create starting

	I1226 21:45:33.566134  703653 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca.pem

	I1226 21:45:34.659916  703653 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/cert.pem

	I1226 21:45:35.203057  703653 cli_runner.go:164] Run: docker network inspect addons-154736 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	W1226 21:45:35.223431  703653 cli_runner.go:211] docker network inspect addons-154736 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1

	I1226 21:45:35.223524  703653 network_create.go:281] running [docker network inspect addons-154736] to gather additional debugging logs...

	I1226 21:45:35.223560  703653 cli_runner.go:164] Run: docker network inspect addons-154736

	W1226 21:45:35.241707  703653 cli_runner.go:211] docker network inspect addons-154736 returned with exit code 1

	I1226 21:45:35.241741  703653 network_create.go:284] error running [docker network inspect addons-154736]: docker network inspect addons-154736: exit status 1

	stdout:

	[]

	stderr:

	Error response from daemon: network addons-154736 not found

	I1226 21:45:35.241753  703653 network_create.go:286] output of [docker network inspect addons-154736]: -- stdout --

	[]

	-- /stdout --

	** stderr ** 

	Error response from daemon: network addons-154736 not found

	** /stderr **

	I1226 21:45:35.241866  703653 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 21:45:35.259937  703653 network.go:209] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0x40024e5ac0}

	I1226 21:45:35.259975  703653 network_create.go:124] attempt to create docker network addons-154736 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...

	I1226 21:45:35.260042  703653 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-154736 addons-154736

	I1226 21:45:35.335366  703653 network_create.go:108] docker network addons-154736 192.168.49.0/24 created

	I1226 21:45:35.335400  703653 kic.go:121] calculated static IP "192.168.49.2" for the "addons-154736" container

	I1226 21:45:35.335480  703653 cli_runner.go:164] Run: docker ps -a --format {{.Names}}

	I1226 21:45:35.352573  703653 cli_runner.go:164] Run: docker volume create addons-154736 --label name.minikube.sigs.k8s.io=addons-154736 --label created_by.minikube.sigs.k8s.io=true

	I1226 21:45:35.370827  703653 oci.go:103] Successfully created a docker volume addons-154736

	I1226 21:45:35.370918  703653 cli_runner.go:164] Run: docker run --rm --name addons-154736-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-154736 --entrypoint /usr/bin/test -v addons-154736:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -d /var/lib

	I1226 21:45:37.529102  703653 cli_runner.go:217] Completed: docker run --rm --name addons-154736-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-154736 --entrypoint /usr/bin/test -v addons-154736:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -d /var/lib: (2.158128411s)

	I1226 21:45:37.529133  703653 oci.go:107] Successfully prepared a docker volume addons-154736

	I1226 21:45:37.529167  703653 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio

	I1226 21:45:37.529191  703653 kic.go:194] Starting extracting preloaded images to volume ...

	I1226 21:45:37.529267  703653 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17857-697646/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v addons-154736:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -I lz4 -xf /preloaded.tar -C /extractDir

	I1226 21:45:41.723596  703653 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/17857-697646/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-arm64.tar.lz4:/preloaded.tar:ro -v addons-154736:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c -I lz4 -xf /preloaded.tar -C /extractDir: (4.194288032s)

	I1226 21:45:41.723631  703653 kic.go:203] duration metric: took 4.194436 seconds to extract preloaded images to volume

	W1226 21:45:41.723767  703653 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.

	I1226 21:45:41.723910  703653 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"

	I1226 21:45:41.790451  703653 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-154736 --name addons-154736 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-154736 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-154736 --network addons-154736 --ip 192.168.49.2 --volume addons-154736:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c

	I1226 21:45:42.139875  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Running}}

	I1226 21:45:42.180243  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:45:42.207149  703653 cli_runner.go:164] Run: docker exec addons-154736 stat /var/lib/dpkg/alternatives/iptables

	I1226 21:45:42.298703  703653 oci.go:144] the created container "addons-154736" has a running status.

	I1226 21:45:42.298732  703653 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa...

	I1226 21:45:43.584121  703653 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)

	I1226 21:45:43.607127  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:45:43.625334  703653 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys

	I1226 21:45:43.625358  703653 kic_runner.go:114] Args: [docker exec --privileged addons-154736 chown docker:docker /home/docker/.ssh/authorized_keys]

	I1226 21:45:43.682322  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:45:43.701947  703653 machine.go:88] provisioning docker machine ...

	I1226 21:45:43.701980  703653 ubuntu.go:169] provisioning hostname "addons-154736"

	I1226 21:45:43.702051  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:45:43.727271  703653 main.go:141] libmachine: Using SSH client type: native

	I1226 21:45:43.727709  703653 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3beb50] 0x3c12c0 <nil>  [] 0s} 127.0.0.1 33671 <nil> <nil>}

	I1226 21:45:43.727730  703653 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-154736 && echo "addons-154736" | sudo tee /etc/hostname

	I1226 21:45:43.887415  703653 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-154736

	I1226 21:45:43.887494  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:45:43.907302  703653 main.go:141] libmachine: Using SSH client type: native

	I1226 21:45:43.907710  703653 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3beb50] 0x3c12c0 <nil>  [] 0s} 127.0.0.1 33671 <nil> <nil>}

	I1226 21:45:43.907728  703653 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-154736' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-154736/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-154736' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1226 21:45:44.045974  703653 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1226 21:45:44.046002  703653 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17857-697646/.minikube CaCertPath:/home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17857-697646/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17857-697646/.minikube}

	I1226 21:45:44.046068  703653 ubuntu.go:177] setting up certificates

	I1226 21:45:44.046078  703653 provision.go:83] configureAuth start

	I1226 21:45:44.046159  703653 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-154736

	I1226 21:45:44.065356  703653 provision.go:138] copyHostCerts

	I1226 21:45:44.065455  703653 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17857-697646/.minikube/ca.pem (1082 bytes)

	I1226 21:45:44.065605  703653 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17857-697646/.minikube/cert.pem (1123 bytes)

	I1226 21:45:44.065670  703653 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17857-697646/.minikube/key.pem (1679 bytes)

	I1226 21:45:44.065751  703653 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17857-697646/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca-key.pem org=jenkins.addons-154736 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube addons-154736]

	I1226 21:45:44.682633  703653 provision.go:172] copyRemoteCerts

	I1226 21:45:44.682703  703653 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1226 21:45:44.682742  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:45:44.700544  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:45:44.799116  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)

	I1226 21:45:44.827540  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1226 21:45:44.855809  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1226 21:45:44.884433  703653 provision.go:86] duration metric: configureAuth took 838.312591ms

	I1226 21:45:44.884503  703653 ubuntu.go:193] setting minikube options for container-runtime

	I1226 21:45:44.884750  703653 config.go:182] Loaded profile config "addons-154736": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4

	I1226 21:45:44.884864  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:45:44.902598  703653 main.go:141] libmachine: Using SSH client type: native

	I1226 21:45:44.903006  703653 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3beb50] 0x3c12c0 <nil>  [] 0s} 127.0.0.1 33671 <nil> <nil>}

	I1226 21:45:44.903028  703653 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I1226 21:45:45.207361  703653 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I1226 21:45:45.207438  703653 machine.go:91] provisioned docker machine in 1.505466578s

	I1226 21:45:45.207468  703653 client.go:171] LocalClient.Create took 11.641443787s

	I1226 21:45:45.207516  703653 start.go:167] duration metric: libmachine.API.Create for "addons-154736" took 11.641516072s

	I1226 21:45:45.207545  703653 start.go:300] post-start starting for "addons-154736" (driver="docker")

	I1226 21:45:45.207576  703653 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1226 21:45:45.207691  703653 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1226 21:45:45.207766  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:45:45.239347  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:45:45.349897  703653 ssh_runner.go:195] Run: cat /etc/os-release

	I1226 21:45:45.355640  703653 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1226 21:45:45.355681  703653 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1226 21:45:45.355694  703653 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1226 21:45:45.355701  703653 info.go:137] Remote host: Ubuntu 22.04.3 LTS

	I1226 21:45:45.355711  703653 filesync.go:126] Scanning /home/jenkins/minikube-integration/17857-697646/.minikube/addons for local assets ...

	I1226 21:45:45.355790  703653 filesync.go:126] Scanning /home/jenkins/minikube-integration/17857-697646/.minikube/files for local assets ...

	I1226 21:45:45.355834  703653 start.go:303] post-start completed in 148.256524ms

	I1226 21:45:45.356161  703653 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-154736

	I1226 21:45:45.377553  703653 profile.go:148] Saving config to /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/config.json ...

	I1226 21:45:45.377843  703653 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 21:45:45.377893  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:45:45.397872  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:45:45.494484  703653 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 21:45:45.500291  703653 start.go:128] duration metric: createHost completed in 11.93677223s

	I1226 21:45:45.500316  703653 start.go:83] releasing machines lock for "addons-154736", held for 11.93691191s

	I1226 21:45:45.500400  703653 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-154736

	I1226 21:45:45.518617  703653 ssh_runner.go:195] Run: cat /version.json

	I1226 21:45:45.518632  703653 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1226 21:45:45.518672  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:45:45.518688  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:45:45.540730  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:45:45.541414  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:45:45.773361  703653 ssh_runner.go:195] Run: systemctl --version

	I1226 21:45:45.779480  703653 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I1226 21:45:45.928374  703653 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I1226 21:45:45.934285  703653 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1226 21:45:45.960009  703653 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found

	I1226 21:45:45.960108  703653 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1226 21:45:46.007940  703653 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)

	I1226 21:45:46.008022  703653 start.go:475] detecting cgroup driver to use...

	I1226 21:45:46.008095  703653 detect.go:196] detected "cgroupfs" cgroup driver on host os

	I1226 21:45:46.008197  703653 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1226 21:45:46.027491  703653 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1226 21:45:46.041920  703653 docker.go:203] disabling cri-docker service (if available) ...

	I1226 21:45:46.042015  703653 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I1226 21:45:46.058996  703653 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I1226 21:45:46.076168  703653 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I1226 21:45:46.176076  703653 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I1226 21:45:46.283099  703653 docker.go:219] disabling docker service ...

	I1226 21:45:46.283188  703653 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I1226 21:45:46.304709  703653 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I1226 21:45:46.318373  703653 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I1226 21:45:46.415364  703653 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I1226 21:45:46.525204  703653 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I1226 21:45:46.538401  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I1226 21:45:46.558845  703653 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I1226 21:45:46.558912  703653 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1226 21:45:46.570719  703653 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I1226 21:45:46.570843  703653 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1226 21:45:46.582868  703653 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I1226 21:45:46.594679  703653 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I1226 21:45:46.607554  703653 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1226 21:45:46.618987  703653 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1226 21:45:46.629441  703653 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1226 21:45:46.640009  703653 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1226 21:45:46.737436  703653 ssh_runner.go:195] Run: sudo systemctl restart crio

	I1226 21:45:46.868766  703653 start.go:522] Will wait 60s for socket path /var/run/crio/crio.sock

	I1226 21:45:46.868855  703653 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I1226 21:45:46.873648  703653 start.go:543] Will wait 60s for crictl version

	I1226 21:45:46.873714  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:45:46.878246  703653 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1226 21:45:46.923846  703653 start.go:559] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.24.6

	RuntimeApiVersion:  v1

	I1226 21:45:46.923968  703653 ssh_runner.go:195] Run: crio --version

	I1226 21:45:46.972287  703653 ssh_runner.go:195] Run: crio --version

	I1226 21:45:47.024056  703653 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.6 ...

	I1226 21:45:47.026175  703653 cli_runner.go:164] Run: docker network inspect addons-154736 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 21:45:47.043826  703653 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts

	I1226 21:45:47.048434  703653 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1226 21:45:47.062328  703653 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio

	I1226 21:45:47.062400  703653 ssh_runner.go:195] Run: sudo crictl images --output json

	I1226 21:45:47.129771  703653 crio.go:496] all images are preloaded for cri-o runtime.

	I1226 21:45:47.129798  703653 crio.go:415] Images already preloaded, skipping extraction

	I1226 21:45:47.129855  703653 ssh_runner.go:195] Run: sudo crictl images --output json

	I1226 21:45:47.170543  703653 crio.go:496] all images are preloaded for cri-o runtime.

	I1226 21:45:47.170567  703653 cache_images.go:84] Images are preloaded, skipping loading

	I1226 21:45:47.170642  703653 ssh_runner.go:195] Run: crio config

	I1226 21:45:47.225638  703653 cni.go:84] Creating CNI manager for ""

	I1226 21:45:47.225661  703653 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet

	I1226 21:45:47.225693  703653 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1226 21:45:47.225714  703653 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-154736 NodeName:addons-154736 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuberne

tes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1226 21:45:47.225856  703653 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.49.2

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "addons-154736"

	  kubeletExtraArgs:

	    node-ip: 192.168.49.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.28.4

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1226 21:45:47.225917  703653 kubeadm.go:976] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=addons-154736 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2

	[Install]

	 config:

	{KubernetesVersion:v1.28.4 ClusterName:addons-154736 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}

	I1226 21:45:47.225985  703653 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4

	I1226 21:45:47.237056  703653 binaries.go:44] Found k8s binaries, skipping transfer

	I1226 21:45:47.237133  703653 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1226 21:45:47.247946  703653 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (423 bytes)

	I1226 21:45:47.269840  703653 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1226 21:45:47.291674  703653 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2094 bytes)

	I1226 21:45:47.313342  703653 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts

	I1226 21:45:47.317861  703653 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1226 21:45:47.331485  703653 certs.go:56] Setting up /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736 for IP: 192.168.49.2

	I1226 21:45:47.331518  703653 certs.go:190] acquiring lock for shared ca certs: {Name:mke6488a150c186a525017f74b8a69a9f5240d76 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:47.331655  703653 certs.go:204] generating minikubeCA CA: /home/jenkins/minikube-integration/17857-697646/.minikube/ca.key

	I1226 21:45:47.957856  703653 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17857-697646/.minikube/ca.crt ...

	I1226 21:45:47.957886  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/ca.crt: {Name:mk47f0115b5b2e0f9fb3d82c3586bf65061aba13 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:47.958103  703653 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17857-697646/.minikube/ca.key ...

	I1226 21:45:47.958116  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/ca.key: {Name:mkf78405cdbf4f9984f2752ec84f5767189bbbb7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:47.958203  703653 certs.go:204] generating proxyClientCA CA: /home/jenkins/minikube-integration/17857-697646/.minikube/proxy-client-ca.key

	I1226 21:45:48.793651  703653 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17857-697646/.minikube/proxy-client-ca.crt ...

	I1226 21:45:48.793685  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/proxy-client-ca.crt: {Name:mkfdb1f360b5d2e7d5f43ab0b751b43bd0785f9b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:48.793879  703653 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17857-697646/.minikube/proxy-client-ca.key ...

	I1226 21:45:48.793891  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/proxy-client-ca.key: {Name:mkdcc5cfb23c652bc0a238c143809b638efe2934 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:48.794001  703653 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/client.key

	I1226 21:45:48.794021  703653 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/client.crt with IP's: []

	I1226 21:45:49.130100  703653 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/client.crt ...

	I1226 21:45:49.130132  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/client.crt: {Name:mk5b103a47afc40825354234830fdd6d328e23cd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:49.130328  703653 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/client.key ...

	I1226 21:45:49.130341  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/client.key: {Name:mk8109095c1de71d7b1e565af62dedeafa19e192 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:49.130979  703653 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.key.dd3b5fb2

	I1226 21:45:49.131003  703653 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]

	I1226 21:45:49.342573  703653 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.crt.dd3b5fb2 ...

	I1226 21:45:49.342606  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.crt.dd3b5fb2: {Name:mkbf4e612869b6431d860f33b33b959adfcdb9d9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:49.342798  703653 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.key.dd3b5fb2 ...

	I1226 21:45:49.342811  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.key.dd3b5fb2: {Name:mkd83808fc939bd68c9f62be01c7ab9dc98abd0d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:49.342902  703653 certs.go:337] copying /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.crt

	I1226 21:45:49.342981  703653 certs.go:341] copying /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.key

	I1226 21:45:49.343036  703653 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/proxy-client.key

	I1226 21:45:49.343051  703653 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/proxy-client.crt with IP's: []

	I1226 21:45:49.729468  703653 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/proxy-client.crt ...

	I1226 21:45:49.729499  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/proxy-client.crt: {Name:mk5f2f9075967085d62c91e8f08859c48d8fb037 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:49.729683  703653 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/proxy-client.key ...

	I1226 21:45:49.729697  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/proxy-client.key: {Name:mk6e3ac998613569553a1ffff7932a3627336a0d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:45:49.729906  703653 certs.go:437] found cert: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca-key.pem (1675 bytes)

	I1226 21:45:49.729951  703653 certs.go:437] found cert: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca.pem (1082 bytes)

	I1226 21:45:49.730001  703653 certs.go:437] found cert: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/home/jenkins/minikube-integration/17857-697646/.minikube/certs/cert.pem (1123 bytes)

	I1226 21:45:49.730030  703653 certs.go:437] found cert: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/home/jenkins/minikube-integration/17857-697646/.minikube/certs/key.pem (1679 bytes)

	I1226 21:45:49.730627  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1226 21:45:49.761140  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1226 21:45:49.791177  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1226 21:45:49.820829  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I1226 21:45:49.849585  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1226 21:45:49.878912  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1226 21:45:49.909268  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1226 21:45:49.941348  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1226 21:45:49.970836  703653 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1226 21:45:49.999844  703653 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1226 21:45:50.029395  703653 ssh_runner.go:195] Run: openssl version

	I1226 21:45:50.037542  703653 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1226 21:45:50.050867  703653 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1226 21:45:50.056091  703653 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Dec 26 21:45 /usr/share/ca-certificates/minikubeCA.pem

	I1226 21:45:50.056176  703653 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1226 21:45:50.065485  703653 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1226 21:45:50.078013  703653 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I1226 21:45:50.083315  703653 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory

	I1226 21:45:50.083437  703653 kubeadm.go:404] StartCluster: {Name:addons-154736 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:addons-154736 Namespace:default APIServerName:minikubeCA APIServerNames:[] APISe

rverIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:f

alse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}

	I1226 21:45:50.083527  703653 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I1226 21:45:50.083590  703653 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I1226 21:45:50.144212  703653 cri.go:89] found id: ""

	I1226 21:45:50.144288  703653 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1226 21:45:50.156065  703653 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1226 21:45:50.167528  703653 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver

	I1226 21:45:50.167619  703653 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1226 21:45:50.179275  703653 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1226 21:45:50.179343  703653 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"

	I1226 21:45:50.239492  703653 kubeadm.go:322] [init] Using Kubernetes version: v1.28.4

	I1226 21:45:50.239794  703653 kubeadm.go:322] [preflight] Running pre-flight checks

	I1226 21:45:50.287034  703653 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:

	I1226 21:45:50.287162  703653 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1051-aws

	I1226 21:45:50.287219  703653 kubeadm.go:322] OS: Linux

	I1226 21:45:50.287279  703653 kubeadm.go:322] CGROUPS_CPU: enabled

	I1226 21:45:50.287349  703653 kubeadm.go:322] CGROUPS_CPUACCT: enabled

	I1226 21:45:50.287410  703653 kubeadm.go:322] CGROUPS_CPUSET: enabled

	I1226 21:45:50.287480  703653 kubeadm.go:322] CGROUPS_DEVICES: enabled

	I1226 21:45:50.287553  703653 kubeadm.go:322] CGROUPS_FREEZER: enabled

	I1226 21:45:50.287623  703653 kubeadm.go:322] CGROUPS_MEMORY: enabled

	I1226 21:45:50.287682  703653 kubeadm.go:322] CGROUPS_PIDS: enabled

	I1226 21:45:50.287752  703653 kubeadm.go:322] CGROUPS_HUGETLB: enabled

	I1226 21:45:50.287813  703653 kubeadm.go:322] CGROUPS_BLKIO: enabled

	I1226 21:45:50.370303  703653 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster

	I1226 21:45:50.370463  703653 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I1226 21:45:50.370584  703653 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I1226 21:45:50.630713  703653 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1226 21:45:50.635156  703653 out.go:204]   - Generating certificates and keys ...

	I1226 21:45:50.635285  703653 kubeadm.go:322] [certs] Using existing ca certificate authority

	I1226 21:45:50.635356  703653 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk

	I1226 21:45:50.944392  703653 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key

	I1226 21:45:51.488209  703653 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key

	I1226 21:45:51.868223  703653 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key

	I1226 21:45:52.038881  703653 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key

	I1226 21:45:52.370275  703653 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key

	I1226 21:45:52.370434  703653 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-154736 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]

	I1226 21:45:52.635129  703653 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key

	I1226 21:45:52.635292  703653 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-154736 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]

	I1226 21:45:53.661223  703653 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key

	I1226 21:45:54.290814  703653 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key

	I1226 21:45:54.651197  703653 kubeadm.go:322] [certs] Generating "sa" key and public key

	I1226 21:45:54.651394  703653 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I1226 21:45:55.134969  703653 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file

	I1226 21:45:55.322944  703653 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I1226 21:45:55.759311  703653 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I1226 21:45:55.948385  703653 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I1226 21:45:55.948895  703653 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I1226 21:45:55.953472  703653 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I1226 21:45:55.955844  703653 out.go:204]   - Booting up control plane ...

	I1226 21:45:55.955952  703653 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I1226 21:45:55.956032  703653 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I1226 21:45:55.957069  703653 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I1226 21:45:55.967769  703653 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1226 21:45:55.968989  703653 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1226 21:45:55.969050  703653 kubeadm.go:322] [kubelet-start] Starting the kubelet

	I1226 21:45:56.074927  703653 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s

	I1226 21:46:03.077104  703653 kubeadm.go:322] [apiclient] All control plane components are healthy after 7.002309 seconds

	I1226 21:46:03.077227  703653 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I1226 21:46:03.091854  703653 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I1226 21:46:03.619549  703653 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs

	I1226 21:46:03.619738  703653 kubeadm.go:322] [mark-control-plane] Marking the node addons-154736 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I1226 21:46:04.130928  703653 kubeadm.go:322] [bootstrap-token] Using token: 08smwl.lifk3a8mo3dqg185

	I1226 21:46:04.132945  703653 out.go:204]   - Configuring RBAC rules ...

	I1226 21:46:04.133066  703653 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I1226 21:46:04.138717  703653 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I1226 21:46:04.147006  703653 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I1226 21:46:04.150888  703653 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I1226 21:46:04.154871  703653 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I1226 21:46:04.160999  703653 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I1226 21:46:04.172410  703653 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I1226 21:46:04.397107  703653 kubeadm.go:322] [addons] Applied essential addon: CoreDNS

	I1226 21:46:04.545271  703653 kubeadm.go:322] [addons] Applied essential addon: kube-proxy

	I1226 21:46:04.546497  703653 kubeadm.go:322] 

	I1226 21:46:04.546573  703653 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!

	I1226 21:46:04.546583  703653 kubeadm.go:322] 

	I1226 21:46:04.546657  703653 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:

	I1226 21:46:04.546666  703653 kubeadm.go:322] 

	I1226 21:46:04.546691  703653 kubeadm.go:322]   mkdir -p $HOME/.kube

	I1226 21:46:04.546750  703653 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I1226 21:46:04.546804  703653 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I1226 21:46:04.546813  703653 kubeadm.go:322] 

	I1226 21:46:04.546864  703653 kubeadm.go:322] Alternatively, if you are the root user, you can run:

	I1226 21:46:04.546872  703653 kubeadm.go:322] 

	I1226 21:46:04.546917  703653 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I1226 21:46:04.546925  703653 kubeadm.go:322] 

	I1226 21:46:04.546975  703653 kubeadm.go:322] You should now deploy a pod network to the cluster.

	I1226 21:46:04.547049  703653 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I1226 21:46:04.547137  703653 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I1226 21:46:04.547146  703653 kubeadm.go:322] 

	I1226 21:46:04.547225  703653 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities

	I1226 21:46:04.547301  703653 kubeadm.go:322] and service account keys on each node and then running the following as root:

	I1226 21:46:04.547309  703653 kubeadm.go:322] 

	I1226 21:46:04.547388  703653 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token 08smwl.lifk3a8mo3dqg185 \

	I1226 21:46:04.547489  703653 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:eb99bb3bfadffb0fd08fb657f91b723758be2a0ceabacd68fe612edc25108351 \

	I1226 21:46:04.547515  703653 kubeadm.go:322] 	--control-plane 

	I1226 21:46:04.547525  703653 kubeadm.go:322] 

	I1226 21:46:04.547605  703653 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:

	I1226 21:46:04.547613  703653 kubeadm.go:322] 

	I1226 21:46:04.547691  703653 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 08smwl.lifk3a8mo3dqg185 \

	I1226 21:46:04.547788  703653 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:eb99bb3bfadffb0fd08fb657f91b723758be2a0ceabacd68fe612edc25108351 

	I1226 21:46:04.550011  703653 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1051-aws\n", err: exit status 1

	I1226 21:46:04.550125  703653 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I1226 21:46:04.550144  703653 cni.go:84] Creating CNI manager for ""

	I1226 21:46:04.550153  703653 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet

	I1226 21:46:04.552156  703653 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I1226 21:46:04.553984  703653 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I1226 21:46:04.565752  703653 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.28.4/kubectl ...

	I1226 21:46:04.565773  703653 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I1226 21:46:04.619814  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I1226 21:46:05.498806  703653 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1226 21:46:05.498945  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:05.499035  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl label nodes minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=393f165ced08f66e4386491f243850f87982a22b minikube.k8s.io/name=addons-154736 minikube.k8s.io/updated_at=2023_12_26T21_46_05_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:05.656110  703653 ops.go:34] apiserver oom_adj: -16

	I1226 21:46:05.656189  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:06.157100  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:06.656948  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:07.157012  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:07.657245  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:08.156650  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:08.656541  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:09.157216  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:09.656418  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:10.156767  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:10.656764  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:11.156322  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:11.656675  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:12.156530  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:12.656297  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:13.156968  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:13.657245  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:14.156642  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:14.656931  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:15.156946  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:15.656910  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:16.157085  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:16.656471  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:17.156278  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:17.656294  703653 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1226 21:46:17.768936  703653 kubeadm.go:1088] duration metric: took 12.270036305s to wait for elevateKubeSystemPrivileges.

	I1226 21:46:17.768962  703653 kubeadm.go:406] StartCluster complete in 27.685530957s

	I1226 21:46:17.768979  703653 settings.go:142] acquiring lock: {Name:mk1b89d623875ac96830001bdd0fc2b8d8c10aec Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:46:17.769094  703653 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/17857-697646/kubeconfig

	I1226 21:46:17.769489  703653 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/kubeconfig: {Name:mk171fc32e21f516abb68bc5ebeb628b3c1d7f0b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 21:46:17.770221  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1226 21:46:17.770499  703653 config.go:182] Loaded profile config "addons-154736": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4

	I1226 21:46:17.770617  703653 addons.go:505] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volumesnapshots:true yakd:true]

	I1226 21:46:17.770691  703653 addons.go:69] Setting yakd=true in profile "addons-154736"

	I1226 21:46:17.770708  703653 addons.go:237] Setting addon yakd=true in "addons-154736"

	I1226 21:46:17.770740  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.771199  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.772718  703653 addons.go:69] Setting cloud-spanner=true in profile "addons-154736"

	I1226 21:46:17.772750  703653 addons.go:237] Setting addon cloud-spanner=true in "addons-154736"

	I1226 21:46:17.772735  703653 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-154736"

	I1226 21:46:17.772791  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.772832  703653 addons.go:237] Setting addon csi-hostpath-driver=true in "addons-154736"

	I1226 21:46:17.772893  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.773203  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.773403  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.772728  703653 addons.go:69] Setting metrics-server=true in profile "addons-154736"

	I1226 21:46:17.773824  703653 addons.go:237] Setting addon metrics-server=true in "addons-154736"

	I1226 21:46:17.773873  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.774269  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.779281  703653 addons.go:69] Setting default-storageclass=true in profile "addons-154736"

	I1226 21:46:17.779314  703653 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-154736"

	I1226 21:46:17.779643  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.792607  703653 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-154736"

	I1226 21:46:17.792651  703653 addons.go:237] Setting addon nvidia-device-plugin=true in "addons-154736"

	I1226 21:46:17.792699  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.793150  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.804697  703653 addons.go:69] Setting gcp-auth=true in profile "addons-154736"

	I1226 21:46:17.804964  703653 mustload.go:65] Loading cluster: addons-154736

	I1226 21:46:17.805721  703653 addons.go:69] Setting registry=true in profile "addons-154736"

	I1226 21:46:17.805750  703653 addons.go:237] Setting addon registry=true in "addons-154736"

	I1226 21:46:17.805792  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.806207  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.806448  703653 config.go:182] Loaded profile config "addons-154736": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4

	I1226 21:46:17.806745  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.828753  703653 addons.go:69] Setting storage-provisioner=true in profile "addons-154736"

	I1226 21:46:17.828787  703653 addons.go:237] Setting addon storage-provisioner=true in "addons-154736"

	I1226 21:46:17.828833  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.829266  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.804878  703653 addons.go:69] Setting ingress=true in profile "addons-154736"

	I1226 21:46:17.840652  703653 addons.go:237] Setting addon ingress=true in "addons-154736"

	I1226 21:46:17.840738  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.843946  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.851917  703653 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-154736"

	I1226 21:46:17.851955  703653 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-154736"

	I1226 21:46:17.852399  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.804889  703653 addons.go:69] Setting ingress-dns=true in profile "addons-154736"

	I1226 21:46:17.852637  703653 addons.go:237] Setting addon ingress-dns=true in "addons-154736"

	I1226 21:46:17.852715  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.853125  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.874589  703653 addons.go:69] Setting volumesnapshots=true in profile "addons-154736"

	I1226 21:46:17.874671  703653 addons.go:237] Setting addon volumesnapshots=true in "addons-154736"

	I1226 21:46:17.874749  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.878996  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:17.804896  703653 addons.go:69] Setting inspektor-gadget=true in profile "addons-154736"

	I1226 21:46:17.895266  703653 addons.go:237] Setting addon inspektor-gadget=true in "addons-154736"

	I1226 21:46:17.895344  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:17.895877  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:18.007568  703653 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.4

	I1226 21:46:18.026335  703653 addons.go:429] installing /etc/kubernetes/addons/yakd-ns.yaml

	I1226 21:46:18.026501  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)

	I1226 21:46:18.026615  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.046125  703653 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.13

	I1226 21:46:18.026045  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:18.062757  703653 addons.go:429] installing /etc/kubernetes/addons/deployment.yaml

	I1226 21:46:18.066821  703653 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.14.3

	I1226 21:46:18.064795  703653 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	I1226 21:46:18.064803  703653 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.6.4

	I1226 21:46:18.064807  703653 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.5

	I1226 21:46:18.064821  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)

	I1226 21:46:18.067197  703653 addons.go:237] Setting addon default-storageclass=true in "addons-154736"

	I1226 21:46:18.073344  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:18.073857  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:18.076019  703653 addons.go:429] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I1226 21:46:18.076045  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I1226 21:46:18.076108  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.074344  703653 addons.go:429] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I1226 21:46:18.076137  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)

	I1226 21:46:18.076187  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.104644  703653 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	I1226 21:46:18.074535  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.094767  703653 addons.go:237] Setting addon storage-provisioner-rancher=true in "addons-154736"

	I1226 21:46:18.106659  703653 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2

	I1226 21:46:18.111864  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:18.113291  703653 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	I1226 21:46:18.125892  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:18.126055  703653 addons.go:429] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	I1226 21:46:18.126072  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)

	I1226 21:46:18.126126  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.125904  703653 out.go:177]   - Using image docker.io/registry:2.8.3

	I1226 21:46:18.156725  703653 addons.go:429] installing /etc/kubernetes/addons/registry-rc.yaml

	I1226 21:46:18.156754  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)

	I1226 21:46:18.156821  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.167971  703653 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	I1226 21:46:18.172167  703653 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	I1226 21:46:18.174496  703653 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	I1226 21:46:18.176642  703653 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	I1226 21:46:18.179637  703653 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	I1226 21:46:18.182306  703653 addons.go:429] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I1226 21:46:18.182372  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I1226 21:46:18.182473  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.193072  703653 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I1226 21:46:18.165581  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I1226 21:46:18.196363  703653 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.23.1

	I1226 21:46:18.196409  703653 addons.go:429] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I1226 21:46:18.202329  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I1226 21:46:18.202409  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.202582  703653 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.9.5

	I1226 21:46:18.204409  703653 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0

	I1226 21:46:18.202750  703653 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1226 21:46:18.210421  703653 addons.go:429] installing /etc/kubernetes/addons/ig-namespace.yaml

	I1226 21:46:18.210452  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)

	I1226 21:46:18.210518  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.238353  703653 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0

	I1226 21:46:18.240718  703653 addons.go:429] installing /etc/kubernetes/addons/ingress-deploy.yaml

	I1226 21:46:18.240741  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16103 bytes)

	I1226 21:46:18.240812  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.259800  703653 addons.go:429] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1226 21:46:18.259864  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1226 21:46:18.259969  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.284670  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.284999  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.322452  703653 addons.go:429] installing /etc/kubernetes/addons/storageclass.yaml

	I1226 21:46:18.322479  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1226 21:46:18.322539  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.383702  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.385611  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.397710  703653 out.go:177]   - Using image docker.io/busybox:stable

	I1226 21:46:18.399834  703653 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	I1226 21:46:18.402027  703653 addons.go:429] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I1226 21:46:18.402047  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)

	I1226 21:46:18.402115  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:18.418660  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.440650  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.469494  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.480016  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.481628  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.493844  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.529486  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.536621  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.560292  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:18.719345  703653 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-154736" context rescaled to 1 replicas

	I1226 21:46:18.719381  703653 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1226 21:46:18.721615  703653 out.go:177] * Verifying Kubernetes components...

	I1226 21:46:18.723683  703653 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1226 21:46:18.823973  703653 addons.go:429] installing /etc/kubernetes/addons/yakd-sa.yaml

	I1226 21:46:18.823993  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)

	I1226 21:46:18.843133  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I1226 21:46:18.886287  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1226 21:46:18.890874  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1226 21:46:18.894516  703653 addons.go:429] installing /etc/kubernetes/addons/registry-svc.yaml

	I1226 21:46:18.894586  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)

	I1226 21:46:18.927177  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/deployment.yaml

	I1226 21:46:18.970962  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I1226 21:46:18.986951  703653 addons.go:429] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I1226 21:46:18.987022  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)

	I1226 21:46:19.021253  703653 addons.go:429] installing /etc/kubernetes/addons/registry-proxy.yaml

	I1226 21:46:19.021322  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)

	I1226 21:46:19.028642  703653 addons.go:429] installing /etc/kubernetes/addons/yakd-crb.yaml

	I1226 21:46:19.028712  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)

	I1226 21:46:19.060764  703653 addons.go:429] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I1226 21:46:19.060835  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I1226 21:46:19.064691  703653 addons.go:429] installing /etc/kubernetes/addons/rbac-hostpath.yaml

	I1226 21:46:19.064761  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)

	I1226 21:46:19.067867  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml

	I1226 21:46:19.074108  703653 addons.go:429] installing /etc/kubernetes/addons/ig-serviceaccount.yaml

	I1226 21:46:19.074185  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)

	I1226 21:46:19.149129  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	I1226 21:46:19.173549  703653 addons.go:429] installing /etc/kubernetes/addons/yakd-svc.yaml

	I1226 21:46:19.173622  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)

	I1226 21:46:19.181331  703653 addons.go:429] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I1226 21:46:19.181402  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I1226 21:46:19.204375  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml

	I1226 21:46:19.247997  703653 addons.go:429] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I1226 21:46:19.248067  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I1226 21:46:19.252641  703653 addons.go:429] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I1226 21:46:19.252714  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)

	I1226 21:46:19.257178  703653 addons.go:429] installing /etc/kubernetes/addons/ig-role.yaml

	I1226 21:46:19.257247  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)

	I1226 21:46:19.375270  703653 addons.go:429] installing /etc/kubernetes/addons/yakd-dp.yaml

	I1226 21:46:19.375338  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)

	I1226 21:46:19.411800  703653 addons.go:429] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I1226 21:46:19.411874  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I1226 21:46:19.474697  703653 addons.go:429] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I1226 21:46:19.474770  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I1226 21:46:19.478562  703653 addons.go:429] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I1226 21:46:19.478631  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)

	I1226 21:46:19.487788  703653 addons.go:429] installing /etc/kubernetes/addons/ig-rolebinding.yaml

	I1226 21:46:19.487864  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)

	I1226 21:46:19.607392  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I1226 21:46:19.643328  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml

	I1226 21:46:19.662535  703653 addons.go:429] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I1226 21:46:19.662607  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I1226 21:46:19.682945  703653 addons.go:429] installing /etc/kubernetes/addons/ig-clusterrole.yaml

	I1226 21:46:19.683021  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)

	I1226 21:46:19.721905  703653 addons.go:429] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I1226 21:46:19.721979  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)

	I1226 21:46:19.783208  703653 addons.go:429] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I1226 21:46:19.783276  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I1226 21:46:19.813062  703653 addons.go:429] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml

	I1226 21:46:19.813122  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)

	I1226 21:46:19.875998  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I1226 21:46:19.892038  703653 addons.go:429] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I1226 21:46:19.892108  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)

	I1226 21:46:19.898813  703653 addons.go:429] installing /etc/kubernetes/addons/ig-crd.yaml

	I1226 21:46:19.898880  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)

	I1226 21:46:19.970604  703653 addons.go:429] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I1226 21:46:19.970675  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)

	I1226 21:46:19.979157  703653 addons.go:429] installing /etc/kubernetes/addons/ig-daemonset.yaml

	I1226 21:46:19.979228  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)

	I1226 21:46:20.068804  703653 addons.go:429] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I1226 21:46:20.068877  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)

	I1226 21:46:20.071774  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml

	I1226 21:46:20.223830  703653 addons.go:429] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I1226 21:46:20.223899  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)

	I1226 21:46:20.393097  703653 addons.go:429] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I1226 21:46:20.393163  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)

	I1226 21:46:20.525129  703653 addons.go:429] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I1226 21:46:20.525203  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I1226 21:46:20.653419  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I1226 21:46:20.842620  703653 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.646185588s)

	I1226 21:46:20.842696  703653 start.go:929] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap

	I1226 21:46:20.842737  703653 ssh_runner.go:235] Completed: sudo systemctl is-active --quiet service kubelet: (2.119032448s)

	I1226 21:46:20.843712  703653 node_ready.go:35] waiting up to 6m0s for node "addons-154736" to be "Ready" ...

	I1226 21:46:22.115492  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (3.272322247s)

	I1226 21:46:22.929290  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:23.873940  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (4.987579254s)

	I1226 21:46:23.874031  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (4.983094048s)

	I1226 21:46:23.874054  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (4.946818712s)

	I1226 21:46:23.899655  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (4.928558019s)

	W1226 21:46:23.935588  703653 out.go:239] ! Enabling 'storage-provisioner-rancher' returned an error: running callbacks: [Error making local-path the default storage class: Error while marking storage class local-path as default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]

	I1226 21:46:24.549723  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (5.481784866s)

	I1226 21:46:24.550248  703653 addons.go:473] Verifying addon ingress=true in "addons-154736"

	I1226 21:46:24.550339  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (5.34541146s)

	I1226 21:46:24.550369  703653 addons.go:473] Verifying addon registry=true in "addons-154736"

	I1226 21:46:24.552781  703653 out.go:177] * Verifying ingress addon...

	I1226 21:46:24.555640  703653 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I1226 21:46:24.552845  703653 out.go:177] * Verifying registry addon...

	I1226 21:46:24.549972  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (4.90658226s)

	I1226 21:46:24.550052  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (4.673983728s)

	I1226 21:46:24.550108  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (4.478251658s)

	I1226 21:46:24.549829  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (5.400630337s)

	I1226 21:46:24.549929  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (4.942445076s)

	I1226 21:46:24.557896  703653 addons.go:473] Verifying addon metrics-server=true in "addons-154736"

	I1226 21:46:24.558715  703653 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I1226 21:46:24.560838  703653 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-154736 service yakd-dashboard -n yakd-dashboard

	W1226 21:46:24.559008  703653 addons.go:455] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I1226 21:46:24.562704  703653 retry.go:31] will retry after 132.401694ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I1226 21:46:24.569656  703653 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=registry

	I1226 21:46:24.569680  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:24.574284  703653 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I1226 21:46:24.574358  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:24.695895  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I1226 21:46:24.956686  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (4.303171454s)

	I1226 21:46:24.956765  703653 addons.go:473] Verifying addon csi-hostpath-driver=true in "addons-154736"

	I1226 21:46:24.960028  703653 out.go:177] * Verifying csi-hostpath-driver addon...

	I1226 21:46:24.963091  703653 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I1226 21:46:24.975073  703653 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I1226 21:46:24.975149  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:25.071087  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:25.079722  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:25.350710  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:25.467870  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:25.561828  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:25.571223  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:25.970056  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:26.065018  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:26.068043  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:26.205366  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.509380595s)

	I1226 21:46:26.468713  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:26.570044  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:26.584924  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:26.924708  703653 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I1226 21:46:26.924807  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:26.956235  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:26.968334  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:27.062289  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:27.065379  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:27.146887  703653 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I1226 21:46:27.172562  703653 addons.go:237] Setting addon gcp-auth=true in "addons-154736"

	I1226 21:46:27.172661  703653 host.go:66] Checking if "addons-154736" exists ...

	I1226 21:46:27.173152  703653 cli_runner.go:164] Run: docker container inspect addons-154736 --format={{.State.Status}}

	I1226 21:46:27.207957  703653 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I1226 21:46:27.208012  703653 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-154736

	I1226 21:46:27.246139  703653 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33671 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/addons-154736/id_rsa Username:docker}

	I1226 21:46:27.365287  703653 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.0

	I1226 21:46:27.367384  703653 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20231011-8b53cabe0

	I1226 21:46:27.369310  703653 addons.go:429] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I1226 21:46:27.369365  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I1226 21:46:27.429064  703653 addons.go:429] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I1226 21:46:27.429087  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I1226 21:46:27.469042  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:27.489750  703653 addons.go:429] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I1226 21:46:27.489813  703653 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5432 bytes)

	I1226 21:46:27.541813  703653 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I1226 21:46:27.562086  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:27.564702  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:27.847272  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:27.968383  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:28.062452  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:28.067190  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:28.469043  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:28.612064  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:28.613425  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:28.694641  703653 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.152734381s)

	I1226 21:46:28.697723  703653 addons.go:473] Verifying addon gcp-auth=true in "addons-154736"

	I1226 21:46:28.699657  703653 out.go:177] * Verifying gcp-auth addon...

	I1226 21:46:28.702193  703653 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I1226 21:46:28.713134  703653 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I1226 21:46:28.713169  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:28.968083  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:29.062578  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:29.065752  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:29.206575  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:29.467801  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:29.562917  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:29.566551  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:29.706567  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:29.847539  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:29.969640  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:30.065196  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:30.065821  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:30.207650  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:30.468600  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:30.559955  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:30.563229  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:30.706713  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:30.967667  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:31.060215  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:31.063555  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:31.206014  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:31.467822  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:31.560684  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:31.564582  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:31.706453  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:31.848194  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:31.967625  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:32.071768  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:32.074574  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:32.206257  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:32.467742  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:32.560210  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:32.564370  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:32.706417  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:32.968484  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:33.059977  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:33.063079  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:33.206191  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:33.469654  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:33.560128  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:33.563933  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:33.706915  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:33.968138  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:34.060699  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:34.062966  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:34.205994  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:34.347763  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:34.467659  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:34.560545  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:34.564030  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:34.706956  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:34.967462  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:35.060365  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:35.063174  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:35.206350  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:35.467439  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:35.560949  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:35.563816  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:35.706116  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:35.967771  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:36.060270  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:36.062972  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:36.206749  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:36.347898  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:36.468162  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:36.562270  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:36.565356  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:36.706459  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:36.969062  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:37.060019  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:37.062458  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:37.205865  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:37.468108  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:37.560701  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:37.563249  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:37.706501  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:37.967330  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:38.061409  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:38.064071  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:38.206358  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:38.467649  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:38.560270  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:38.563682  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:38.706163  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:38.847114  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:38.968020  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:39.061302  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:39.062938  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:39.206046  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:39.468201  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:39.560687  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:39.563258  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:39.705944  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:39.967732  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:40.060511  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:40.063552  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:40.206079  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:40.467704  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:40.559890  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:40.562420  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:40.706020  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:40.847265  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:40.967615  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:41.059557  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:41.063115  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:41.206147  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:41.468171  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:41.561080  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:41.563399  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:41.705797  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:41.968183  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:42.060346  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:42.065795  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:42.206857  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:42.467804  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:42.559940  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:42.563378  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:42.706060  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:42.847516  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:42.967877  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:43.061125  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:43.063696  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:43.206173  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:43.468000  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:43.560123  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:43.564203  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:43.706221  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:43.967655  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:44.060179  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:44.063269  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:44.206390  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:44.468741  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:44.560372  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:44.562859  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:44.706366  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:44.847638  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:44.967909  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:45.061583  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:45.064665  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:45.211106  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:45.467461  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:45.560089  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:45.562275  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:45.706638  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:45.970355  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:46.059861  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:46.063618  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:46.206118  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:46.467955  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:46.560833  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:46.563482  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:46.706762  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:46.967932  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:47.060026  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:47.062487  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:47.205482  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:47.348084  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:47.476263  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:47.560890  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:47.564350  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:47.706703  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:47.969547  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:48.060729  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:48.063500  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:48.206175  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:48.468027  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:48.562588  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:48.565212  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:48.706331  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:48.968883  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:49.062420  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:49.067064  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:49.205752  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:49.468835  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:49.560426  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:49.566168  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:49.706795  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:49.847821  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:49.967554  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:50.060438  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:50.063784  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:50.206837  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:50.468711  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:50.568015  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:50.570291  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:50.706000  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:50.968506  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:51.060136  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:51.064069  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:51.205554  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:51.468398  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:51.562146  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:51.562949  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:51.706465  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:51.848005  703653 node_ready.go:58] node "addons-154736" has status "Ready":"False"

	I1226 21:46:51.967993  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:52.060615  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:52.063507  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:52.206665  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:52.489848  703653 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I1226 21:46:52.489871  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:52.570538  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:52.575568  703653 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry

	I1226 21:46:52.575599  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:52.783948  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:52.858988  703653 node_ready.go:49] node "addons-154736" has status "Ready":"True"

	I1226 21:46:52.859014  703653 node_ready.go:38] duration metric: took 32.015238708s waiting for node "addons-154736" to be "Ready" ...

	I1226 21:46:52.859025  703653 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1226 21:46:52.873732  703653 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-gbz9g" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:52.970570  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:53.062030  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:53.066822  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:53.208151  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:53.479541  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:53.561590  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:53.564565  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:53.706740  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:53.970560  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:54.062379  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:54.070050  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:54.206168  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:54.427418  703653 pod_ready.go:92] pod "coredns-5dd5756b68-gbz9g" in "kube-system" namespace has status "Ready":"True"

	I1226 21:46:54.427443  703653 pod_ready.go:81] duration metric: took 1.55363774s waiting for pod "coredns-5dd5756b68-gbz9g" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.427484  703653 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-154736" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.441610  703653 pod_ready.go:92] pod "etcd-addons-154736" in "kube-system" namespace has status "Ready":"True"

	I1226 21:46:54.441633  703653 pod_ready.go:81] duration metric: took 14.134232ms waiting for pod "etcd-addons-154736" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.441673  703653 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-154736" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.475840  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:54.482080  703653 pod_ready.go:92] pod "kube-apiserver-addons-154736" in "kube-system" namespace has status "Ready":"True"

	I1226 21:46:54.482105  703653 pod_ready.go:81] duration metric: took 40.41664ms waiting for pod "kube-apiserver-addons-154736" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.482143  703653 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-154736" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.503272  703653 pod_ready.go:92] pod "kube-controller-manager-addons-154736" in "kube-system" namespace has status "Ready":"True"

	I1226 21:46:54.503299  703653 pod_ready.go:81] duration metric: took 21.139593ms waiting for pod "kube-controller-manager-addons-154736" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.503315  703653 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-4r79z" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.510754  703653 pod_ready.go:92] pod "kube-proxy-4r79z" in "kube-system" namespace has status "Ready":"True"

	I1226 21:46:54.510779  703653 pod_ready.go:81] duration metric: took 7.429869ms waiting for pod "kube-proxy-4r79z" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.510791  703653 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-154736" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.560768  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:54.569594  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:54.706488  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:54.849037  703653 pod_ready.go:92] pod "kube-scheduler-addons-154736" in "kube-system" namespace has status "Ready":"True"

	I1226 21:46:54.849064  703653 pod_ready.go:81] duration metric: took 338.264308ms waiting for pod "kube-scheduler-addons-154736" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.849077  703653 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace to be "Ready" ...

	I1226 21:46:54.969242  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:55.061146  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:55.067005  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:55.207290  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:55.470788  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:55.564909  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:55.570773  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:55.706289  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:55.976219  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:56.067117  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:56.070953  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:56.207571  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:56.471026  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:56.561105  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:56.565253  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:56.707338  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:56.856778  703653 pod_ready.go:102] pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace has status "Ready":"False"

	I1226 21:46:56.969325  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:57.062863  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:57.066909  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:57.206843  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:57.469685  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:57.560698  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:57.565874  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:57.706369  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:57.971579  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:58.067484  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:58.070866  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:58.206809  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:58.469998  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:58.560651  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:58.566168  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:58.705958  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:58.860185  703653 pod_ready.go:102] pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace has status "Ready":"False"

	I1226 21:46:58.976070  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:59.072436  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:59.074569  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:59.205965  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:59.475382  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:46:59.561133  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:46:59.563634  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:46:59.706415  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:46:59.969341  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:00.072603  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:00.073664  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:00.210007  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:00.471336  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:00.561063  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:00.570171  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:00.708851  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:00.970634  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:01.065099  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:01.069820  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:01.207701  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:01.377053  703653 pod_ready.go:102] pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:01.471027  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:01.561179  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:01.567931  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:01.707290  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:01.969516  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:02.062572  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:02.067470  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:02.206698  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:02.473756  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:02.562936  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:02.568913  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:02.714007  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:02.974098  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:03.060756  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:03.065070  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:03.207705  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:03.469972  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:03.566258  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:03.569802  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:03.707702  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:03.857703  703653 pod_ready.go:102] pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:03.974229  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:04.065539  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:04.068208  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:04.206996  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:04.470685  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:04.560769  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:04.573550  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:04.707771  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:04.970025  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:05.061588  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:05.077281  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:05.206268  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:05.470787  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:05.562031  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:05.565526  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:05.706928  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:05.974070  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:06.060856  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:06.065192  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:06.205889  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:06.357938  703653 pod_ready.go:102] pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:06.474136  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:06.561022  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:06.569230  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:06.706481  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:06.970270  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:07.062297  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:07.065987  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:07.206895  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:07.470017  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:07.560625  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:07.563890  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:07.706085  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:07.969070  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:08.062278  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:08.067967  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:08.206596  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:08.515424  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:08.566521  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:08.574832  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:08.713605  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:08.856198  703653 pod_ready.go:102] pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:08.969419  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:09.061431  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:09.067912  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:09.206807  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:09.469389  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:09.560738  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:09.565395  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:09.706554  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:09.972022  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:10.061966  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:10.065576  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:10.206308  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:10.469790  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:10.561193  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:10.564481  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:10.707575  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:10.857077  703653 pod_ready.go:102] pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:10.968937  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:11.061350  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:11.067239  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:11.206695  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:11.474233  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:11.561359  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:11.564561  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:11.706552  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:11.969464  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:12.061431  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:12.065839  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:12.205791  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:12.486311  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:12.561067  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:12.564620  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:12.708399  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:12.873072  703653 pod_ready.go:102] pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:12.971333  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:13.094658  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:13.096399  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:13.208739  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:13.356187  703653 pod_ready.go:92] pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace has status "Ready":"True"

	I1226 21:47:13.356216  703653 pod_ready.go:81] duration metric: took 18.507131159s waiting for pod "metrics-server-7c66d45ddc-pz8ht" in "kube-system" namespace to be "Ready" ...

	I1226 21:47:13.356229  703653 pod_ready.go:78] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace to be "Ready" ...

	I1226 21:47:13.469532  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:13.561073  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:13.566388  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:13.706438  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:13.970252  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:14.061999  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:14.070026  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:14.207712  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:14.471132  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:14.567489  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:14.570427  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:14.707552  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:14.970629  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:15.062212  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:15.070838  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:15.207228  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:15.363858  703653 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:15.472669  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:15.563808  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:15.568650  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:15.706794  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:15.969450  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:16.064243  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:16.065309  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:16.207222  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:16.473523  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:16.568060  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:16.569013  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:16.706515  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:16.973407  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:17.066957  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:17.072279  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:17.206427  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:17.364884  703653 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:17.468992  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:17.567084  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:17.570624  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:17.706523  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:17.969537  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:18.060154  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:18.064503  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:18.222664  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:18.469733  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:18.571327  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:18.573773  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:18.709089  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:18.968889  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:19.069311  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:19.073568  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:19.207943  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:19.482855  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:19.575162  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:19.575483  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:19.705784  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:19.863199  703653 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:19.970830  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:20.061874  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:20.065796  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:20.206850  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:20.473637  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:20.561375  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:20.565460  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:20.706454  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:20.968707  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:21.061491  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:21.065619  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:21.206526  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:21.469410  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:21.567855  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:21.568668  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:21.714494  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:21.902192  703653 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:21.968787  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:22.061541  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:22.066095  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:22.206091  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:22.492888  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:22.562627  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:22.589676  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:22.718269  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:22.971014  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:23.060948  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:23.070832  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:23.206897  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:23.469906  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:23.566160  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:23.569918  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:23.707051  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:23.970360  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:24.061380  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:24.065995  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:24.207026  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:24.365402  703653 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:24.469724  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:24.561066  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:24.565718  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:24.708651  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:24.974549  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:25.062214  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:25.065091  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:25.205842  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:25.475004  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:25.560266  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:25.564620  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:25.706207  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:25.969910  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:26.061138  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:26.064142  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:26.205918  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:26.469544  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:26.559990  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:26.564544  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:26.706927  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:26.872638  703653 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:26.989402  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:27.061512  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:27.065575  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:27.206308  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:27.470363  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:27.565960  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:27.571508  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:27.709823  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:27.983523  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:28.064834  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:28.069810  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:28.206858  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:28.469981  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:28.561866  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:28.567347  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:28.706372  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:28.969840  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:29.060913  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:29.065572  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:29.216288  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:29.410195  703653 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:29.469260  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:29.565518  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:29.567101  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:29.706298  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:29.969149  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:30.062598  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:30.071250  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:30.206184  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:30.469173  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:30.560713  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:30.563786  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1226 21:47:30.705967  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:30.970274  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:31.061099  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:31.064599  703653 kapi.go:107] duration metric: took 1m6.505878547s to wait for kubernetes.io/minikube-addons=registry ...

	I1226 21:47:31.206762  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:31.469586  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:31.561988  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:31.706767  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:31.864032  703653 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:31.977033  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:32.061252  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:32.206052  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:32.469257  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:32.560678  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:32.706429  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:32.972790  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:33.060407  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:33.208205  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:33.478798  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:33.561123  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:33.713322  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:33.865637  703653 pod_ready.go:102] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"False"

	I1226 21:47:33.969626  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:34.068821  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:34.206745  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:34.468862  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:34.561874  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:34.706720  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:34.970112  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:35.061384  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:35.206359  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:35.470876  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:35.560734  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:35.707315  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:35.969191  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:36.061593  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:36.206118  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:36.366788  703653 pod_ready.go:92] pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace has status "Ready":"True"

	I1226 21:47:36.366814  703653 pod_ready.go:81] duration metric: took 23.010576239s waiting for pod "nvidia-device-plugin-daemonset-9xfxt" in "kube-system" namespace to be "Ready" ...

	I1226 21:47:36.366838  703653 pod_ready.go:38] duration metric: took 43.50780045s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1226 21:47:36.366858  703653 api_server.go:52] waiting for apiserver process to appear ...

	I1226 21:47:36.366895  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I1226 21:47:36.366967  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I1226 21:47:36.437260  703653 cri.go:89] found id: "c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8"

	I1226 21:47:36.437371  703653 cri.go:89] found id: ""

	I1226 21:47:36.437394  703653 logs.go:284] 1 containers: [c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8]

	I1226 21:47:36.437504  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:36.444644  703653 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I1226 21:47:36.444799  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I1226 21:47:36.470712  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:36.568139  703653 cri.go:89] found id: "a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a"

	I1226 21:47:36.568223  703653 cri.go:89] found id: ""

	I1226 21:47:36.568258  703653 logs.go:284] 1 containers: [a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a]

	I1226 21:47:36.568371  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:36.574008  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:36.589803  703653 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I1226 21:47:36.589967  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I1226 21:47:36.709373  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:36.777925  703653 cri.go:89] found id: "0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a"

	I1226 21:47:36.777994  703653 cri.go:89] found id: ""

	I1226 21:47:36.778023  703653 logs.go:284] 1 containers: [0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a]

	I1226 21:47:36.778115  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:36.786332  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I1226 21:47:36.786481  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I1226 21:47:36.865357  703653 cri.go:89] found id: "a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43"

	I1226 21:47:36.865381  703653 cri.go:89] found id: ""

	I1226 21:47:36.865389  703653 logs.go:284] 1 containers: [a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43]

	I1226 21:47:36.865446  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:36.871193  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I1226 21:47:36.871273  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I1226 21:47:36.939797  703653 cri.go:89] found id: "fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d"

	I1226 21:47:36.939824  703653 cri.go:89] found id: ""

	I1226 21:47:36.939833  703653 logs.go:284] 1 containers: [fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d]

	I1226 21:47:36.939889  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:36.950417  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I1226 21:47:36.950495  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I1226 21:47:36.971592  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:37.019700  703653 cri.go:89] found id: "5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee"

	I1226 21:47:37.019732  703653 cri.go:89] found id: ""

	I1226 21:47:37.019741  703653 logs.go:284] 1 containers: [5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee]

	I1226 21:47:37.019810  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:37.044883  703653 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I1226 21:47:37.044974  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I1226 21:47:37.061353  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:37.108196  703653 cri.go:89] found id: "5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445"

	I1226 21:47:37.108272  703653 cri.go:89] found id: ""

	I1226 21:47:37.108293  703653 logs.go:284] 1 containers: [5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445]

	I1226 21:47:37.108380  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:37.114078  703653 logs.go:123] Gathering logs for kube-apiserver [c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8] ...

	I1226 21:47:37.114151  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8"

	I1226 21:47:37.195220  703653 logs.go:123] Gathering logs for etcd [a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a] ...

	I1226 21:47:37.195296  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a"

	I1226 21:47:37.218174  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:37.275411  703653 logs.go:123] Gathering logs for kube-scheduler [a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43] ...

	I1226 21:47:37.275488  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43"

	I1226 21:47:37.362244  703653 logs.go:123] Gathering logs for kube-proxy [fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d] ...

	I1226 21:47:37.363123  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d"

	I1226 21:47:37.424432  703653 logs.go:123] Gathering logs for container status ...

	I1226 21:47:37.424460  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1226 21:47:37.470454  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:37.495685  703653 logs.go:123] Gathering logs for kubelet ...

	I1226 21:47:37.495714  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W1226 21:47:37.555728  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:18 addons-154736 kubelet[1365]: W1226 21:46:18.444235    1365 reflector.go:535] object-"kube-system"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	W1226 21:47:37.555951  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:18 addons-154736 kubelet[1365]: E1226 21:46:18.444308    1365 reflector.go:147] object-"kube-system"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	I1226 21:47:37.563330  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	W1226 21:47:37.577596  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.432342    1365 reflector.go:535] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:37.577823  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.432378    1365 reflector.go:147] object-"default"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:37.578130  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.434011    1365 reflector.go:535] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:37.578343  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.434040    1365 reflector.go:147] object-"default"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:37.579459  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.447831    1365 reflector.go:535] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:47:37.579665  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.447865    1365 reflector.go:147] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:47:37.581033  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.510344    1365 reflector.go:535] object-"kube-system"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	W1226 21:47:37.581221  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.510378    1365 reflector.go:147] object-"kube-system"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	I1226 21:47:37.618607  703653 logs.go:123] Gathering logs for describe nodes ...

	I1226 21:47:37.618646  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I1226 21:47:37.707887  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:37.883827  703653 logs.go:123] Gathering logs for kube-controller-manager [5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee] ...

	I1226 21:47:37.883860  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee"

	I1226 21:47:37.970815  703653 logs.go:123] Gathering logs for kindnet [5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445] ...

	I1226 21:47:37.970891  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445"

	I1226 21:47:37.972427  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:38.083080  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:38.112927  703653 logs.go:123] Gathering logs for CRI-O ...

	I1226 21:47:38.112956  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"

	I1226 21:47:38.210766  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:38.227495  703653 logs.go:123] Gathering logs for dmesg ...

	I1226 21:47:38.227530  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1226 21:47:38.260459  703653 logs.go:123] Gathering logs for coredns [0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a] ...

	I1226 21:47:38.260489  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a"

	I1226 21:47:38.314608  703653 out.go:309] Setting ErrFile to fd 2...

	I1226 21:47:38.314638  703653 out.go:343] TERM=,COLORTERM=, which probably does not support color

	W1226 21:47:38.314684  703653 out.go:239] X Problems detected in kubelet:

	W1226 21:47:38.314697  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.434040    1365 reflector.go:147] object-"default"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:38.314705  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.447831    1365 reflector.go:535] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:47:38.314715  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.447865    1365 reflector.go:147] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:47:38.314726  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.510344    1365 reflector.go:535] object-"kube-system"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	W1226 21:47:38.314733  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.510378    1365 reflector.go:147] object-"kube-system"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	I1226 21:47:38.314742  703653 out.go:309] Setting ErrFile to fd 2...

	I1226 21:47:38.314748  703653 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 21:47:38.469819  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:38.562425  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:38.705829  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:38.969304  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:39.072021  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:39.206688  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:39.470181  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:39.570020  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:39.707394  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:39.984670  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:40.065219  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:40.206859  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:40.469223  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:40.561358  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:40.706599  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:40.969985  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:41.061660  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:41.206767  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:41.470553  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:41.561113  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:41.705515  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:41.969382  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:42.061119  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:42.206342  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:42.470436  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:42.563875  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:42.706690  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:42.969264  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:43.065780  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:43.210316  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:43.470323  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:43.561501  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:43.706578  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:43.969896  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:44.062275  703653 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1226 21:47:44.206718  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:44.472904  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:44.560083  703653 kapi.go:107] duration metric: took 1m20.004440781s to wait for app.kubernetes.io/name=ingress-nginx ...

	I1226 21:47:44.705661  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:44.969639  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:45.209224  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:45.471716  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:45.707461  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:45.970535  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:46.206918  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1226 21:47:46.468572  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:46.710653  703653 kapi.go:107] duration metric: took 1m18.008457405s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I1226 21:47:46.713128  703653 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-154736 cluster.

	I1226 21:47:46.715469  703653 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I1226 21:47:46.717459  703653 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I1226 21:47:46.968908  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:47.469921  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:47.970474  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:48.315876  703653 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1226 21:47:48.333253  703653 api_server.go:72] duration metric: took 1m29.613843192s to wait for apiserver process to appear ...

	I1226 21:47:48.333327  703653 api_server.go:88] waiting for apiserver healthz status ...

	I1226 21:47:48.333374  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I1226 21:47:48.333520  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I1226 21:47:48.387443  703653 cri.go:89] found id: "c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8"

	I1226 21:47:48.387505  703653 cri.go:89] found id: ""

	I1226 21:47:48.387528  703653 logs.go:284] 1 containers: [c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8]

	I1226 21:47:48.387614  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:48.392971  703653 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I1226 21:47:48.393076  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I1226 21:47:48.441764  703653 cri.go:89] found id: "a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a"

	I1226 21:47:48.441787  703653 cri.go:89] found id: ""

	I1226 21:47:48.441795  703653 logs.go:284] 1 containers: [a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a]

	I1226 21:47:48.441857  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:48.446560  703653 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I1226 21:47:48.446637  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I1226 21:47:48.469918  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:48.497664  703653 cri.go:89] found id: "0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a"

	I1226 21:47:48.497689  703653 cri.go:89] found id: ""

	I1226 21:47:48.497698  703653 logs.go:284] 1 containers: [0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a]

	I1226 21:47:48.497770  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:48.503260  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I1226 21:47:48.503397  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I1226 21:47:48.549508  703653 cri.go:89] found id: "a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43"

	I1226 21:47:48.549586  703653 cri.go:89] found id: ""

	I1226 21:47:48.549618  703653 logs.go:284] 1 containers: [a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43]

	I1226 21:47:48.549705  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:48.561880  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I1226 21:47:48.562111  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I1226 21:47:48.610492  703653 cri.go:89] found id: "fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d"

	I1226 21:47:48.610522  703653 cri.go:89] found id: ""

	I1226 21:47:48.610531  703653 logs.go:284] 1 containers: [fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d]

	I1226 21:47:48.610598  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:48.615237  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I1226 21:47:48.615369  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I1226 21:47:48.659894  703653 cri.go:89] found id: "5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee"

	I1226 21:47:48.659921  703653 cri.go:89] found id: ""

	I1226 21:47:48.659929  703653 logs.go:284] 1 containers: [5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee]

	I1226 21:47:48.659986  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:48.664547  703653 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I1226 21:47:48.664625  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I1226 21:47:48.716253  703653 cri.go:89] found id: "5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445"

	I1226 21:47:48.716328  703653 cri.go:89] found id: ""

	I1226 21:47:48.716364  703653 logs.go:284] 1 containers: [5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445]

	I1226 21:47:48.716458  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:47:48.721160  703653 logs.go:123] Gathering logs for kube-scheduler [a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43] ...

	I1226 21:47:48.721186  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43"

	I1226 21:47:48.796955  703653 logs.go:123] Gathering logs for kube-controller-manager [5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee] ...

	I1226 21:47:48.796993  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee"

	I1226 21:47:48.939771  703653 logs.go:123] Gathering logs for kindnet [5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445] ...

	I1226 21:47:48.939808  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445"

	I1226 21:47:48.973717  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:49.030173  703653 logs.go:123] Gathering logs for container status ...

	I1226 21:47:49.030203  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1226 21:47:49.125812  703653 logs.go:123] Gathering logs for dmesg ...

	I1226 21:47:49.125848  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1226 21:47:49.171784  703653 logs.go:123] Gathering logs for kube-apiserver [c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8] ...

	I1226 21:47:49.171827  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8"

	I1226 21:47:49.261006  703653 logs.go:123] Gathering logs for etcd [a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a] ...

	I1226 21:47:49.261045  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a"

	I1226 21:47:49.385558  703653 logs.go:123] Gathering logs for coredns [0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a] ...

	I1226 21:47:49.385596  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a"

	I1226 21:47:49.470012  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:49.494852  703653 logs.go:123] Gathering logs for kubelet ...

	I1226 21:47:49.494954  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W1226 21:47:49.548364  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.432342    1365 reflector.go:535] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:49.549166  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.432378    1365 reflector.go:147] object-"default"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:49.549563  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.434011    1365 reflector.go:535] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:49.549818  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.434040    1365 reflector.go:147] object-"default"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:49.551333  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.447831    1365 reflector.go:535] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:47:49.551609  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.447865    1365 reflector.go:147] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:47:49.553338  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.510344    1365 reflector.go:535] object-"kube-system"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	W1226 21:47:49.553576  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.510378    1365 reflector.go:147] object-"kube-system"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	I1226 21:47:49.605108  703653 logs.go:123] Gathering logs for describe nodes ...

	I1226 21:47:49.605192  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I1226 21:47:49.830170  703653 logs.go:123] Gathering logs for kube-proxy [fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d] ...

	I1226 21:47:49.830254  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d"

	I1226 21:47:49.887319  703653 logs.go:123] Gathering logs for CRI-O ...

	I1226 21:47:49.887347  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"

	I1226 21:47:49.972589  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:50.005922  703653 out.go:309] Setting ErrFile to fd 2...

	I1226 21:47:50.005963  703653 out.go:343] TERM=,COLORTERM=, which probably does not support color

	W1226 21:47:50.006045  703653 out.go:239] X Problems detected in kubelet:

	W1226 21:47:50.006055  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.434040    1365 reflector.go:147] object-"default"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:47:50.006062  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.447831    1365 reflector.go:535] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:47:50.006073  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.447865    1365 reflector.go:147] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:47:50.006081  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.510344    1365 reflector.go:535] object-"kube-system"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	W1226 21:47:50.006087  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.510378    1365 reflector.go:147] object-"kube-system"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	I1226 21:47:50.006236  703653 out.go:309] Setting ErrFile to fd 2...

	I1226 21:47:50.006245  703653 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 21:47:50.469306  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:50.969161  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:51.469541  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:51.976072  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:52.468916  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:52.971505  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:53.471156  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:53.972400  703653 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1226 21:47:54.470053  703653 kapi.go:107] duration metric: took 1m29.506960429s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I1226 21:47:54.472743  703653 out.go:177] * Enabled addons: nvidia-device-plugin, storage-provisioner, cloud-spanner, default-storageclass, metrics-server, inspektor-gadget, ingress-dns, yakd, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver

	I1226 21:47:54.474676  703653 addons.go:508] enable addons completed in 1m36.704070199s: enabled=[nvidia-device-plugin storage-provisioner cloud-spanner default-storageclass metrics-server inspektor-gadget ingress-dns yakd volumesnapshots registry ingress gcp-auth csi-hostpath-driver]

	I1226 21:48:00.012117  703653 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...

	I1226 21:48:00.054028  703653 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:

	ok

	I1226 21:48:00.105602  703653 api_server.go:141] control plane version: v1.28.4

	I1226 21:48:00.105631  703653 api_server.go:131] duration metric: took 11.77228382s to wait for apiserver health ...

	I1226 21:48:00.105641  703653 system_pods.go:43] waiting for kube-system pods to appear ...

	I1226 21:48:00.105664  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I1226 21:48:00.105734  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I1226 21:48:00.205318  703653 cri.go:89] found id: "c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8"

	I1226 21:48:00.205391  703653 cri.go:89] found id: ""

	I1226 21:48:00.205415  703653 logs.go:284] 1 containers: [c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8]

	I1226 21:48:00.205524  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:48:00.215039  703653 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I1226 21:48:00.215144  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I1226 21:48:00.324722  703653 cri.go:89] found id: "a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a"

	I1226 21:48:00.324761  703653 cri.go:89] found id: ""

	I1226 21:48:00.324771  703653 logs.go:284] 1 containers: [a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a]

	I1226 21:48:00.324844  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:48:00.334077  703653 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I1226 21:48:00.334167  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I1226 21:48:00.430622  703653 cri.go:89] found id: "0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a"

	I1226 21:48:00.430677  703653 cri.go:89] found id: ""

	I1226 21:48:00.430686  703653 logs.go:284] 1 containers: [0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a]

	I1226 21:48:00.430760  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:48:00.436429  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I1226 21:48:00.436554  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I1226 21:48:00.495777  703653 cri.go:89] found id: "a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43"

	I1226 21:48:00.495803  703653 cri.go:89] found id: ""

	I1226 21:48:00.495812  703653 logs.go:284] 1 containers: [a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43]

	I1226 21:48:00.495875  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:48:00.501338  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I1226 21:48:00.501419  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I1226 21:48:00.552860  703653 cri.go:89] found id: "fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d"

	I1226 21:48:00.552885  703653 cri.go:89] found id: ""

	I1226 21:48:00.552895  703653 logs.go:284] 1 containers: [fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d]

	I1226 21:48:00.552952  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:48:00.558338  703653 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I1226 21:48:00.558413  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I1226 21:48:00.612356  703653 cri.go:89] found id: "5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee"

	I1226 21:48:00.612377  703653 cri.go:89] found id: ""

	I1226 21:48:00.612385  703653 logs.go:284] 1 containers: [5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee]

	I1226 21:48:00.612449  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:48:00.619281  703653 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I1226 21:48:00.619395  703653 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I1226 21:48:00.662127  703653 cri.go:89] found id: "5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445"

	I1226 21:48:00.662151  703653 cri.go:89] found id: ""

	I1226 21:48:00.662159  703653 logs.go:284] 1 containers: [5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445]

	I1226 21:48:00.662229  703653 ssh_runner.go:195] Run: which crictl

	I1226 21:48:00.667001  703653 logs.go:123] Gathering logs for kubelet ...

	I1226 21:48:00.667025  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W1226 21:48:00.702904  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.432342    1365 reflector.go:535] object-"default"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:48:00.703173  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.432378    1365 reflector.go:147] object-"default"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:48:00.703487  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.434011    1365 reflector.go:535] object-"default"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:48:00.703673  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.434040    1365 reflector.go:147] object-"default"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:48:00.705704  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.447831    1365 reflector.go:535] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:48:00.705960  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.447865    1365 reflector.go:147] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:48:00.707327  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.510344    1365 reflector.go:535] object-"kube-system"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	W1226 21:48:00.707535  703653 logs.go:138] Found kubelet problem: Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.510378    1365 reflector.go:147] object-"kube-system"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	I1226 21:48:00.754783  703653 logs.go:123] Gathering logs for describe nodes ...

	I1226 21:48:00.754810  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I1226 21:48:00.898722  703653 logs.go:123] Gathering logs for coredns [0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a] ...

	I1226 21:48:00.898807  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a"

	I1226 21:48:00.944475  703653 logs.go:123] Gathering logs for kube-scheduler [a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43] ...

	I1226 21:48:00.944507  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43"

	I1226 21:48:00.998551  703653 logs.go:123] Gathering logs for kindnet [5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445] ...

	I1226 21:48:00.998580  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445"

	I1226 21:48:01.044214  703653 logs.go:123] Gathering logs for CRI-O ...

	I1226 21:48:01.044242  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"

	I1226 21:48:01.140135  703653 logs.go:123] Gathering logs for container status ...

	I1226 21:48:01.140173  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1226 21:48:01.217748  703653 logs.go:123] Gathering logs for dmesg ...

	I1226 21:48:01.217781  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1226 21:48:01.240763  703653 logs.go:123] Gathering logs for kube-apiserver [c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8] ...

	I1226 21:48:01.240795  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8"

	I1226 21:48:01.318123  703653 logs.go:123] Gathering logs for etcd [a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a] ...

	I1226 21:48:01.318163  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a"

	I1226 21:48:01.403342  703653 logs.go:123] Gathering logs for kube-proxy [fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d] ...

	I1226 21:48:01.403377  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d"

	I1226 21:48:01.445673  703653 logs.go:123] Gathering logs for kube-controller-manager [5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee] ...

	I1226 21:48:01.445704  703653 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee"

	I1226 21:48:01.544040  703653 out.go:309] Setting ErrFile to fd 2...

	I1226 21:48:01.544074  703653 out.go:343] TERM=,COLORTERM=, which probably does not support color

	W1226 21:48:01.544133  703653 out.go:239] X Problems detected in kubelet:

	W1226 21:48:01.544145  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.434040    1365 reflector.go:147] object-"default"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "default": no relationship found between node 'addons-154736' and this object

	W1226 21:48:01.544153  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.447831    1365 reflector.go:535] object-"ingress-nginx"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:48:01.544165  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.447865    1365 reflector.go:147] object-"ingress-nginx"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-154736" cannot list resource "configmaps" in API group "" in the namespace "ingress-nginx": no relationship found between node 'addons-154736' and this object

	W1226 21:48:01.544171  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: W1226 21:46:52.510344    1365 reflector.go:535] object-"kube-system"/"gcp-auth": failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	W1226 21:48:01.544178  703653 out.go:239]   Dec 26 21:46:52 addons-154736 kubelet[1365]: E1226 21:46:52.510378    1365 reflector.go:147] object-"kube-system"/"gcp-auth": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth" is forbidden: User "system:node:addons-154736" cannot list resource "secrets" in API group "" in the namespace "kube-system": no relationship found between node 'addons-154736' and this object

	I1226 21:48:01.544187  703653 out.go:309] Setting ErrFile to fd 2...

	I1226 21:48:01.544193  703653 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 21:48:11.554926  703653 system_pods.go:59] 18 kube-system pods found

	I1226 21:48:11.554969  703653 system_pods.go:61] "coredns-5dd5756b68-gbz9g" [7756995c-c766-475d-9528-a269947fb962] Running

	I1226 21:48:11.554976  703653 system_pods.go:61] "csi-hostpath-attacher-0" [27b8fdc0-b1a5-4537-90ed-94f695dc725c] Running

	I1226 21:48:11.554981  703653 system_pods.go:61] "csi-hostpath-resizer-0" [12956ad9-043f-423a-a709-e31bcd813e2c] Running

	I1226 21:48:11.554987  703653 system_pods.go:61] "csi-hostpathplugin-6v6w7" [16d70f46-43bf-4ddd-84fa-27b4cb888c4d] Running

	I1226 21:48:11.554993  703653 system_pods.go:61] "etcd-addons-154736" [547ecee7-8f0e-4964-9a05-a236594fe216] Running

	I1226 21:48:11.554998  703653 system_pods.go:61] "kindnet-5jgmg" [eca9c6b5-b0b8-4bdc-adf8-082992994bf6] Running

	I1226 21:48:11.555010  703653 system_pods.go:61] "kube-apiserver-addons-154736" [34c16ef5-ca23-4cb1-bec3-39f588dca777] Running

	I1226 21:48:11.555016  703653 system_pods.go:61] "kube-controller-manager-addons-154736" [b82dbbab-8430-449d-bdc0-1958eaf7e227] Running

	I1226 21:48:11.555028  703653 system_pods.go:61] "kube-ingress-dns-minikube" [e6c2ffcd-377b-48c7-b5ca-3ac9d28f4f89] Running / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])

	I1226 21:48:11.555034  703653 system_pods.go:61] "kube-proxy-4r79z" [4d99dd25-dcc5-4774-9ed5-ad626aabfced] Running

	I1226 21:48:11.555050  703653 system_pods.go:61] "kube-scheduler-addons-154736" [6a9cd5cd-d4ac-42d2-a4c7-e14e0a947899] Running

	I1226 21:48:11.555058  703653 system_pods.go:61] "metrics-server-7c66d45ddc-pz8ht" [ff2fdb32-af66-480d-ad25-175b65c5b1d4] Running

	I1226 21:48:11.555066  703653 system_pods.go:61] "nvidia-device-plugin-daemonset-9xfxt" [74fad637-1854-48ce-b606-8a09c28e7cfe] Running

	I1226 21:48:11.555071  703653 system_pods.go:61] "registry-g2w98" [21fa161c-0f99-4fb5-9573-259bd78d21a5] Running

	I1226 21:48:11.555078  703653 system_pods.go:61] "registry-proxy-h7qrg" [274f34a4-99a0-4df2-8e40-73229ad88336] Running

	I1226 21:48:11.555083  703653 system_pods.go:61] "snapshot-controller-58dbcc7b99-rtlzb" [b1add7d4-2504-43e0-83c8-40fc2c220da7] Running

	I1226 21:48:11.555088  703653 system_pods.go:61] "snapshot-controller-58dbcc7b99-wl4bb" [a7f38ca6-3848-4c5b-a7a3-b01da5e90140] Running

	I1226 21:48:11.555092  703653 system_pods.go:61] "storage-provisioner" [f0bcfc9d-7cd8-489e-9d2f-49edc5ce7b5d] Running

	I1226 21:48:11.555099  703653 system_pods.go:74] duration metric: took 11.449451529s to wait for pod list to return data ...

	I1226 21:48:11.555111  703653 default_sa.go:34] waiting for default service account to be created ...

	I1226 21:48:11.557677  703653 default_sa.go:45] found service account: "default"

	I1226 21:48:11.557702  703653 default_sa.go:55] duration metric: took 2.583966ms for default service account to be created ...

	I1226 21:48:11.557712  703653 system_pods.go:116] waiting for k8s-apps to be running ...

	I1226 21:48:11.567787  703653 system_pods.go:86] 18 kube-system pods found

	I1226 21:48:11.567826  703653 system_pods.go:89] "coredns-5dd5756b68-gbz9g" [7756995c-c766-475d-9528-a269947fb962] Running

	I1226 21:48:11.567834  703653 system_pods.go:89] "csi-hostpath-attacher-0" [27b8fdc0-b1a5-4537-90ed-94f695dc725c] Running

	I1226 21:48:11.567840  703653 system_pods.go:89] "csi-hostpath-resizer-0" [12956ad9-043f-423a-a709-e31bcd813e2c] Running

	I1226 21:48:11.567846  703653 system_pods.go:89] "csi-hostpathplugin-6v6w7" [16d70f46-43bf-4ddd-84fa-27b4cb888c4d] Running

	I1226 21:48:11.567851  703653 system_pods.go:89] "etcd-addons-154736" [547ecee7-8f0e-4964-9a05-a236594fe216] Running

	I1226 21:48:11.567856  703653 system_pods.go:89] "kindnet-5jgmg" [eca9c6b5-b0b8-4bdc-adf8-082992994bf6] Running

	I1226 21:48:11.567860  703653 system_pods.go:89] "kube-apiserver-addons-154736" [34c16ef5-ca23-4cb1-bec3-39f588dca777] Running

	I1226 21:48:11.567867  703653 system_pods.go:89] "kube-controller-manager-addons-154736" [b82dbbab-8430-449d-bdc0-1958eaf7e227] Running

	I1226 21:48:11.567876  703653 system_pods.go:89] "kube-ingress-dns-minikube" [e6c2ffcd-377b-48c7-b5ca-3ac9d28f4f89] Running / Ready:ContainersNotReady (containers with unready status: [minikube-ingress-dns]) / ContainersReady:ContainersNotReady (containers with unready status: [minikube-ingress-dns])

	I1226 21:48:11.567890  703653 system_pods.go:89] "kube-proxy-4r79z" [4d99dd25-dcc5-4774-9ed5-ad626aabfced] Running

	I1226 21:48:11.567899  703653 system_pods.go:89] "kube-scheduler-addons-154736" [6a9cd5cd-d4ac-42d2-a4c7-e14e0a947899] Running

	I1226 21:48:11.567904  703653 system_pods.go:89] "metrics-server-7c66d45ddc-pz8ht" [ff2fdb32-af66-480d-ad25-175b65c5b1d4] Running

	I1226 21:48:11.567910  703653 system_pods.go:89] "nvidia-device-plugin-daemonset-9xfxt" [74fad637-1854-48ce-b606-8a09c28e7cfe] Running

	I1226 21:48:11.567917  703653 system_pods.go:89] "registry-g2w98" [21fa161c-0f99-4fb5-9573-259bd78d21a5] Running

	I1226 21:48:11.567922  703653 system_pods.go:89] "registry-proxy-h7qrg" [274f34a4-99a0-4df2-8e40-73229ad88336] Running

	I1226 21:48:11.567926  703653 system_pods.go:89] "snapshot-controller-58dbcc7b99-rtlzb" [b1add7d4-2504-43e0-83c8-40fc2c220da7] Running

	I1226 21:48:11.567931  703653 system_pods.go:89] "snapshot-controller-58dbcc7b99-wl4bb" [a7f38ca6-3848-4c5b-a7a3-b01da5e90140] Running

	I1226 21:48:11.567938  703653 system_pods.go:89] "storage-provisioner" [f0bcfc9d-7cd8-489e-9d2f-49edc5ce7b5d] Running

	I1226 21:48:11.567948  703653 system_pods.go:126] duration metric: took 10.227696ms to wait for k8s-apps to be running ...

	I1226 21:48:11.567960  703653 system_svc.go:44] waiting for kubelet service to be running ....

	I1226 21:48:11.568025  703653 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1226 21:48:11.582548  703653 system_svc.go:56] duration metric: took 14.580186ms WaitForService to wait for kubelet.

	I1226 21:48:11.582578  703653 kubeadm.go:581] duration metric: took 1m52.863172985s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I1226 21:48:11.582598  703653 node_conditions.go:102] verifying NodePressure condition ...

	I1226 21:48:11.586209  703653 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki

	I1226 21:48:11.586240  703653 node_conditions.go:123] node cpu capacity is 2

	I1226 21:48:11.586252  703653 node_conditions.go:105] duration metric: took 3.649229ms to run NodePressure ...

	I1226 21:48:11.586264  703653 start.go:228] waiting for startup goroutines ...

	I1226 21:48:11.586271  703653 start.go:233] waiting for cluster config update ...

	I1226 21:48:11.586284  703653 start.go:242] writing updated cluster config ...

	I1226 21:48:11.586574  703653 ssh_runner.go:195] Run: rm -f paused

	I1226 21:48:11.914611  703653 start.go:600] kubectl: 1.29.0, cluster: 1.28.4 (minor skew: 1)

	I1226 21:48:11.917788  703653 out.go:177] * Done! kubectl is now configured to use "addons-154736" cluster and "default" namespace by default

	==> CRI-O <==

	Dec 26 21:53:43 addons-154736 crio[897]: time="2023-12-26 21:53:43.487532624Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:8aea65d81da202cf886d7766c7f2691bb9e363c6b5d9b1f5d9ddaaa4bc1e90c2,RepoTags:[docker.io/library/nginx:latest],RepoDigests:[docker.io/library/nginx@sha256:2bdc49f2f8ae8d8dc50ed00f2ee56d00385c6f8bc8a8b320d0a294d9e3b49026 docker.io/library/nginx@sha256:73a06b3a2577448f9acc23502a0cb4d41919da9cc5035e66b0a9a09715397684],Size_:196113558,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=16e67bb6-6fbf-4776-bc2d-67c92fe5165b name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:53:52 addons-154736 crio[897]: time="2023-12-26 21:53:52.758704805Z" level=info msg="Pulling image: docker.io/nginx:latest" id=7dd9cd94-aa7d-437e-abf2-6faa8b56b5a3 name=/runtime.v1.ImageService/PullImage

	Dec 26 21:53:52 addons-154736 crio[897]: time="2023-12-26 21:53:52.760756828Z" level=info msg="Trying to access \"docker.io/library/nginx:latest\""

	Dec 26 21:54:06 addons-154736 crio[897]: time="2023-12-26 21:54:06.486984628Z" level=info msg="Checking image status: docker.io/nginx:alpine" id=e704ba1b-c62e-4221-af92-e4df8353b5af name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:54:06 addons-154736 crio[897]: time="2023-12-26 21:54:06.487201395Z" level=info msg="Image docker.io/nginx:alpine not found" id=e704ba1b-c62e-4221-af92-e4df8353b5af name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:54:17 addons-154736 crio[897]: time="2023-12-26 21:54:17.488097398Z" level=info msg="Checking image status: docker.io/nginx:alpine" id=f9df838f-cb13-4622-958a-2ab56fd30a07 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:54:17 addons-154736 crio[897]: time="2023-12-26 21:54:17.488313352Z" level=info msg="Image docker.io/nginx:alpine not found" id=f9df838f-cb13-4622-958a-2ab56fd30a07 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:54:28 addons-154736 crio[897]: time="2023-12-26 21:54:28.487097872Z" level=info msg="Checking image status: docker.io/nginx:alpine" id=6bdb7b09-1849-4bb8-8fe8-e51afa4d72d2 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:54:28 addons-154736 crio[897]: time="2023-12-26 21:54:28.488375684Z" level=info msg="Image docker.io/nginx:alpine not found" id=6bdb7b09-1849-4bb8-8fe8-e51afa4d72d2 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:54:41 addons-154736 crio[897]: time="2023-12-26 21:54:41.486597003Z" level=info msg="Checking image status: docker.io/nginx:alpine" id=e6d9ed5d-9835-468b-9a97-89908f9f1621 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:54:41 addons-154736 crio[897]: time="2023-12-26 21:54:41.486828530Z" level=info msg="Image docker.io/nginx:alpine not found" id=e6d9ed5d-9835-468b-9a97-89908f9f1621 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:54:51 addons-154736 crio[897]: time="2023-12-26 21:54:51.487578819Z" level=info msg="Checking image status: docker.io/nginx:latest" id=12f6f416-119b-41c3-ba72-b9464e19093f name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:54:51 addons-154736 crio[897]: time="2023-12-26 21:54:51.487853471Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:8aea65d81da202cf886d7766c7f2691bb9e363c6b5d9b1f5d9ddaaa4bc1e90c2,RepoTags:[docker.io/library/nginx:latest],RepoDigests:[docker.io/library/nginx@sha256:2bdc49f2f8ae8d8dc50ed00f2ee56d00385c6f8bc8a8b320d0a294d9e3b49026 docker.io/library/nginx@sha256:73a06b3a2577448f9acc23502a0cb4d41919da9cc5035e66b0a9a09715397684],Size_:196113558,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=12f6f416-119b-41c3-ba72-b9464e19093f name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:54:52 addons-154736 crio[897]: time="2023-12-26 21:54:52.486672703Z" level=info msg="Checking image status: docker.io/nginx:alpine" id=01debe37-2c88-41c3-9649-cec2d88a53ca name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:54:52 addons-154736 crio[897]: time="2023-12-26 21:54:52.486965537Z" level=info msg="Image docker.io/nginx:alpine not found" id=01debe37-2c88-41c3-9649-cec2d88a53ca name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:55:03 addons-154736 crio[897]: time="2023-12-26 21:55:03.487143241Z" level=info msg="Checking image status: docker.io/nginx:alpine" id=902100ef-ed7b-4b11-b3f9-8c2081f88b1d name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:55:03 addons-154736 crio[897]: time="2023-12-26 21:55:03.487387634Z" level=info msg="Image docker.io/nginx:alpine not found" id=902100ef-ed7b-4b11-b3f9-8c2081f88b1d name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:55:03 addons-154736 crio[897]: time="2023-12-26 21:55:03.487481974Z" level=info msg="Checking image status: docker.io/nginx:latest" id=b7dc9222-2082-4b22-b3b3-0af48eb1a400 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:55:03 addons-154736 crio[897]: time="2023-12-26 21:55:03.487626873Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:8aea65d81da202cf886d7766c7f2691bb9e363c6b5d9b1f5d9ddaaa4bc1e90c2,RepoTags:[docker.io/library/nginx:latest],RepoDigests:[docker.io/library/nginx@sha256:2bdc49f2f8ae8d8dc50ed00f2ee56d00385c6f8bc8a8b320d0a294d9e3b49026 docker.io/library/nginx@sha256:73a06b3a2577448f9acc23502a0cb4d41919da9cc5035e66b0a9a09715397684],Size_:196113558,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=b7dc9222-2082-4b22-b3b3-0af48eb1a400 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:55:17 addons-154736 crio[897]: time="2023-12-26 21:55:17.487311218Z" level=info msg="Checking image status: docker.io/nginx:latest" id=82c8cc32-51dd-4087-9ae1-e38497591088 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:55:17 addons-154736 crio[897]: time="2023-12-26 21:55:17.487583006Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:8aea65d81da202cf886d7766c7f2691bb9e363c6b5d9b1f5d9ddaaa4bc1e90c2,RepoTags:[docker.io/library/nginx:latest],RepoDigests:[docker.io/library/nginx@sha256:2bdc49f2f8ae8d8dc50ed00f2ee56d00385c6f8bc8a8b320d0a294d9e3b49026 docker.io/library/nginx@sha256:73a06b3a2577448f9acc23502a0cb4d41919da9cc5035e66b0a9a09715397684],Size_:196113558,Uid:nil,Username:,Spec:nil,},Info:map[string]string{},}" id=82c8cc32-51dd-4087-9ae1-e38497591088 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:55:18 addons-154736 crio[897]: time="2023-12-26 21:55:18.486186569Z" level=info msg="Checking image status: docker.io/nginx:alpine" id=f7bdba2b-2092-4536-8063-cd1d2f8579f0 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:55:18 addons-154736 crio[897]: time="2023-12-26 21:55:18.486405855Z" level=info msg="Image docker.io/nginx:alpine not found" id=f7bdba2b-2092-4536-8063-cd1d2f8579f0 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 21:55:18 addons-154736 crio[897]: time="2023-12-26 21:55:18.487300521Z" level=info msg="Pulling image: docker.io/nginx:alpine" id=2cc72c56-db56-4a69-b1ab-1dd3fe583efc name=/runtime.v1.ImageService/PullImage

	Dec 26 21:55:18 addons-154736 crio[897]: time="2023-12-26 21:55:18.489340885Z" level=info msg="Trying to access \"docker.io/library/nginx:alpine\""

	==> container status <==

	CONTAINER           IMAGE                                                                                                                                        CREATED             STATE               NAME                                     ATTEMPT             POD ID              POD

	5fe6705eae1fb       1499ed4fbd0aa6ea742ab6bce25603aa33556e1ac0e2f24a4901a675247e538a                                                                             2 minutes ago       Exited              minikube-ingress-dns                     6                   01202b99ec6d0       kube-ingress-dns-minikube

	abb80e1df162f       ghcr.io/headlamp-k8s/headlamp@sha256:0fe50c48c186b89ff3d341dba427174d8232a64c3062af5de854a3a7cb2105ce                                        7 minutes ago       Running             headlamp                                 0                   7ca1bd6e6c1a2       headlamp-7ddfbb94ff-qntlc

	d649a08406e0b       registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f                          7 minutes ago       Running             csi-snapshotter                          0                   9824742ac2b4d       csi-hostpathplugin-6v6w7

	a2e9c531dfae6       registry.k8s.io/sig-storage/csi-provisioner@sha256:98ffd09c0784203d200e0f8c241501de31c8df79644caac7eed61bd6391e5d49                          7 minutes ago       Running             csi-provisioner                          0                   9824742ac2b4d       csi-hostpathplugin-6v6w7

	c46e1aaf747f5       registry.k8s.io/sig-storage/livenessprobe@sha256:8b00c6e8f52639ed9c6f866085893ab688e57879741b3089e3cfa9998502e158                            7 minutes ago       Running             liveness-probe                           0                   9824742ac2b4d       csi-hostpathplugin-6v6w7

	5736264be5277       registry.k8s.io/sig-storage/hostpathplugin@sha256:7b1dfc90a367222067fc468442fdf952e20fc5961f25c1ad654300ddc34d7083                           7 minutes ago       Running             hostpath                                 0                   9824742ac2b4d       csi-hostpathplugin-6v6w7

	426fb5db606fa       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:63b520448091bc94aa4dba00d6b3b3c25e410c4fb73aa46feae5b25f9895abaa                                 7 minutes ago       Running             gcp-auth                                 0                   9bd4cf657b01b       gcp-auth-d4c87556c-c9kbx

	165279e6203ce       registry.k8s.io/ingress-nginx/controller@sha256:1ca66aa9f7f8fdecbecc88e4b89f0f4e7a1f1e952d0d5e52df2524e526259f6b                             7 minutes ago       Running             controller                               0                   4a0fbbb610f9c       ingress-nginx-controller-69cff4fd79-rqdlh

	c9f32bcae8b00       registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:511b8c8ac828194a753909d26555ff08bc12f497dd8daeb83fe9d593693a26c1                7 minutes ago       Running             node-driver-registrar                    0                   9824742ac2b4d       csi-hostpathplugin-6v6w7

	b684e7784c70e       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:67202a0258c6f81d073f265f449a732c89cc1112a8e80ea27317294df6dce2b5                   7 minutes ago       Exited              patch                                    0                   4ea53d7234716       ingress-nginx-admission-patch-gwrdr

	af22d1e4dbcc7       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:67202a0258c6f81d073f265f449a732c89cc1112a8e80ea27317294df6dce2b5                   8 minutes ago       Exited              create                                   0                   d92ec2169085e       ingress-nginx-admission-create-jtzt2

	1bc6c433ebb20       registry.k8s.io/sig-storage/csi-external-health-monitor-controller@sha256:80b9ba94aa2afe24553d69bd165a6a51552d1582d68618ec00d3b804a7d9193c   8 minutes ago       Running             csi-external-health-monitor-controller   0                   9824742ac2b4d       csi-hostpathplugin-6v6w7

	9ebfe5e4c3c95       registry.k8s.io/sig-storage/csi-attacher@sha256:4b5609c78455de45821910065281a368d5f760b41250f90cbde5110543bdc326                             8 minutes ago       Running             csi-attacher                             0                   6403bae626ef6       csi-hostpath-attacher-0

	de059b46043d6       registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7                              8 minutes ago       Running             csi-resizer                              0                   95e515ab13810       csi-hostpath-resizer-0

	7d0d63bb665e8       docker.io/rancher/local-path-provisioner@sha256:689a2489a24e74426e4a4666e611c988202c5fa995908b0c60133aca3eb87d98                             8 minutes ago       Running             local-path-provisioner                   0                   3c9b34a725c2d       local-path-provisioner-78b46b4d5c-nwr5l

	ce1e295decd3a       registry.k8s.io/sig-storage/snapshot-controller@sha256:5d668e35c15df6e87e2530da25d557f543182cedbdb39d421b87076463ee9857                      8 minutes ago       Running             volume-snapshot-controller               0                   01b7c76bc0451       snapshot-controller-58dbcc7b99-wl4bb

	8716dbfa389d1       registry.k8s.io/sig-storage/snapshot-controller@sha256:5d668e35c15df6e87e2530da25d557f543182cedbdb39d421b87076463ee9857                      8 minutes ago       Running             volume-snapshot-controller               0                   d160ae65c8530       snapshot-controller-58dbcc7b99-rtlzb

	aea4da7d2eeb6       docker.io/marcnuri/yakd@sha256:a3f540278e4c11373e15605311851dd9c64d208f4d63e727bccc0e39f9329310                                              8 minutes ago       Running             yakd                                     0                   4f2b49cd1d1cc       yakd-dashboard-9947fc6bf-5ggjq

	2ca195417d20c       ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6                                                                             8 minutes ago       Running             storage-provisioner                      0                   c3b7a1e4b36d7       storage-provisioner

	0b9784687fdf8       97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108                                                                             8 minutes ago       Running             coredns                                  0                   eb0ca42f98aa6       coredns-5dd5756b68-gbz9g

	fc7c1d4cc434f       3ca3ca488cf13fde14cfc4b3ffde0c53a8c161b030f4a444a797fba6aef38c39                                                                             9 minutes ago       Running             kube-proxy                               0                   ecfe1e6ef509b       kube-proxy-4r79z

	5f14597475dee       04b4eaa3d3db8abea4b9ea4d10a0926ebb31db5a31b673aa1cf7a4b3af4add26                                                                             9 minutes ago       Running             kindnet-cni                              0                   9ab992efa85d9       kindnet-5jgmg

	c5b1b0ac08cda       04b4c447bb9d4840af3bf7e836397379d65df87c86e55dcd27f31a8d11df2419                                                                             9 minutes ago       Running             kube-apiserver                           0                   931df03571461       kube-apiserver-addons-154736

	5f4d17cd1a759       9961cbceaf234d59b7dcf8a197a024f3e3ce4b7fe2b67c2378efd3d209ca994b                                                                             9 minutes ago       Running             kube-controller-manager                  0                   2627c20b7662e       kube-controller-manager-addons-154736

	a1a3df534703e       05c284c929889d88306fdb3dd14ee2d0132543740f9e247685243214fc3d2c54                                                                             9 minutes ago       Running             kube-scheduler                           0                   ec5babc1f5d4e       kube-scheduler-addons-154736

	a00bf48419309       9cdd6470f48c8b127530b7ce6ea4b3524137984481e48bcde619735890840ace                                                                             9 minutes ago       Running             etcd                                     0                   7d1113e33d739       etcd-addons-154736

	==> coredns [0b9784687fdf8249ef1817273d553c0e4539fdc99e2ed4e51e1e88341426888a] <==

	[INFO] 10.244.0.17:56311 - 15111 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.002393906s

	[INFO] 10.244.0.17:51530 - 56241 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000175454s

	[INFO] 10.244.0.17:51530 - 12478 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000167824s

	[INFO] 10.244.0.17:39191 - 1431 "AAAA IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000152177s

	[INFO] 10.244.0.17:39191 - 26810 "A IN registry.kube-system.svc.cluster.local.kube-system.svc.cluster.local. udp 86 false 512" NXDOMAIN qr,aa,rd 179 0.000257677s

	[INFO] 10.244.0.17:48634 - 5977 "AAAA IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000094922s

	[INFO] 10.244.0.17:48634 - 31128 "A IN registry.kube-system.svc.cluster.local.svc.cluster.local. udp 74 false 512" NXDOMAIN qr,aa,rd 167 0.000201201s

	[INFO] 10.244.0.17:42129 - 3593 "AAAA IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000112933s

	[INFO] 10.244.0.17:42129 - 27143 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000175676s

	[INFO] 10.244.0.17:38550 - 52237 "AAAA IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001772128s

	[INFO] 10.244.0.17:38550 - 50184 "A IN registry.kube-system.svc.cluster.local.us-east-2.compute.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.001680774s

	[INFO] 10.244.0.17:43293 - 31812 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000078431s

	[INFO] 10.244.0.17:43293 - 9529 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000118701s

	[INFO] 10.244.0.20:60042 - 54775 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000264445s

	[INFO] 10.244.0.20:36194 - 51775 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.00017314s

	[INFO] 10.244.0.20:34311 - 42203 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000161137s

	[INFO] 10.244.0.20:47094 - 4881 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.00011441s

	[INFO] 10.244.0.20:40589 - 5895 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000281774s

	[INFO] 10.244.0.20:42712 - 53585 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000328559s

	[INFO] 10.244.0.20:45825 - 51530 "A IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002334691s

	[INFO] 10.244.0.20:60259 - 40603 "AAAA IN storage.googleapis.com.us-east-2.compute.internal. udp 78 false 1232" NXDOMAIN qr,rd,ra 67 0.002397369s

	[INFO] 10.244.0.20:47110 - 43627 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.000740267s

	[INFO] 10.244.0.20:50917 - 58925 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 344 0.004757339s

	[INFO] 10.244.0.22:47955 - 2 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000184398s

	[INFO] 10.244.0.22:42660 - 3 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000128588s

	==> describe nodes <==

	Name:               addons-154736

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=addons-154736

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=393f165ced08f66e4386491f243850f87982a22b

	                    minikube.k8s.io/name=addons-154736

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_12_26T21_46_05_0700

	                    minikube.k8s.io/version=v1.32.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	                    topology.hostpath.csi/node=addons-154736

	Annotations:        csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-154736"}

	                    kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Tue, 26 Dec 2023 21:46:01 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  addons-154736

	  AcquireTime:     <unset>

	  RenewTime:       Tue, 26 Dec 2023 21:55:17 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Tue, 26 Dec 2023 21:54:13 +0000   Tue, 26 Dec 2023 21:45:58 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Tue, 26 Dec 2023 21:54:13 +0000   Tue, 26 Dec 2023 21:45:58 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Tue, 26 Dec 2023 21:54:13 +0000   Tue, 26 Dec 2023 21:45:58 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Tue, 26 Dec 2023 21:54:13 +0000   Tue, 26 Dec 2023 21:46:52 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.49.2

	  Hostname:    addons-154736

	Capacity:

	  cpu:                2

	  ephemeral-storage:  203034800Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             8022496Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  203034800Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             8022496Ki

	  pods:               110

	System Info:

	  Machine ID:                 cfc7b39add434585b250c10345c20f17

	  System UUID:                04713493-cfac-4455-8894-dae1076e6bc4

	  Boot ID:                    f8f887b2-8c20-433d-a967-90e814370f09

	  Kernel Version:             5.15.0-1051-aws

	  OS Image:                   Ubuntu 22.04.3 LTS

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  cri-o://1.24.6

	  Kubelet Version:            v1.28.4

	  Kube-Proxy Version:         v1.28.4

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (21 in total)

	  Namespace                   Name                                         CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                         ------------  ----------  ---------------  -------------  ---

	  default                     nginx                                        0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m22s

	  default                     task-pv-pod-restore                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m2s

	  gcp-auth                    gcp-auth-d4c87556c-c9kbx                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m53s

	  headlamp                    headlamp-7ddfbb94ff-qntlc                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m8s

	  ingress-nginx               ingress-nginx-controller-69cff4fd79-rqdlh    100m (5%!)(MISSING)     0 (0%!)(MISSING)      90Mi (1%!)(MISSING)        0 (0%!)(MISSING)         8m57s

	  kube-system                 coredns-5dd5756b68-gbz9g                     100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     9m1s

	  kube-system                 csi-hostpath-attacher-0                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m57s

	  kube-system                 csi-hostpath-resizer-0                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m57s

	  kube-system                 csi-hostpathplugin-6v6w7                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m29s

	  kube-system                 etcd-addons-154736                           100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         9m17s

	  kube-system                 kindnet-5jgmg                                100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      9m3s

	  kube-system                 kube-apiserver-addons-154736                 250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m17s

	  kube-system                 kube-controller-manager-addons-154736        200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m17s

	  kube-system                 kube-ingress-dns-minikube                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m58s

	  kube-system                 kube-proxy-4r79z                             0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m3s

	  kube-system                 kube-scheduler-addons-154736                 100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m17s

	  kube-system                 snapshot-controller-58dbcc7b99-rtlzb         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m57s

	  kube-system                 snapshot-controller-58dbcc7b99-wl4bb         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m57s

	  kube-system                 storage-provisioner                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m58s

	  local-path-storage          local-path-provisioner-78b46b4d5c-nwr5l      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m58s

	  yakd-dashboard              yakd-dashboard-9947fc6bf-5ggjq               0 (0%!)(MISSING)        0 (0%!)(MISSING)      128Mi (1%!)(MISSING)       256Mi (3%!)(MISSING)     8m57s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                950m (47%!)(MISSING)  100m (5%!)(MISSING)

	  memory             438Mi (5%!)(MISSING)  476Mi (6%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age    From             Message

	  ----    ------                   ----   ----             -------

	  Normal  Starting                 8m57s  kube-proxy       

	  Normal  Starting                 9m17s  kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  9m17s  kubelet          Node addons-154736 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    9m17s  kubelet          Node addons-154736 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     9m17s  kubelet          Node addons-154736 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           9m4s   node-controller  Node addons-154736 event: Registered Node addons-154736 in Controller

	  Normal  NodeReady                8m29s  kubelet          Node addons-154736 status is now: NodeReady

	==> dmesg <==

	[  +0.001114] FS-Cache: O-key=[8] '635f3b0000000000'

	[  +0.000763] FS-Cache: N-cookie c=00000030 [p=00000027 fl=2 nc=0 na=1]

	[  +0.001031] FS-Cache: N-cookie d=00000000b9607d6a{9p.inode} n=000000000db3c1b7

	[  +0.001157] FS-Cache: N-key=[8] '635f3b0000000000'

	[  +0.002874] FS-Cache: Duplicate cookie detected

	[  +0.000764] FS-Cache: O-cookie c=0000002a [p=00000027 fl=226 nc=0 na=1]

	[  +0.001117] FS-Cache: O-cookie d=00000000b9607d6a{9p.inode} n=000000007ac7c815

	[  +0.001084] FS-Cache: O-key=[8] '635f3b0000000000'

	[  +0.000742] FS-Cache: N-cookie c=00000031 [p=00000027 fl=2 nc=0 na=1]

	[  +0.001038] FS-Cache: N-cookie d=00000000b9607d6a{9p.inode} n=00000000328509c1

	[  +0.001125] FS-Cache: N-key=[8] '635f3b0000000000'

	[  +2.220713] FS-Cache: Duplicate cookie detected

	[  +0.000749] FS-Cache: O-cookie c=00000028 [p=00000027 fl=226 nc=0 na=1]

	[  +0.001122] FS-Cache: O-cookie d=00000000b9607d6a{9p.inode} n=00000000ebeba0e0

	[  +0.001200] FS-Cache: O-key=[8] '615f3b0000000000'

	[  +0.000765] FS-Cache: N-cookie c=00000033 [p=00000027 fl=2 nc=0 na=1]

	[  +0.000989] FS-Cache: N-cookie d=00000000b9607d6a{9p.inode} n=000000008353ea7f

	[  +0.001072] FS-Cache: N-key=[8] '615f3b0000000000'

	[  +0.309997] FS-Cache: Duplicate cookie detected

	[  +0.000749] FS-Cache: O-cookie c=0000002d [p=00000027 fl=226 nc=0 na=1]

	[  +0.001114] FS-Cache: O-cookie d=00000000b9607d6a{9p.inode} n=00000000e02b88cc

	[  +0.001198] FS-Cache: O-key=[8] '695f3b0000000000'

	[  +0.000739] FS-Cache: N-cookie c=00000034 [p=00000027 fl=2 nc=0 na=1]

	[  +0.001020] FS-Cache: N-cookie d=00000000b9607d6a{9p.inode} n=000000000db3c1b7

	[  +0.001131] FS-Cache: N-key=[8] '695f3b0000000000'

	==> etcd [a00bf48419309758b7753801eeea631f219e76d965d7b323f5e9abc71c187c1a] <==

	{"level":"warn","ts":"2023-12-26T21:46:19.422447Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"149.411853ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2023-12-26T21:46:19.423272Z","caller":"traceutil/trace.go:171","msg":"trace[751642578] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:340; }","duration":"150.325784ms","start":"2023-12-26T21:46:19.27293Z","end":"2023-12-26T21:46:19.423256Z","steps":["trace[751642578] 'agreement among raft nodes before linearized reading'  (duration: 149.376071ms)"],"step_count":1}

	{"level":"warn","ts":"2023-12-26T21:46:19.434917Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"153.18153ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-public/\" range_end:\"/registry/serviceaccounts/kube-public0\" ","response":"range_response_count:1 size:179"}

	{"level":"info","ts":"2023-12-26T21:46:19.449152Z","caller":"traceutil/trace.go:171","msg":"trace[612606180] range","detail":"{range_begin:/registry/serviceaccounts/kube-public/; range_end:/registry/serviceaccounts/kube-public0; response_count:1; response_revision:340; }","duration":"167.415706ms","start":"2023-12-26T21:46:19.281716Z","end":"2023-12-26T21:46:19.449131Z","steps":["trace[612606180] 'agreement among raft nodes before linearized reading'  (duration: 153.1419ms)"],"step_count":1}

	{"level":"warn","ts":"2023-12-26T21:46:19.435203Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"153.620929ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/kube-proxy\" ","response":"range_response_count:1 size:185"}

	{"level":"info","ts":"2023-12-26T21:46:19.450364Z","caller":"traceutil/trace.go:171","msg":"trace[1514450604] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/kube-proxy; range_end:; response_count:1; response_revision:340; }","duration":"168.7533ms","start":"2023-12-26T21:46:19.281574Z","end":"2023-12-26T21:46:19.450327Z","steps":["trace[1514450604] 'agreement among raft nodes before linearized reading'  (duration: 153.599177ms)"],"step_count":1}

	{"level":"warn","ts":"2023-12-26T21:46:19.435236Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"153.87264ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/kube-system/replicaset-controller\" ","response":"range_response_count:1 size:207"}

	{"level":"info","ts":"2023-12-26T21:46:19.450684Z","caller":"traceutil/trace.go:171","msg":"trace[844122797] range","detail":"{range_begin:/registry/serviceaccounts/kube-system/replicaset-controller; range_end:; response_count:1; response_revision:340; }","duration":"169.314879ms","start":"2023-12-26T21:46:19.28136Z","end":"2023-12-26T21:46:19.450675Z","steps":["trace[844122797] 'agreement among raft nodes before linearized reading'  (duration: 153.860891ms)"],"step_count":1}

	{"level":"warn","ts":"2023-12-26T21:46:22.668146Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"232.19351ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/minions/addons-154736\" ","response":"range_response_count:1 size:5743"}

	{"level":"info","ts":"2023-12-26T21:46:22.673597Z","caller":"traceutil/trace.go:171","msg":"trace[511291353] range","detail":"{range_begin:/registry/minions/addons-154736; range_end:; response_count:1; response_revision:378; }","duration":"237.638785ms","start":"2023-12-26T21:46:22.435901Z","end":"2023-12-26T21:46:22.673539Z","steps":["trace[511291353] 'agreement among raft nodes before linearized reading'  (duration: 36.731458ms)","trace[511291353] 'range keys from in-memory index tree'  (duration: 195.457558ms)"],"step_count":2}

	{"level":"warn","ts":"2023-12-26T21:46:22.673853Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"201.04778ms","expected-duration":"100ms","prefix":"","request":"header:<ID:8128026081072486522 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/daemonsets/kube-system/nvidia-device-plugin-daemonset\" mod_revision:363 > success:<request_put:<key:\"/registry/daemonsets/kube-system/nvidia-device-plugin-daemonset\" value_size:3174 >> failure:<request_range:<key:\"/registry/daemonsets/kube-system/nvidia-device-plugin-daemonset\" > >>","response":"size:16"}

	{"level":"info","ts":"2023-12-26T21:46:22.673947Z","caller":"traceutil/trace.go:171","msg":"trace[1935977781] linearizableReadLoop","detail":"{readStateIndex:388; appliedIndex:387; }","duration":"201.322071ms","start":"2023-12-26T21:46:22.472609Z","end":"2023-12-26T21:46:22.673932Z","steps":["trace[1935977781] 'read index received'  (duration: 419.797µs)","trace[1935977781] 'applied index is now lower than readState.Index'  (duration: 200.901019ms)"],"step_count":2}

	{"level":"info","ts":"2023-12-26T21:46:22.674917Z","caller":"traceutil/trace.go:171","msg":"trace[231094946] transaction","detail":"{read_only:false; response_revision:379; number_of_response:1; }","duration":"238.601307ms","start":"2023-12-26T21:46:22.436303Z","end":"2023-12-26T21:46:22.674904Z","steps":["trace[231094946] 'process raft request'  (duration: 36.42707ms)","trace[231094946] 'compare'  (duration: 194.925385ms)"],"step_count":2}

	{"level":"warn","ts":"2023-12-26T21:46:22.679418Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"243.401262ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/resourcequotas/local-path-storage/\" range_end:\"/registry/resourcequotas/local-path-storage0\" ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2023-12-26T21:46:22.685778Z","caller":"traceutil/trace.go:171","msg":"trace[1635112425] range","detail":"{range_begin:/registry/resourcequotas/local-path-storage/; range_end:/registry/resourcequotas/local-path-storage0; response_count:0; response_revision:379; }","duration":"249.765309ms","start":"2023-12-26T21:46:22.435992Z","end":"2023-12-26T21:46:22.685757Z","steps":["trace[1635112425] 'agreement among raft nodes before linearized reading'  (duration: 238.070382ms)"],"step_count":1}

	{"level":"warn","ts":"2023-12-26T21:46:22.687437Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"251.139407ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/limitranges/default/\" range_end:\"/registry/limitranges/default0\" ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2023-12-26T21:46:22.692198Z","caller":"traceutil/trace.go:171","msg":"trace[1516003958] range","detail":"{range_begin:/registry/limitranges/default/; range_end:/registry/limitranges/default0; response_count:0; response_revision:379; }","duration":"255.897058ms","start":"2023-12-26T21:46:22.43628Z","end":"2023-12-26T21:46:22.692177Z","steps":["trace[1516003958] 'agreement among raft nodes before linearized reading'  (duration: 237.777523ms)"],"step_count":1}

	{"level":"warn","ts":"2023-12-26T21:46:22.693456Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"257.419763ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/resourcequotas/yakd-dashboard/\" range_end:\"/registry/resourcequotas/yakd-dashboard0\" ","response":"range_response_count:0 size:5"}

	{"level":"info","ts":"2023-12-26T21:46:22.737829Z","caller":"traceutil/trace.go:171","msg":"trace[1066999797] range","detail":"{range_begin:/registry/resourcequotas/yakd-dashboard/; range_end:/registry/resourcequotas/yakd-dashboard0; response_count:0; response_revision:382; }","duration":"301.7929ms","start":"2023-12-26T21:46:22.436018Z","end":"2023-12-26T21:46:22.737811Z","steps":["trace[1066999797] 'agreement among raft nodes before linearized reading'  (duration: 238.041861ms)","trace[1066999797] 'get authentication metadata'  (duration: 19.369681ms)"],"step_count":2}

	{"level":"warn","ts":"2023-12-26T21:46:22.737927Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2023-12-26T21:46:22.436015Z","time spent":"301.894427ms","remote":"127.0.0.1:36046","response type":"/etcdserverpb.KV/Range","request count":0,"request size":84,"response count":0,"response size":29,"request content":"key:\"/registry/resourcequotas/yakd-dashboard/\" range_end:\"/registry/resourcequotas/yakd-dashboard0\" "}

	{"level":"warn","ts":"2023-12-26T21:46:22.69355Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"257.58278ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/kube-system\" ","response":"range_response_count:1 size:351"}

	{"level":"info","ts":"2023-12-26T21:46:22.738143Z","caller":"traceutil/trace.go:171","msg":"trace[1020394058] range","detail":"{range_begin:/registry/namespaces/kube-system; range_end:; response_count:1; response_revision:382; }","duration":"302.170483ms","start":"2023-12-26T21:46:22.435963Z","end":"2023-12-26T21:46:22.738133Z","steps":["trace[1020394058] 'agreement among raft nodes before linearized reading'  (duration: 238.109658ms)","trace[1020394058] 'get authentication metadata'  (duration: 19.456522ms)"],"step_count":2}

	{"level":"warn","ts":"2023-12-26T21:46:22.738223Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2023-12-26T21:46:22.435959Z","time spent":"302.253221ms","remote":"127.0.0.1:36074","response type":"/etcdserverpb.KV/Range","request count":0,"request size":34,"response count":1,"response size":375,"request content":"key:\"/registry/namespaces/kube-system\" "}

	{"level":"info","ts":"2023-12-26T21:46:22.687855Z","caller":"traceutil/trace.go:171","msg":"trace[1234581384] transaction","detail":"{read_only:false; response_revision:380; number_of_response:1; }","duration":"164.055398ms","start":"2023-12-26T21:46:22.523789Z","end":"2023-12-26T21:46:22.687845Z","steps":["trace[1234581384] 'process raft request'  (duration: 162.503228ms)"],"step_count":1}

	{"level":"warn","ts":"2023-12-26T21:46:22.736988Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2023-12-26T21:46:22.436272Z","time spent":"300.69471ms","remote":"127.0.0.1:36104","response type":"/etcdserverpb.KV/Range","request count":0,"request size":64,"response count":0,"response size":29,"request content":"key:\"/registry/limitranges/default/\" range_end:\"/registry/limitranges/default0\" "}

	==> gcp-auth [426fb5db606fa75ce6945ac23ec91db80974534187f20b743958f83105dfbf01] <==

	2023/12/26 21:47:46 GCP Auth Webhook started!

	2023/12/26 21:48:13 Ready to marshal response ...

	2023/12/26 21:48:13 Ready to write response ...

	2023/12/26 21:48:13 Ready to marshal response ...

	2023/12/26 21:48:13 Ready to write response ...

	2023/12/26 21:48:13 Ready to marshal response ...

	2023/12/26 21:48:13 Ready to write response ...

	2023/12/26 21:48:24 Ready to marshal response ...

	2023/12/26 21:48:24 Ready to write response ...

	2023/12/26 21:48:30 Ready to marshal response ...

	2023/12/26 21:48:30 Ready to write response ...

	2023/12/26 21:48:30 Ready to marshal response ...

	2023/12/26 21:48:30 Ready to write response ...

	2023/12/26 21:48:39 Ready to marshal response ...

	2023/12/26 21:48:39 Ready to write response ...

	2023/12/26 21:48:44 Ready to marshal response ...

	2023/12/26 21:48:44 Ready to write response ...

	2023/12/26 21:48:59 Ready to marshal response ...

	2023/12/26 21:48:59 Ready to write response ...

	2023/12/26 21:49:19 Ready to marshal response ...

	2023/12/26 21:49:19 Ready to write response ...

	==> kernel <==

	 21:55:22 up  5:37,  0 users,  load average: 0.16, 0.69, 1.33

	Linux addons-154736 5.15.0-1051-aws #56~20.04.1-Ubuntu SMP Tue Nov 28 15:43:06 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux

	PRETTY_NAME="Ubuntu 22.04.3 LTS"

	==> kindnet [5f14597475deec6687f7cf3ad4f366e454ec133bf87236d0dd00a321bff92445] <==

	I1226 21:53:12.249596       1 main.go:227] handling current node

	I1226 21:53:22.262218       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:53:22.262252       1 main.go:227] handling current node

	I1226 21:53:32.266639       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:53:32.266670       1 main.go:227] handling current node

	I1226 21:53:42.277721       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:53:42.277758       1 main.go:227] handling current node

	I1226 21:53:52.288362       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:53:52.288501       1 main.go:227] handling current node

	I1226 21:54:02.292683       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:54:02.292708       1 main.go:227] handling current node

	I1226 21:54:12.305033       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:54:12.305060       1 main.go:227] handling current node

	I1226 21:54:22.309597       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:54:22.309629       1 main.go:227] handling current node

	I1226 21:54:32.321920       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:54:32.321951       1 main.go:227] handling current node

	I1226 21:54:42.326881       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:54:42.326914       1 main.go:227] handling current node

	I1226 21:54:52.339163       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:54:52.339188       1 main.go:227] handling current node

	I1226 21:55:02.348797       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:55:02.348825       1 main.go:227] handling current node

	I1226 21:55:12.357795       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 21:55:12.357824       1 main.go:227] handling current node

	==> kube-apiserver [c5b1b0ac08cda61e9bbefc778ff2c9efec379f6aaf465452284a7a96531982d8] <==

	E1226 21:47:14.175767       1 controller.go:102] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable

	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]

	I1226 21:47:14.176876       1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.

	W1226 21:47:18.183142       1 handler_proxy.go:93] no RequestInfo found in the context

	E1226 21:47:18.183194       1 controller.go:146] Error updating APIService "v1beta1.metrics.k8s.io" with err: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable

	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]

	E1226 21:47:18.183278       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.101.226.217:443/apis/metrics.k8s.io/v1beta1: Get "https://10.101.226.217:443/apis/metrics.k8s.io/v1beta1": context deadline exceeded

	I1226 21:47:18.226035       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager

	E1226 21:47:18.235616       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io "v1beta1.metrics.k8s.io": the object has been modified; please apply your changes to the latest version and try again

	I1226 21:47:18.249146       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager

	I1226 21:48:01.090044       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager

	I1226 21:48:13.391328       1 alloc.go:330] "allocated clusterIPs" service="headlamp/headlamp" clusterIPs={"IPv4":"10.100.241.164"}

	I1226 21:48:47.250109       1 handler.go:232] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager

	I1226 21:48:47.272806       1 handler.go:232] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager

	W1226 21:48:48.323602       1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io

	I1226 21:48:57.771535       1 controller.go:624] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io

	I1226 21:48:58.917884       1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io

	I1226 21:48:59.228975       1 alloc.go:330] "allocated clusterIPs" service="default/nginx" clusterIPs={"IPv4":"10.97.161.33"}

	I1226 21:49:19.227715       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Nothing (removed from the queue).

	I1226 21:51:01.378469       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1226 21:51:01.378621       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1226 21:51:01.378765       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1226 21:51:01.378829       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	I1226 21:51:01.378947       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager

	I1226 21:51:01.379002       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager

	==> kube-controller-manager [5f4d17cd1a7591fad519abf838f38f74aa1d9ab2dbda0b46ce722b54400e80ee] <==

	I1226 21:49:02.278814       1 event.go:307] "Event occurred" object="default/hpvc-restore" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="Waiting for a volume to be created either by the external provisioner 'hostpath.csi.k8s.io' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered."

	W1226 21:49:05.724978       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:49:05.725011       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	I1226 21:49:17.280093       1 event.go:307] "Event occurred" object="default/hpvc-restore" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="Waiting for a volume to be created either by the external provisioner 'hostpath.csi.k8s.io' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered."

	I1226 21:49:19.442102       1 event.go:307] "Event occurred" object="default/hpvc-restore" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="Waiting for a volume to be created either by the external provisioner 'hostpath.csi.k8s.io' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered."

	W1226 21:49:22.322988       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:49:22.323018       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:50:08.035478       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:50:08.035517       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:50:43.390905       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:50:43.390938       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:51:20.739347       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:51:20.739382       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:51:55.552410       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:51:55.552446       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:52:31.808159       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:52:31.808199       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:53:02.112640       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:53:02.112676       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:53:35.339875       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:53:35.339909       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:54:32.830341       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:54:32.830378       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	W1226 21:55:17.216364       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	E1226 21:55:17.216397       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource

	==> kube-proxy [fc7c1d4cc434f0b477649382600f28a8b97ca79c8a08eb97ab1947e7523f584d] <==

	I1226 21:46:23.640742       1 server_others.go:69] "Using iptables proxy"

	I1226 21:46:23.780851       1 node.go:141] Successfully retrieved node IP: 192.168.49.2

	I1226 21:46:23.961749       1 server.go:632] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"

	I1226 21:46:23.964285       1 server_others.go:152] "Using iptables Proxier"

	I1226 21:46:23.964388       1 server_others.go:421] "Detect-local-mode set to ClusterCIDR, but no cluster CIDR for family" ipFamily="IPv6"

	I1226 21:46:23.964453       1 server_others.go:438] "Defaulting to no-op detect-local"

	I1226 21:46:23.964548       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I1226 21:46:23.964814       1 server.go:846] "Version info" version="v1.28.4"

	I1226 21:46:23.965035       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1226 21:46:23.965823       1 config.go:188] "Starting service config controller"

	I1226 21:46:23.966279       1 shared_informer.go:311] Waiting for caches to sync for service config

	I1226 21:46:23.966348       1 config.go:97] "Starting endpoint slice config controller"

	I1226 21:46:23.966380       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I1226 21:46:23.966960       1 config.go:315] "Starting node config controller"

	I1226 21:46:23.967020       1 shared_informer.go:311] Waiting for caches to sync for node config

	I1226 21:46:24.068617       1 shared_informer.go:318] Caches are synced for node config

	I1226 21:46:24.068805       1 shared_informer.go:318] Caches are synced for service config

	I1226 21:46:24.068877       1 shared_informer.go:318] Caches are synced for endpoint slice config

	==> kube-scheduler [a1a3df534703e2bb88745f494a4f27e49f98cc68c5747f8b75f69df096105d43] <==

	W1226 21:46:01.499821       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E1226 21:46:01.499861       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W1226 21:46:01.499951       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E1226 21:46:01.499994       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W1226 21:46:01.500095       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E1226 21:46:01.500137       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W1226 21:46:01.500229       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E1226 21:46:01.500269       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	W1226 21:46:01.500416       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E1226 21:46:01.500460       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W1226 21:46:01.500581       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E1226 21:46:01.500641       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W1226 21:46:01.500744       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E1226 21:46:01.500787       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W1226 21:46:01.500885       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E1226 21:46:01.500922       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W1226 21:46:01.501014       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E1226 21:46:01.501056       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W1226 21:46:01.501147       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1226 21:46:01.501185       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	W1226 21:46:01.501259       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E1226 21:46:01.501297       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	W1226 21:46:02.462665       1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E1226 21:46:02.462706       1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	I1226 21:46:05.170353       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	==> kubelet <==

	Dec 26 21:54:51 addons-154736 kubelet[1365]: I1226 21:54:51.486045    1365 scope.go:117] "RemoveContainer" containerID="5fe6705eae1fbc89ec665967bdfcef33c4d35b3192b0d5e54fd47a92656d5772"

	Dec 26 21:54:51 addons-154736 kubelet[1365]: E1226 21:54:51.486364    1365 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"minikube-ingress-dns\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=minikube-ingress-dns pod=kube-ingress-dns-minikube_kube-system(e6c2ffcd-377b-48c7-b5ca-3ac9d28f4f89)\"" pod="kube-system/kube-ingress-dns-minikube" podUID="e6c2ffcd-377b-48c7-b5ca-3ac9d28f4f89"

	Dec 26 21:54:51 addons-154736 kubelet[1365]: E1226 21:54:51.488261    1365 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"task-pv-container\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx\\\"\"" pod="default/task-pv-pod-restore" podUID="207a63c3-f7e0-4270-aa76-3681a7e5658c"

	Dec 26 21:54:52 addons-154736 kubelet[1365]: E1226 21:54:52.487289    1365 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx:alpine\\\"\"" pod="default/nginx" podUID="89cc57b4-3f60-4a69-b7d3-dbc25226b9c0"

	Dec 26 21:54:53 addons-154736 kubelet[1365]: E1226 21:54:53.412858    1365 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/a61ae8a41b5ee6689d25072d91db1f4be4f943b229f7bda694bb08385682cece/diff" to get inode usage: stat /var/lib/containers/storage/overlay/a61ae8a41b5ee6689d25072d91db1f4be4f943b229f7bda694bb08385682cece/diff: no such file or directory, extraDiskErr: <nil>

	Dec 26 21:55:03 addons-154736 kubelet[1365]: E1226 21:55:03.487876    1365 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"task-pv-container\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx\\\"\"" pod="default/task-pv-pod-restore" podUID="207a63c3-f7e0-4270-aa76-3681a7e5658c"

	Dec 26 21:55:03 addons-154736 kubelet[1365]: E1226 21:55:03.488267    1365 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx:alpine\\\"\"" pod="default/nginx" podUID="89cc57b4-3f60-4a69-b7d3-dbc25226b9c0"

	Dec 26 21:55:04 addons-154736 kubelet[1365]: E1226 21:55:04.712064    1365 manager.go:1106] Failed to create existing container: /docker/0927c77a91cb3abbb70268b3a742f5c0c803d1cbb42dd1efdc24f53bd33e9c94/crio-d929e20c5935e81c71048d8651d982f22977ffc67f098b4b6530407ffeaa3f0f: Error finding container d929e20c5935e81c71048d8651d982f22977ffc67f098b4b6530407ffeaa3f0f: Status 404 returned error can't find the container with id d929e20c5935e81c71048d8651d982f22977ffc67f098b4b6530407ffeaa3f0f

	Dec 26 21:55:04 addons-154736 kubelet[1365]: E1226 21:55:04.712260    1365 manager.go:1106] Failed to create existing container: /crio-9de0ffc80a888993dda0cf8d7dfbc8404cd150a9b2fabac624d21d9e640d3e38: Error finding container 9de0ffc80a888993dda0cf8d7dfbc8404cd150a9b2fabac624d21d9e640d3e38: Status 404 returned error can't find the container with id 9de0ffc80a888993dda0cf8d7dfbc8404cd150a9b2fabac624d21d9e640d3e38

	Dec 26 21:55:04 addons-154736 kubelet[1365]: E1226 21:55:04.712418    1365 manager.go:1106] Failed to create existing container: /crio-e0e51a4b6edc7ce00a271701cfc3682cb172087a8a07a3eee24537d16438244d: Error finding container e0e51a4b6edc7ce00a271701cfc3682cb172087a8a07a3eee24537d16438244d: Status 404 returned error can't find the container with id e0e51a4b6edc7ce00a271701cfc3682cb172087a8a07a3eee24537d16438244d

	Dec 26 21:55:04 addons-154736 kubelet[1365]: E1226 21:55:04.712567    1365 manager.go:1106] Failed to create existing container: /crio-d929e20c5935e81c71048d8651d982f22977ffc67f098b4b6530407ffeaa3f0f: Error finding container d929e20c5935e81c71048d8651d982f22977ffc67f098b4b6530407ffeaa3f0f: Status 404 returned error can't find the container with id d929e20c5935e81c71048d8651d982f22977ffc67f098b4b6530407ffeaa3f0f

	Dec 26 21:55:04 addons-154736 kubelet[1365]: E1226 21:55:04.712707    1365 manager.go:1106] Failed to create existing container: /crio-88bbfca1fd18479c52e5a80c7f33f86b611a658500dfd5677be53da7cb2a5271: Error finding container 88bbfca1fd18479c52e5a80c7f33f86b611a658500dfd5677be53da7cb2a5271: Status 404 returned error can't find the container with id 88bbfca1fd18479c52e5a80c7f33f86b611a658500dfd5677be53da7cb2a5271

	Dec 26 21:55:04 addons-154736 kubelet[1365]: E1226 21:55:04.712868    1365 manager.go:1106] Failed to create existing container: /docker/0927c77a91cb3abbb70268b3a742f5c0c803d1cbb42dd1efdc24f53bd33e9c94/crio-e0e51a4b6edc7ce00a271701cfc3682cb172087a8a07a3eee24537d16438244d: Error finding container e0e51a4b6edc7ce00a271701cfc3682cb172087a8a07a3eee24537d16438244d: Status 404 returned error can't find the container with id e0e51a4b6edc7ce00a271701cfc3682cb172087a8a07a3eee24537d16438244d

	Dec 26 21:55:04 addons-154736 kubelet[1365]: E1226 21:55:04.768589    1365 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/bc0fd6958f94b2af68d66aebfa5a93fdf17ef0a2f16914164d37a3d6c1f47504/diff" to get inode usage: stat /var/lib/containers/storage/overlay/bc0fd6958f94b2af68d66aebfa5a93fdf17ef0a2f16914164d37a3d6c1f47504/diff: no such file or directory, extraDiskErr: <nil>

	Dec 26 21:55:04 addons-154736 kubelet[1365]: E1226 21:55:04.776003    1365 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/47b4a472ab43e6738e94069f5a35204ecad97d8f2ec79132203dc4a015ea166e/diff" to get inode usage: stat /var/lib/containers/storage/overlay/47b4a472ab43e6738e94069f5a35204ecad97d8f2ec79132203dc4a015ea166e/diff: no such file or directory, extraDiskErr: <nil>

	Dec 26 21:55:04 addons-154736 kubelet[1365]: E1226 21:55:04.776019    1365 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/00695726537d13a01c67ff06a7fae7867c7554f4b45abef0d2fedcf3241a7c45/diff" to get inode usage: stat /var/lib/containers/storage/overlay/00695726537d13a01c67ff06a7fae7867c7554f4b45abef0d2fedcf3241a7c45/diff: no such file or directory, extraDiskErr: <nil>

	Dec 26 21:55:04 addons-154736 kubelet[1365]: E1226 21:55:04.781374    1365 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/5cf772e9a600f01aaf8234df1eedde33b958f911afea74b479d05696357835c5/diff" to get inode usage: stat /var/lib/containers/storage/overlay/5cf772e9a600f01aaf8234df1eedde33b958f911afea74b479d05696357835c5/diff: no such file or directory, extraDiskErr: <nil>

	Dec 26 21:55:04 addons-154736 kubelet[1365]: E1226 21:55:04.849893    1365 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/2f49872ed6f4a2d544c642d174e3bcfaa973f396c3147aac730930e8430503d9/diff" to get inode usage: stat /var/lib/containers/storage/overlay/2f49872ed6f4a2d544c642d174e3bcfaa973f396c3147aac730930e8430503d9/diff: no such file or directory, extraDiskErr: <nil>

	Dec 26 21:55:04 addons-154736 kubelet[1365]: E1226 21:55:04.884915    1365 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/f0f7030f1ab62f84c7091cb8779f8667fb6fce25fefac65ecc65e74592bea34f/diff" to get inode usage: stat /var/lib/containers/storage/overlay/f0f7030f1ab62f84c7091cb8779f8667fb6fce25fefac65ecc65e74592bea34f/diff: no such file or directory, extraDiskErr: <nil>

	Dec 26 21:55:04 addons-154736 kubelet[1365]: E1226 21:55:04.924672    1365 fsHandler.go:119] failed to collect filesystem stats - rootDiskErr: could not stat "/var/lib/containers/storage/overlay/5cf772e9a600f01aaf8234df1eedde33b958f911afea74b479d05696357835c5/diff" to get inode usage: stat /var/lib/containers/storage/overlay/5cf772e9a600f01aaf8234df1eedde33b958f911afea74b479d05696357835c5/diff: no such file or directory, extraDiskErr: <nil>

	Dec 26 21:55:06 addons-154736 kubelet[1365]: I1226 21:55:06.486185    1365 scope.go:117] "RemoveContainer" containerID="5fe6705eae1fbc89ec665967bdfcef33c4d35b3192b0d5e54fd47a92656d5772"

	Dec 26 21:55:06 addons-154736 kubelet[1365]: E1226 21:55:06.486445    1365 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"minikube-ingress-dns\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=minikube-ingress-dns pod=kube-ingress-dns-minikube_kube-system(e6c2ffcd-377b-48c7-b5ca-3ac9d28f4f89)\"" pod="kube-system/kube-ingress-dns-minikube" podUID="e6c2ffcd-377b-48c7-b5ca-3ac9d28f4f89"

	Dec 26 21:55:17 addons-154736 kubelet[1365]: E1226 21:55:17.488052    1365 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"task-pv-container\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx\\\"\"" pod="default/task-pv-pod-restore" podUID="207a63c3-f7e0-4270-aa76-3681a7e5658c"

	Dec 26 21:55:21 addons-154736 kubelet[1365]: I1226 21:55:21.486257    1365 scope.go:117] "RemoveContainer" containerID="5fe6705eae1fbc89ec665967bdfcef33c4d35b3192b0d5e54fd47a92656d5772"

	Dec 26 21:55:21 addons-154736 kubelet[1365]: E1226 21:55:21.486526    1365 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"minikube-ingress-dns\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=minikube-ingress-dns pod=kube-ingress-dns-minikube_kube-system(e6c2ffcd-377b-48c7-b5ca-3ac9d28f4f89)\"" pod="kube-system/kube-ingress-dns-minikube" podUID="e6c2ffcd-377b-48c7-b5ca-3ac9d28f4f89"

	==> storage-provisioner [2ca195417d20cd7d770bd0d4ca4ba2c4f87c603396ace0f89dc95113a10a3c0f] <==

	I1226 21:46:53.461435       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1226 21:46:53.482276       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1226 21:46:53.482442       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1226 21:46:53.499286       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1226 21:46:53.499560       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-154736_8b77c78b-51e5-498d-bad2-c4833c8e2aec!

	I1226 21:46:53.501777       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"1f84c5a7-4067-41c5-b8c4-76d4700df79e", APIVersion:"v1", ResourceVersion:"884", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-154736_8b77c78b-51e5-498d-bad2-c4833c8e2aec became leader

	I1226 21:46:53.600700       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-154736_8b77c78b-51e5-498d-bad2-c4833c8e2aec!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p addons-154736 -n addons-154736

helpers_test.go:261: (dbg) Run:  kubectl --context addons-154736 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: nginx task-pv-pod-restore ingress-nginx-admission-create-jtzt2 ingress-nginx-admission-patch-gwrdr

helpers_test.go:274: ======> post-mortem[TestAddons/parallel/CSI]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context addons-154736 describe pod nginx task-pv-pod-restore ingress-nginx-admission-create-jtzt2 ingress-nginx-admission-patch-gwrdr

helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-154736 describe pod nginx task-pv-pod-restore ingress-nginx-admission-create-jtzt2 ingress-nginx-admission-patch-gwrdr: exit status 1 (122.769921ms)

-- stdout --

	Name:             nginx

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             addons-154736/192.168.49.2

	Start Time:       Tue, 26 Dec 2023 21:48:59 +0000

	Labels:           run=nginx

	Annotations:      <none>

	Status:           Pending

	IP:               10.244.0.27

	IPs:

	  IP:  10.244.0.27

	Containers:

	  nginx:

	    Container ID:   

	    Image:          docker.io/nginx:alpine

	    Image ID:       

	    Port:           80/TCP

	    Host Port:      0/TCP

	    State:          Waiting

	      Reason:       ImagePullBackOff

	    Ready:          False

	    Restart Count:  0

	    Environment:

	      GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json

	      PROJECT_ID:                      this_is_fake

	      GCP_PROJECT:                     this_is_fake

	      GCLOUD_PROJECT:                  this_is_fake

	      GOOGLE_CLOUD_PROJECT:            this_is_fake

	      CLOUDSDK_CORE_PROJECT:           this_is_fake

	    Mounts:

	      /google-app-creds.json from gcp-creds (ro)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-mttn4 (ro)

	Conditions:

	  Type              Status

	  Initialized       True 

	  Ready             False 

	  ContainersReady   False 

	  PodScheduled      True 

	Volumes:

	  kube-api-access-mttn4:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	  gcp-creds:

	    Type:          HostPath (bare host directory volume)

	    Path:          /var/lib/minikube/google_application_credentials.json

	    HostPathType:  File

	QoS Class:         BestEffort

	Node-Selectors:    <none>

	Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                   node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason     Age                   From               Message

	  ----     ------     ----                  ----               -------

	  Normal   Scheduled  6m24s                 default-scheduler  Successfully assigned default/nginx to addons-154736

	  Warning  Failed     5m53s                 kubelet            Failed to pull image "docker.io/nginx:alpine": initializing source docker://nginx:alpine: reading manifest alpine in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Warning  Failed     2m51s                 kubelet            Failed to pull image "docker.io/nginx:alpine": loading manifest for target platform: reading manifest sha256:7913e8fa2e6a5f0160a5e6b7ea48b7d4a301c6058d63c3d632a35a59093cb4eb in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Normal   Pulling    2m1s (x4 over 6m24s)  kubelet            Pulling image "docker.io/nginx:alpine"

	  Warning  Failed     91s (x4 over 5m53s)   kubelet            Error: ErrImagePull

	  Warning  Failed     91s (x2 over 4m23s)   kubelet            Failed to pull image "docker.io/nginx:alpine": reading manifest alpine in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Normal   BackOff    66s (x7 over 5m53s)   kubelet            Back-off pulling image "docker.io/nginx:alpine"

	  Warning  Failed     66s (x7 over 5m53s)   kubelet            Error: ImagePullBackOff

	Name:             task-pv-pod-restore

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             addons-154736/192.168.49.2

	Start Time:       Tue, 26 Dec 2023 21:49:19 +0000

	Labels:           app=task-pv-pod-restore

	Annotations:      <none>

	Status:           Pending

	IP:               10.244.0.28

	IPs:

	  IP:  10.244.0.28

	Containers:

	  task-pv-container:

	    Container ID:   

	    Image:          docker.io/nginx

	    Image ID:       

	    Port:           80/TCP

	    Host Port:      0/TCP

	    State:          Waiting

	      Reason:       ImagePullBackOff

	    Ready:          False

	    Restart Count:  0

	    Environment:

	      GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json

	      PROJECT_ID:                      this_is_fake

	      GCP_PROJECT:                     this_is_fake

	      GCLOUD_PROJECT:                  this_is_fake

	      GOOGLE_CLOUD_PROJECT:            this_is_fake

	      CLOUDSDK_CORE_PROJECT:           this_is_fake

	    Mounts:

	      /google-app-creds.json from gcp-creds (ro)

	      /usr/share/nginx/html from task-pv-storage (rw)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-6gjg5 (ro)

	Conditions:

	  Type              Status

	  Initialized       True 

	  Ready             False 

	  ContainersReady   False 

	  PodScheduled      True 

	Volumes:

	  task-pv-storage:

	    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)

	    ClaimName:  hpvc-restore

	    ReadOnly:   false

	  kube-api-access-6gjg5:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	  gcp-creds:

	    Type:          HostPath (bare host directory volume)

	    Path:          /var/lib/minikube/google_application_credentials.json

	    HostPathType:  File

	QoS Class:         BestEffort

	Node-Selectors:    <none>

	Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                   node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason     Age                    From               Message

	  ----     ------     ----                   ----               -------

	  Normal   Scheduled  6m4s                   default-scheduler  Successfully assigned default/task-pv-pod-restore to addons-154736

	  Warning  Failed     2m21s (x2 over 3m52s)  kubelet            Failed to pull image "docker.io/nginx": reading manifest latest in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Normal   Pulling    100s (x4 over 6m3s)    kubelet            Pulling image "docker.io/nginx"

	  Warning  Failed     46s (x2 over 4m53s)    kubelet            Failed to pull image "docker.io/nginx": loading manifest for target platform: reading manifest sha256:73a06b3a2577448f9acc23502a0cb4d41919da9cc5035e66b0a9a09715397684 in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Warning  Failed     46s (x4 over 4m53s)    kubelet            Error: ErrImagePull

	  Normal   BackOff    6s (x7 over 4m53s)     kubelet            Back-off pulling image "docker.io/nginx"

	  Warning  Failed     6s (x7 over 4m53s)     kubelet            Error: ImagePullBackOff

-- /stdout --

** stderr ** 

	Error from server (NotFound): pods "ingress-nginx-admission-create-jtzt2" not found

	Error from server (NotFound): pods "ingress-nginx-admission-patch-gwrdr" not found

** /stderr **

helpers_test.go:279: kubectl --context addons-154736 describe pod nginx task-pv-pod-restore ingress-nginx-admission-create-jtzt2 ingress-nginx-admission-patch-gwrdr: exit status 1

--- FAIL: TestAddons/parallel/CSI (403.23s)

=== RUN   TestFunctional/parallel/PersistentVolumeClaim

=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

=== CONT  TestFunctional/parallel/PersistentVolumeClaim

functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...

helpers_test.go:344: "storage-provisioner" [d0995a50-650c-4928-83fc-533af41c36fc] Running

functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 6.003715532s

functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-262391 get storageclass -o=json

functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-262391 apply -f testdata/storage-provisioner/pvc.yaml

functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-262391 get pvc myclaim -o=json

functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-262391 apply -f testdata/storage-provisioner/pod.yaml

functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...

helpers_test.go:344: "sp-pod" [265d1a5f-6c1b-41a9-830c-235ee9d55ffe] Pending

helpers_test.go:344: "sp-pod" [265d1a5f-6c1b-41a9-830c-235ee9d55ffe] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])

E1226 22:03:11.961419  703036 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/client.crt: no such file or directory

E1226 22:03:39.648734  703036 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/addons-154736/client.crt: no such file or directory

helpers_test.go:329: TestFunctional/parallel/PersistentVolumeClaim: WARNING: pod list for "default" "test=storage-provisioner" returned: client rate limiter Wait returned an error: context deadline exceeded

functional_test_pvc_test.go:130: ***** TestFunctional/parallel/PersistentVolumeClaim: pod "test=storage-provisioner" failed to start within 3m0s: context deadline exceeded ****

functional_test_pvc_test.go:130: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p functional-262391 -n functional-262391

functional_test_pvc_test.go:130: TestFunctional/parallel/PersistentVolumeClaim: showing logs for failed pods as of 2023-12-26 22:04:23.991669003 +0000 UTC m=+1184.644643858

functional_test_pvc_test.go:130: (dbg) Run:  kubectl --context functional-262391 describe po sp-pod -n default

functional_test_pvc_test.go:130: (dbg) kubectl --context functional-262391 describe po sp-pod -n default:

Name:             sp-pod

Namespace:        default

Priority:         0

Service Account:  default

Node:             functional-262391/192.168.49.2

Start Time:       Tue, 26 Dec 2023 22:01:23 +0000

Labels:           test=storage-provisioner

Annotations:      <none>

Status:           Pending

IP:               10.244.0.5

IPs:

IP:  10.244.0.5

Containers:

myfrontend:

Container ID:   

Image:          docker.io/nginx

Image ID:       

Port:           <none>

Host Port:      <none>

State:          Waiting

Reason:       ImagePullBackOff

Ready:          False

Restart Count:  0

Environment:    <none>

Mounts:

/tmp/mount from mypd (rw)

/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-4hc7k (ro)

Conditions:

Type              Status

Initialized       True 

Ready             False 

ContainersReady   False 

PodScheduled      True 

Volumes:

mypd:

Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)

ClaimName:  myclaim

ReadOnly:   false

kube-api-access-4hc7k:

Type:                    Projected (a volume that contains injected data from multiple sources)

TokenExpirationSeconds:  3607

ConfigMapName:           kube-root-ca.crt

ConfigMapOptional:       <nil>

DownwardAPI:             true

QoS Class:                   BestEffort

Node-Selectors:              <none>

Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

Events:

Type     Reason     Age                 From               Message

----     ------     ----                ----               -------

Normal   Scheduled  3m1s                default-scheduler  Successfully assigned default/sp-pod to functional-262391

Warning  Failed     51s (x2 over 2m6s)  kubelet            Failed to pull image "docker.io/nginx": reading manifest latest in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

Warning  Failed     51s (x2 over 2m6s)  kubelet            Error: ErrImagePull

Normal   BackOff    40s (x2 over 2m6s)  kubelet            Back-off pulling image "docker.io/nginx"

Warning  Failed     40s (x2 over 2m6s)  kubelet            Error: ImagePullBackOff

Normal   Pulling    28s (x3 over 3m1s)  kubelet            Pulling image "docker.io/nginx"

functional_test_pvc_test.go:130: (dbg) Run:  kubectl --context functional-262391 logs sp-pod -n default

functional_test_pvc_test.go:130: (dbg) Non-zero exit: kubectl --context functional-262391 logs sp-pod -n default: exit status 1 (113.096989ms)

** stderr ** 

	Error from server (BadRequest): container "myfrontend" in pod "sp-pod" is waiting to start: trying and failing to pull image

** /stderr **

functional_test_pvc_test.go:130: kubectl --context functional-262391 logs sp-pod -n default: exit status 1

functional_test_pvc_test.go:131: failed waiting for pod: test=storage-provisioner within 3m0s: context deadline exceeded

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:230: ======>  post-mortem[TestFunctional/parallel/PersistentVolumeClaim]: docker inspect <======

helpers_test.go:231: (dbg) Run:  docker inspect functional-262391

helpers_test.go:235: (dbg) docker inspect functional-262391:

-- stdout --

	[

	    {

	        "Id": "0f329dae541ede1670d5c7556e5f4b260ee3b6f71728967a170153f52271f2cf",

	        "Created": "2023-12-26T21:58:28.884688462Z",

	        "Path": "/usr/local/bin/entrypoint",

	        "Args": [

	            "/sbin/init"

	        ],

	        "State": {

	            "Status": "running",

	            "Running": true,

	            "Paused": false,

	            "Restarting": false,

	            "OOMKilled": false,

	            "Dead": false,

	            "Pid": 717786,

	            "ExitCode": 0,

	            "Error": "",

	            "StartedAt": "2023-12-26T21:58:29.210132221Z",

	            "FinishedAt": "0001-01-01T00:00:00Z"

	        },

	        "Image": "sha256:3bfff26a1ae256fcdf8f10a333efdefbe26edc5c1669e1cc5c973c016e44d3c4",

	        "ResolvConfPath": "/var/lib/docker/containers/0f329dae541ede1670d5c7556e5f4b260ee3b6f71728967a170153f52271f2cf/resolv.conf",

	        "HostnamePath": "/var/lib/docker/containers/0f329dae541ede1670d5c7556e5f4b260ee3b6f71728967a170153f52271f2cf/hostname",

	        "HostsPath": "/var/lib/docker/containers/0f329dae541ede1670d5c7556e5f4b260ee3b6f71728967a170153f52271f2cf/hosts",

	        "LogPath": "/var/lib/docker/containers/0f329dae541ede1670d5c7556e5f4b260ee3b6f71728967a170153f52271f2cf/0f329dae541ede1670d5c7556e5f4b260ee3b6f71728967a170153f52271f2cf-json.log",

	        "Name": "/functional-262391",

	        "RestartCount": 0,

	        "Driver": "overlay2",

	        "Platform": "linux",

	        "MountLabel": "",

	        "ProcessLabel": "",

	        "AppArmorProfile": "unconfined",

	        "ExecIDs": null,

	        "HostConfig": {

	            "Binds": [

	                "/lib/modules:/lib/modules:ro",

	                "functional-262391:/var"

	            ],

	            "ContainerIDFile": "",

	            "LogConfig": {

	                "Type": "json-file",

	                "Config": {}

	            },

	            "NetworkMode": "functional-262391",

	            "PortBindings": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ],

	                "8441/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": ""

	                    }

	                ]

	            },

	            "RestartPolicy": {

	                "Name": "no",

	                "MaximumRetryCount": 0

	            },

	            "AutoRemove": false,

	            "VolumeDriver": "",

	            "VolumesFrom": null,

	            "ConsoleSize": [

	                0,

	                0

	            ],

	            "CapAdd": null,

	            "CapDrop": null,

	            "CgroupnsMode": "host",

	            "Dns": [],

	            "DnsOptions": [],

	            "DnsSearch": [],

	            "ExtraHosts": null,

	            "GroupAdd": null,

	            "IpcMode": "private",

	            "Cgroup": "",

	            "Links": null,

	            "OomScoreAdj": 0,

	            "PidMode": "",

	            "Privileged": true,

	            "PublishAllPorts": false,

	            "ReadonlyRootfs": false,

	            "SecurityOpt": [

	                "seccomp=unconfined",

	                "apparmor=unconfined",

	                "label=disable"

	            ],

	            "Tmpfs": {

	                "/run": "",

	                "/tmp": ""

	            },

	            "UTSMode": "",

	            "UsernsMode": "",

	            "ShmSize": 67108864,

	            "Runtime": "runc",

	            "Isolation": "",

	            "CpuShares": 0,

	            "Memory": 4194304000,

	            "NanoCpus": 2000000000,

	            "CgroupParent": "",

	            "BlkioWeight": 0,

	            "BlkioWeightDevice": [],

	            "BlkioDeviceReadBps": [],

	            "BlkioDeviceWriteBps": [],

	            "BlkioDeviceReadIOps": [],

	            "BlkioDeviceWriteIOps": [],

	            "CpuPeriod": 0,

	            "CpuQuota": 0,

	            "CpuRealtimePeriod": 0,

	            "CpuRealtimeRuntime": 0,

	            "CpusetCpus": "",

	            "CpusetMems": "",

	            "Devices": [],

	            "DeviceCgroupRules": null,

	            "DeviceRequests": null,

	            "MemoryReservation": 0,

	            "MemorySwap": 8388608000,

	            "MemorySwappiness": null,

	            "OomKillDisable": false,

	            "PidsLimit": null,

	            "Ulimits": null,

	            "CpuCount": 0,

	            "CpuPercent": 0,

	            "IOMaximumIOps": 0,

	            "IOMaximumBandwidth": 0,

	            "MaskedPaths": null,

	            "ReadonlyPaths": null

	        },

	        "GraphDriver": {

	            "Data": {

	                "LowerDir": "/var/lib/docker/overlay2/00cbe638b8c702d782fd71428fce6e33400c14e7d9f6d750537c8c238a6eae3a-init/diff:/var/lib/docker/overlay2/45396a29879cab7c8a67d68e40c59b67c1c0ba964e9ed87a152af8cc5862c477/diff",

	                "MergedDir": "/var/lib/docker/overlay2/00cbe638b8c702d782fd71428fce6e33400c14e7d9f6d750537c8c238a6eae3a/merged",

	                "UpperDir": "/var/lib/docker/overlay2/00cbe638b8c702d782fd71428fce6e33400c14e7d9f6d750537c8c238a6eae3a/diff",

	                "WorkDir": "/var/lib/docker/overlay2/00cbe638b8c702d782fd71428fce6e33400c14e7d9f6d750537c8c238a6eae3a/work"

	            },

	            "Name": "overlay2"

	        },

	        "Mounts": [

	            {

	                "Type": "volume",

	                "Name": "functional-262391",

	                "Source": "/var/lib/docker/volumes/functional-262391/_data",

	                "Destination": "/var",

	                "Driver": "local",

	                "Mode": "z",

	                "RW": true,

	                "Propagation": ""

	            },

	            {

	                "Type": "bind",

	                "Source": "/lib/modules",

	                "Destination": "/lib/modules",

	                "Mode": "ro",

	                "RW": false,

	                "Propagation": "rprivate"

	            }

	        ],

	        "Config": {

	            "Hostname": "functional-262391",

	            "Domainname": "",

	            "User": "",

	            "AttachStdin": false,

	            "AttachStdout": false,

	            "AttachStderr": false,

	            "ExposedPorts": {

	                "22/tcp": {},

	                "2376/tcp": {},

	                "32443/tcp": {},

	                "5000/tcp": {},

	                "8441/tcp": {}

	            },

	            "Tty": true,

	            "OpenStdin": false,

	            "StdinOnce": false,

	            "Env": [

	                "container=docker",

	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"

	            ],

	            "Cmd": null,

	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c",

	            "Volumes": null,

	            "WorkingDir": "/",

	            "Entrypoint": [

	                "/usr/local/bin/entrypoint",

	                "/sbin/init"

	            ],

	            "OnBuild": null,

	            "Labels": {

	                "created_by.minikube.sigs.k8s.io": "true",

	                "mode.minikube.sigs.k8s.io": "functional-262391",

	                "name.minikube.sigs.k8s.io": "functional-262391",

	                "role.minikube.sigs.k8s.io": ""

	            },

	            "StopSignal": "SIGRTMIN+3"

	        },

	        "NetworkSettings": {

	            "Bridge": "",

	            "SandboxID": "104ab2df16957d6ba98436c367fffde800a78d234814c5d8691dc97c19a3c649",

	            "HairpinMode": false,

	            "LinkLocalIPv6Address": "",

	            "LinkLocalIPv6PrefixLen": 0,

	            "Ports": {

	                "22/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33681"

	                    }

	                ],

	                "2376/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33680"

	                    }

	                ],

	                "32443/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33677"

	                    }

	                ],

	                "5000/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33679"

	                    }

	                ],

	                "8441/tcp": [

	                    {

	                        "HostIp": "127.0.0.1",

	                        "HostPort": "33678"

	                    }

	                ]

	            },

	            "SandboxKey": "/var/run/docker/netns/104ab2df1695",

	            "SecondaryIPAddresses": null,

	            "SecondaryIPv6Addresses": null,

	            "EndpointID": "",

	            "Gateway": "",

	            "GlobalIPv6Address": "",

	            "GlobalIPv6PrefixLen": 0,

	            "IPAddress": "",

	            "IPPrefixLen": 0,

	            "IPv6Gateway": "",

	            "MacAddress": "",

	            "Networks": {

	                "functional-262391": {

	                    "IPAMConfig": {

	                        "IPv4Address": "192.168.49.2"

	                    },

	                    "Links": null,

	                    "Aliases": [

	                        "0f329dae541e",

	                        "functional-262391"

	                    ],

	                    "NetworkID": "038a4b5ef3d68f6ef4dd3c1b1f8aaf7070f2955dc32144f6c885c304d30c400a",

	                    "EndpointID": "76f1ef576704b6de0150926e0166e3a58fbef43c9b5de830607b124766d25cc7",

	                    "Gateway": "192.168.49.1",

	                    "IPAddress": "192.168.49.2",

	                    "IPPrefixLen": 24,

	                    "IPv6Gateway": "",

	                    "GlobalIPv6Address": "",

	                    "GlobalIPv6PrefixLen": 0,

	                    "MacAddress": "02:42:c0:a8:31:02",

	                    "DriverOpts": null

	                }

	            }

	        }

	    }

	]

-- /stdout --

helpers_test.go:239: (dbg) Run:  out/minikube-linux-arm64 status --format={{.Host}} -p functional-262391 -n functional-262391

helpers_test.go:244: <<< TestFunctional/parallel/PersistentVolumeClaim FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestFunctional/parallel/PersistentVolumeClaim]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-arm64 -p functional-262391 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-arm64 -p functional-262391 logs -n 25: (1.929432791s)

helpers_test.go:252: TestFunctional/parallel/PersistentVolumeClaim logs: 

-- stdout --

	==> Audit <==

	|---------|--------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| Command |                                   Args                                   |      Profile      |  User   | Version |     Start Time      |      End Time       |

	|---------|--------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| ssh     | functional-262391 ssh                                                    | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:00 UTC |                     |

	|         | sudo crictl inspecti                                                     |                   |         |         |                     |                     |

	|         | registry.k8s.io/pause:latest                                             |                   |         |         |                     |                     |

	| cache   | functional-262391 cache reload                                           | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:00 UTC | 26 Dec 23 22:00 UTC |

	| ssh     | functional-262391 ssh                                                    | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:00 UTC | 26 Dec 23 22:00 UTC |

	|         | sudo crictl inspecti                                                     |                   |         |         |                     |                     |

	|         | registry.k8s.io/pause:latest                                             |                   |         |         |                     |                     |

	| cache   | delete                                                                   | minikube          | jenkins | v1.32.0 | 26 Dec 23 22:00 UTC | 26 Dec 23 22:00 UTC |

	|         | registry.k8s.io/pause:3.1                                                |                   |         |         |                     |                     |

	| cache   | delete                                                                   | minikube          | jenkins | v1.32.0 | 26 Dec 23 22:00 UTC | 26 Dec 23 22:00 UTC |

	|         | registry.k8s.io/pause:latest                                             |                   |         |         |                     |                     |

	| kubectl | functional-262391 kubectl --                                             | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:00 UTC | 26 Dec 23 22:00 UTC |

	|         | --context functional-262391                                              |                   |         |         |                     |                     |

	|         | get pods                                                                 |                   |         |         |                     |                     |

	| start   | -p functional-262391                                                     | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:00 UTC | 26 Dec 23 22:01 UTC |

	|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision |                   |         |         |                     |                     |

	|         | --wait=all                                                               |                   |         |         |                     |                     |

	| service | invalid-svc -p                                                           | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:01 UTC |                     |

	|         | functional-262391                                                        |                   |         |         |                     |                     |

	| config  | functional-262391 config unset                                           | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:01 UTC | 26 Dec 23 22:01 UTC |

	|         | cpus                                                                     |                   |         |         |                     |                     |

	| cp      | functional-262391 cp                                                     | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:01 UTC | 26 Dec 23 22:01 UTC |

	|         | testdata/cp-test.txt                                                     |                   |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                 |                   |         |         |                     |                     |

	| config  | functional-262391 config get                                             | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:01 UTC |                     |

	|         | cpus                                                                     |                   |         |         |                     |                     |

	| config  | functional-262391 config set                                             | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:01 UTC | 26 Dec 23 22:01 UTC |

	|         | cpus 2                                                                   |                   |         |         |                     |                     |

	| config  | functional-262391 config get                                             | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:01 UTC | 26 Dec 23 22:01 UTC |

	|         | cpus                                                                     |                   |         |         |                     |                     |

	| ssh     | functional-262391 ssh -n                                                 | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:01 UTC | 26 Dec 23 22:01 UTC |

	|         | functional-262391 sudo cat                                               |                   |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                 |                   |         |         |                     |                     |

	| config  | functional-262391 config unset                                           | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:01 UTC | 26 Dec 23 22:01 UTC |

	|         | cpus                                                                     |                   |         |         |                     |                     |

	| config  | functional-262391 config get                                             | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:01 UTC |                     |

	|         | cpus                                                                     |                   |         |         |                     |                     |

	| ssh     | functional-262391 ssh echo                                               | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:01 UTC | 26 Dec 23 22:01 UTC |

	|         | hello                                                                    |                   |         |         |                     |                     |

	| cp      | functional-262391 cp                                                     | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:01 UTC | 26 Dec 23 22:01 UTC |

	|         | functional-262391:/home/docker/cp-test.txt                               |                   |         |         |                     |                     |

	|         | /tmp/TestFunctionalparallelCpCmd963562061/001/cp-test.txt                |                   |         |         |                     |                     |

	| ssh     | functional-262391 ssh cat                                                | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:01 UTC | 26 Dec 23 22:01 UTC |

	|         | /etc/hostname                                                            |                   |         |         |                     |                     |

	| ssh     | functional-262391 ssh -n                                                 | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:01 UTC | 26 Dec 23 22:01 UTC |

	|         | functional-262391 sudo cat                                               |                   |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                 |                   |         |         |                     |                     |

	| tunnel  | functional-262391 tunnel                                                 | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:01 UTC |                     |

	|         | --alsologtostderr                                                        |                   |         |         |                     |                     |

	| tunnel  | functional-262391 tunnel                                                 | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:01 UTC |                     |

	|         | --alsologtostderr                                                        |                   |         |         |                     |                     |

	| cp      | functional-262391 cp                                                     | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:01 UTC | 26 Dec 23 22:01 UTC |

	|         | testdata/cp-test.txt                                                     |                   |         |         |                     |                     |

	|         | /tmp/does/not/exist/cp-test.txt                                          |                   |         |         |                     |                     |

	| ssh     | functional-262391 ssh -n                                                 | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:01 UTC | 26 Dec 23 22:01 UTC |

	|         | functional-262391 sudo cat                                               |                   |         |         |                     |                     |

	|         | /tmp/does/not/exist/cp-test.txt                                          |                   |         |         |                     |                     |

	| tunnel  | functional-262391 tunnel                                                 | functional-262391 | jenkins | v1.32.0 | 26 Dec 23 22:01 UTC |                     |

	|         | --alsologtostderr                                                        |                   |         |         |                     |                     |

	|---------|--------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2023/12/26 22:00:28

	Running on machine: ip-172-31-21-244

	Binary: Built with gc go1.21.5 for linux/arm64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1226 22:00:28.077567  722547 out.go:296] Setting OutFile to fd 1 ...

	I1226 22:00:28.077707  722547 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 22:00:28.077711  722547 out.go:309] Setting ErrFile to fd 2...

	I1226 22:00:28.077715  722547 out.go:343] TERM=,COLORTERM=, which probably does not support color

	I1226 22:00:28.077994  722547 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17857-697646/.minikube/bin

	I1226 22:00:28.078352  722547 out.go:303] Setting JSON to false

	I1226 22:00:28.079291  722547 start.go:128] hostinfo: {"hostname":"ip-172-31-21-244","uptime":20562,"bootTime":1703607466,"procs":176,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1051-aws","kernelArch":"aarch64","virtualizationSystem":"","virtualizationRole":"","hostId":"da8ac1fd-6236-412a-a346-95873c98230d"}

	I1226 22:00:28.079356  722547 start.go:138] virtualization:  

	I1226 22:00:28.081876  722547 out.go:177] * [functional-262391] minikube v1.32.0 on Ubuntu 20.04 (arm64)

	I1226 22:00:28.084451  722547 out.go:177]   - MINIKUBE_LOCATION=17857

	I1226 22:00:28.084648  722547 notify.go:220] Checking for updates...

	I1226 22:00:28.086567  722547 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1226 22:00:28.088590  722547 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17857-697646/kubeconfig

	I1226 22:00:28.090400  722547 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17857-697646/.minikube

	I1226 22:00:28.091983  722547 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-arm64

	I1226 22:00:28.093704  722547 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1226 22:00:28.096176  722547 config.go:182] Loaded profile config "functional-262391": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4

	I1226 22:00:28.096280  722547 driver.go:392] Setting default libvirt URI to qemu:///system

	I1226 22:00:28.120506  722547 docker.go:122] docker version: linux-24.0.7:Docker Engine - Community

	I1226 22:00:28.120617  722547 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1226 22:00:28.203054  722547 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:54 SystemTime:2023-12-26 22:00:28.192248636 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1051-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi

tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dd1e886e55dd695541fdcd67420c2888645a495 Expected:3dd1e886e55dd695541fdcd67420c2888645a495} RuncCommit:{ID:v1.1.10-0-g18a0cb0 Expected:v1.1.10-0-g18a0cb0} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>

ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}

	I1226 22:00:28.203165  722547 docker.go:295] overlay module found

	I1226 22:00:28.205492  722547 out.go:177] * Using the docker driver based on existing profile

	I1226 22:00:28.207414  722547 start.go:298] selected driver: docker

	I1226 22:00:28.207423  722547 start.go:902] validating driver "docker" against &{Name:functional-262391 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-262391 Namespace:default APIServerName:miniku

beCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountTyp

e:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}

	I1226 22:00:28.207508  722547 start.go:913] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1226 22:00:28.207613  722547 cli_runner.go:164] Run: docker system info --format "{{json .}}"

	I1226 22:00:28.287087  722547 info.go:266] docker info: {ID:5FDH:SA5P:5GCT:NLAS:B73P:SGDQ:PBG5:UBVH:UZY3:RXGO:CI7S:WAIH Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:35 OomKillDisable:true NGoroutines:54 SystemTime:2023-12-26 22:00:28.275911702 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1051-aws OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Archi

tecture:aarch64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:2 MemTotal:8215035904 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ip-172-31-21-244 Labels:[] ExperimentalBuild:false ServerVersion:24.0.7 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:3dd1e886e55dd695541fdcd67420c2888645a495 Expected:3dd1e886e55dd695541fdcd67420c2888645a495} RuncCommit:{ID:v1.1.10-0-g18a0cb0 Expected:v1.1.10-0-g18a0cb0} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil>

ServerErrors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.11.2] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.21.0]] Warnings:<nil>}}

	I1226 22:00:28.287531  722547 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1226 22:00:28.287576  722547 cni.go:84] Creating CNI manager for ""

	I1226 22:00:28.287587  722547 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet

	I1226 22:00:28.287598  722547 start_flags.go:323] config:

	{Name:functional-262391 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-262391 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:

crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType

:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}

	I1226 22:00:28.291198  722547 out.go:177] * Starting control plane node functional-262391 in cluster functional-262391

	I1226 22:00:28.293106  722547 cache.go:121] Beginning downloading kic base image for docker with crio

	I1226 22:00:28.295029  722547 out.go:177] * Pulling base image v0.0.42-1703498848-17857 ...

	I1226 22:00:28.297201  722547 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio

	I1226 22:00:28.297250  722547 preload.go:148] Found local preload: /home/jenkins/minikube-integration/17857-697646/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-arm64.tar.lz4

	I1226 22:00:28.297257  722547 cache.go:56] Caching tarball of preloaded images

	I1226 22:00:28.297280  722547 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local docker daemon

	I1226 22:00:28.297337  722547 preload.go:174] Found /home/jenkins/minikube-integration/17857-697646/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-arm64.tar.lz4 in cache, skipping download

	I1226 22:00:28.297346  722547 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on crio

	I1226 22:00:28.297466  722547 profile.go:148] Saving config to /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/functional-262391/config.json ...

	I1226 22:00:28.315242  722547 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c in local docker daemon, skipping pull

	I1226 22:00:28.315256  722547 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c exists in daemon, skipping load

	I1226 22:00:28.315275  722547 cache.go:194] Successfully downloaded all kic artifacts

	I1226 22:00:28.315323  722547 start.go:365] acquiring machines lock for functional-262391: {Name:mkd624895a4124116431e841da065e96d170c675 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1226 22:00:28.315389  722547 start.go:369] acquired machines lock for "functional-262391" in 41.648µs

	I1226 22:00:28.315422  722547 start.go:96] Skipping create...Using existing machine configuration

	I1226 22:00:28.315427  722547 fix.go:54] fixHost starting: 

	I1226 22:00:28.315697  722547 cli_runner.go:164] Run: docker container inspect functional-262391 --format={{.State.Status}}

	I1226 22:00:28.334365  722547 fix.go:102] recreateIfNeeded on functional-262391: state=Running err=<nil>

	W1226 22:00:28.334393  722547 fix.go:128] unexpected machine state, will restart: <nil>

	I1226 22:00:28.336687  722547 out.go:177] * Updating the running docker "functional-262391" container ...

	I1226 22:00:28.338639  722547 machine.go:88] provisioning docker machine ...

	I1226 22:00:28.338672  722547 ubuntu.go:169] provisioning hostname "functional-262391"

	I1226 22:00:28.338745  722547 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-262391

	I1226 22:00:28.358928  722547 main.go:141] libmachine: Using SSH client type: native

	I1226 22:00:28.359433  722547 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3beb50] 0x3c12c0 <nil>  [] 0s} 127.0.0.1 33681 <nil> <nil>}

	I1226 22:00:28.359445  722547 main.go:141] libmachine: About to run SSH command:

	sudo hostname functional-262391 && echo "functional-262391" | sudo tee /etc/hostname

	I1226 22:00:28.516200  722547 main.go:141] libmachine: SSH cmd err, output: <nil>: functional-262391

	I1226 22:00:28.516274  722547 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-262391

	I1226 22:00:28.539952  722547 main.go:141] libmachine: Using SSH client type: native

	I1226 22:00:28.540340  722547 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3beb50] 0x3c12c0 <nil>  [] 0s} 127.0.0.1 33681 <nil> <nil>}

	I1226 22:00:28.540355  722547 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sfunctional-262391' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 functional-262391/g' /etc/hosts;

				else 

					echo '127.0.1.1 functional-262391' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1226 22:00:28.685949  722547 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1226 22:00:28.685965  722547 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/17857-697646/.minikube CaCertPath:/home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17857-697646/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17857-697646/.minikube}

	I1226 22:00:28.685994  722547 ubuntu.go:177] setting up certificates

	I1226 22:00:28.686004  722547 provision.go:83] configureAuth start

	I1226 22:00:28.686069  722547 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" functional-262391

	I1226 22:00:28.705691  722547 provision.go:138] copyHostCerts

	I1226 22:00:28.705766  722547 exec_runner.go:144] found /home/jenkins/minikube-integration/17857-697646/.minikube/ca.pem, removing ...

	I1226 22:00:28.705788  722547 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17857-697646/.minikube/ca.pem

	I1226 22:00:28.705861  722547 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17857-697646/.minikube/ca.pem (1082 bytes)

	I1226 22:00:28.705961  722547 exec_runner.go:144] found /home/jenkins/minikube-integration/17857-697646/.minikube/cert.pem, removing ...

	I1226 22:00:28.705965  722547 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17857-697646/.minikube/cert.pem

	I1226 22:00:28.705989  722547 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17857-697646/.minikube/cert.pem (1123 bytes)

	I1226 22:00:28.706043  722547 exec_runner.go:144] found /home/jenkins/minikube-integration/17857-697646/.minikube/key.pem, removing ...

	I1226 22:00:28.706049  722547 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17857-697646/.minikube/key.pem

	I1226 22:00:28.706071  722547 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17857-697646/.minikube/key.pem (1679 bytes)

	I1226 22:00:28.706111  722547 provision.go:112] generating server cert: /home/jenkins/minikube-integration/17857-697646/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca-key.pem org=jenkins.functional-262391 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube functional-262391]

	I1226 22:00:29.887340  722547 provision.go:172] copyRemoteCerts

	I1226 22:00:29.887421  722547 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1226 22:00:29.887471  722547 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-262391

	I1226 22:00:29.908213  722547 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33681 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/functional-262391/id_rsa Username:docker}

	I1226 22:00:30.031735  722547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/machines/server.pem --> /etc/docker/server.pem (1229 bytes)

	I1226 22:00:30.078161  722547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I1226 22:00:30.114221  722547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1226 22:00:30.150210  722547 provision.go:86] duration metric: configureAuth took 1.464169306s

	I1226 22:00:30.150239  722547 ubuntu.go:193] setting minikube options for container-runtime

	I1226 22:00:30.150456  722547 config.go:182] Loaded profile config "functional-262391": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4

	I1226 22:00:30.150560  722547 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-262391

	I1226 22:00:30.171705  722547 main.go:141] libmachine: Using SSH client type: native

	I1226 22:00:30.172118  722547 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x3beb50] 0x3c12c0 <nil>  [] 0s} 127.0.0.1 33681 <nil> <nil>}

	I1226 22:00:30.172133  722547 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I1226 22:00:35.621496  722547 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I1226 22:00:35.621509  722547 machine.go:91] provisioned docker machine in 7.2828605s

	I1226 22:00:35.621519  722547 start.go:300] post-start starting for "functional-262391" (driver="docker")

	I1226 22:00:35.621538  722547 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1226 22:00:35.621615  722547 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1226 22:00:35.621656  722547 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-262391

	I1226 22:00:35.641450  722547 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33681 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/functional-262391/id_rsa Username:docker}

	I1226 22:00:35.743339  722547 ssh_runner.go:195] Run: cat /etc/os-release

	I1226 22:00:35.747685  722547 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found

	I1226 22:00:35.747711  722547 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found

	I1226 22:00:35.747720  722547 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found

	I1226 22:00:35.747727  722547 info.go:137] Remote host: Ubuntu 22.04.3 LTS

	I1226 22:00:35.747736  722547 filesync.go:126] Scanning /home/jenkins/minikube-integration/17857-697646/.minikube/addons for local assets ...

	I1226 22:00:35.747794  722547 filesync.go:126] Scanning /home/jenkins/minikube-integration/17857-697646/.minikube/files for local assets ...

	I1226 22:00:35.747879  722547 filesync.go:149] local asset: /home/jenkins/minikube-integration/17857-697646/.minikube/files/etc/ssl/certs/7030362.pem -> 7030362.pem in /etc/ssl/certs

	I1226 22:00:35.747957  722547 filesync.go:149] local asset: /home/jenkins/minikube-integration/17857-697646/.minikube/files/etc/test/nested/copy/703036/hosts -> hosts in /etc/test/nested/copy/703036

	I1226 22:00:35.748000  722547 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs /etc/test/nested/copy/703036

	I1226 22:00:35.758519  722547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/files/etc/ssl/certs/7030362.pem --> /etc/ssl/certs/7030362.pem (1708 bytes)

	I1226 22:00:35.786952  722547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/files/etc/test/nested/copy/703036/hosts --> /etc/test/nested/copy/703036/hosts (40 bytes)

	I1226 22:00:35.815590  722547 start.go:303] post-start completed in 194.056661ms

	I1226 22:00:35.815660  722547 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I1226 22:00:35.815698  722547 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-262391

	I1226 22:00:35.836942  722547 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33681 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/functional-262391/id_rsa Username:docker}

	I1226 22:00:35.935418  722547 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"

	I1226 22:00:35.941700  722547 fix.go:56] fixHost completed within 7.626265465s

	I1226 22:00:35.941725  722547 start.go:83] releasing machines lock for "functional-262391", held for 7.626318747s

	I1226 22:00:35.941792  722547 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" functional-262391

	I1226 22:00:35.959472  722547 ssh_runner.go:195] Run: cat /version.json

	I1226 22:00:35.959488  722547 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1226 22:00:35.959516  722547 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-262391

	I1226 22:00:35.959523  722547 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-262391

	I1226 22:00:35.979276  722547 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33681 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/functional-262391/id_rsa Username:docker}

	I1226 22:00:35.986776  722547 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33681 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/functional-262391/id_rsa Username:docker}

	I1226 22:00:36.081395  722547 ssh_runner.go:195] Run: systemctl --version

	I1226 22:00:36.227930  722547 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I1226 22:00:36.378456  722547 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I1226 22:00:36.384171  722547 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1226 22:00:36.394811  722547 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found

	I1226 22:00:36.394896  722547 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1226 22:00:36.406083  722547 cni.go:259] no active bridge cni configs found in "/etc/cni/net.d" - nothing to disable

	I1226 22:00:36.406097  722547 start.go:475] detecting cgroup driver to use...

	I1226 22:00:36.406127  722547 detect.go:196] detected "cgroupfs" cgroup driver on host os

	I1226 22:00:36.406174  722547 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1226 22:00:36.420610  722547 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1226 22:00:36.434077  722547 docker.go:203] disabling cri-docker service (if available) ...

	I1226 22:00:36.434129  722547 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I1226 22:00:36.450077  722547 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I1226 22:00:36.464184  722547 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I1226 22:00:36.601520  722547 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I1226 22:00:36.743683  722547 docker.go:219] disabling docker service ...

	I1226 22:00:36.743750  722547 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I1226 22:00:36.762919  722547 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I1226 22:00:36.776505  722547 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I1226 22:00:36.907739  722547 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I1226 22:00:37.046877  722547 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I1226 22:00:37.061954  722547 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I1226 22:00:37.083181  722547 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I1226 22:00:37.083238  722547 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1226 22:00:37.095502  722547 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I1226 22:00:37.095577  722547 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1226 22:00:37.107861  722547 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I1226 22:00:37.120491  722547 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I1226 22:00:37.133017  722547 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1226 22:00:37.144416  722547 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1226 22:00:37.154923  722547 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1226 22:00:37.165717  722547 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1226 22:00:37.306326  722547 ssh_runner.go:195] Run: sudo systemctl restart crio

	I1226 22:00:43.142279  722547 ssh_runner.go:235] Completed: sudo systemctl restart crio: (5.835926872s)

	I1226 22:00:43.142299  722547 start.go:522] Will wait 60s for socket path /var/run/crio/crio.sock

	I1226 22:00:43.142353  722547 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I1226 22:00:43.147176  722547 start.go:543] Will wait 60s for crictl version

	I1226 22:00:43.147229  722547 ssh_runner.go:195] Run: which crictl

	I1226 22:00:43.151603  722547 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1226 22:00:43.196006  722547 start.go:559] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.24.6

	RuntimeApiVersion:  v1

	I1226 22:00:43.196084  722547 ssh_runner.go:195] Run: crio --version

	I1226 22:00:43.240454  722547 ssh_runner.go:195] Run: crio --version

	I1226 22:00:43.292076  722547 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.6 ...

	I1226 22:00:43.293737  722547 cli_runner.go:164] Run: docker network inspect functional-262391 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"

	I1226 22:00:43.311983  722547 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts

	I1226 22:00:43.318919  722547 out.go:177]   - apiserver.enable-admission-plugins=NamespaceAutoProvision

	I1226 22:00:43.320691  722547 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio

	I1226 22:00:43.320766  722547 ssh_runner.go:195] Run: sudo crictl images --output json

	I1226 22:00:43.367915  722547 crio.go:496] all images are preloaded for cri-o runtime.

	I1226 22:00:43.367928  722547 crio.go:415] Images already preloaded, skipping extraction

	I1226 22:00:43.367981  722547 ssh_runner.go:195] Run: sudo crictl images --output json

	I1226 22:00:43.409081  722547 crio.go:496] all images are preloaded for cri-o runtime.

	I1226 22:00:43.409095  722547 cache_images.go:84] Images are preloaded, skipping loading

	I1226 22:00:43.409174  722547 ssh_runner.go:195] Run: crio config

	I1226 22:00:43.462669  722547 extraconfig.go:124] Overwriting default enable-admission-plugins=NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota with user provided enable-admission-plugins=NamespaceAutoProvision for component apiserver

	I1226 22:00:43.462697  722547 cni.go:84] Creating CNI manager for ""

	I1226 22:00:43.462705  722547 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet

	I1226 22:00:43.462714  722547 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16

	I1226 22:00:43.462735  722547 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8441 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:functional-262391 NodeName:functional-262391 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceAutoProvision] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:ma

p[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1226 22:00:43.462876  722547 kubeadm.go:181] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.49.2

	  bindPort: 8441

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "functional-262391"

	  kubeletExtraArgs:

	    node-ip: 192.168.49.2

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceAutoProvision"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8441

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.28.4

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1226 22:00:43.462950  722547 kubeadm.go:976] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=functional-262391 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2

	[Install]

	 config:

	{KubernetesVersion:v1.28.4 ClusterName:functional-262391 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:}

	I1226 22:00:43.463012  722547 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4

	I1226 22:00:43.473762  722547 binaries.go:44] Found k8s binaries, skipping transfer

	I1226 22:00:43.473823  722547 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1226 22:00:43.484175  722547 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (427 bytes)

	I1226 22:00:43.505234  722547 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1226 22:00:43.526879  722547 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (1948 bytes)

	I1226 22:00:43.548396  722547 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts

	I1226 22:00:43.553114  722547 certs.go:56] Setting up /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/functional-262391 for IP: 192.168.49.2

	I1226 22:00:43.553137  722547 certs.go:190] acquiring lock for shared ca certs: {Name:mke6488a150c186a525017f74b8a69a9f5240d76 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 22:00:43.553290  722547 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/17857-697646/.minikube/ca.key

	I1226 22:00:43.553329  722547 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/17857-697646/.minikube/proxy-client-ca.key

	I1226 22:00:43.553398  722547 certs.go:315] skipping minikube-user signed cert generation: /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/functional-262391/client.key

	I1226 22:00:43.553447  722547 certs.go:315] skipping minikube signed cert generation: /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/functional-262391/apiserver.key.dd3b5fb2

	I1226 22:00:43.553493  722547 certs.go:315] skipping aggregator signed cert generation: /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/functional-262391/proxy-client.key

	I1226 22:00:43.553628  722547 certs.go:437] found cert: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/home/jenkins/minikube-integration/17857-697646/.minikube/certs/703036.pem (1338 bytes)

	W1226 22:00:43.553654  722547 certs.go:433] ignoring /home/jenkins/minikube-integration/17857-697646/.minikube/certs/home/jenkins/minikube-integration/17857-697646/.minikube/certs/703036_empty.pem, impossibly tiny 0 bytes

	I1226 22:00:43.553662  722547 certs.go:437] found cert: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca-key.pem (1675 bytes)

	I1226 22:00:43.553688  722547 certs.go:437] found cert: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/home/jenkins/minikube-integration/17857-697646/.minikube/certs/ca.pem (1082 bytes)

	I1226 22:00:43.553711  722547 certs.go:437] found cert: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/home/jenkins/minikube-integration/17857-697646/.minikube/certs/cert.pem (1123 bytes)

	I1226 22:00:43.553732  722547 certs.go:437] found cert: /home/jenkins/minikube-integration/17857-697646/.minikube/certs/home/jenkins/minikube-integration/17857-697646/.minikube/certs/key.pem (1679 bytes)

	I1226 22:00:43.553779  722547 certs.go:437] found cert: /home/jenkins/minikube-integration/17857-697646/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/17857-697646/.minikube/files/etc/ssl/certs/7030362.pem (1708 bytes)

	I1226 22:00:43.554518  722547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/functional-262391/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)

	I1226 22:00:43.583140  722547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/functional-262391/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1226 22:00:43.611782  722547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/functional-262391/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1226 22:00:43.640223  722547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/profiles/functional-262391/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1226 22:00:43.669676  722547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1226 22:00:43.698487  722547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1226 22:00:43.727275  722547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1226 22:00:43.755853  722547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1226 22:00:43.784903  722547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/certs/703036.pem --> /usr/share/ca-certificates/703036.pem (1338 bytes)

	I1226 22:00:43.814218  722547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/files/etc/ssl/certs/7030362.pem --> /usr/share/ca-certificates/7030362.pem (1708 bytes)

	I1226 22:00:43.843528  722547 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17857-697646/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1226 22:00:43.872256  722547 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1226 22:00:43.893667  722547 ssh_runner.go:195] Run: openssl version

	I1226 22:00:43.900745  722547 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/703036.pem && ln -fs /usr/share/ca-certificates/703036.pem /etc/ssl/certs/703036.pem"

	I1226 22:00:43.912680  722547 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/703036.pem

	I1226 22:00:43.917263  722547 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Dec 26 21:58 /usr/share/ca-certificates/703036.pem

	I1226 22:00:43.917320  722547 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/703036.pem

	I1226 22:00:43.926128  722547 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/703036.pem /etc/ssl/certs/51391683.0"

	I1226 22:00:43.937392  722547 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/7030362.pem && ln -fs /usr/share/ca-certificates/7030362.pem /etc/ssl/certs/7030362.pem"

	I1226 22:00:43.949381  722547 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/7030362.pem

	I1226 22:00:43.953970  722547 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Dec 26 21:58 /usr/share/ca-certificates/7030362.pem

	I1226 22:00:43.954036  722547 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/7030362.pem

	I1226 22:00:43.962837  722547 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/7030362.pem /etc/ssl/certs/3ec20f2e.0"

	I1226 22:00:43.973970  722547 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1226 22:00:43.985565  722547 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1226 22:00:43.990601  722547 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Dec 26 21:45 /usr/share/ca-certificates/minikubeCA.pem

	I1226 22:00:43.990662  722547 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1226 22:00:43.999545  722547 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1226 22:00:44.016353  722547 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd

	I1226 22:00:44.021173  722547 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400

	I1226 22:00:44.030337  722547 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400

	I1226 22:00:44.039063  722547 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400

	I1226 22:00:44.048003  722547 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400

	I1226 22:00:44.057012  722547 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400

	I1226 22:00:44.065764  722547 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400

	I1226 22:00:44.074648  722547 kubeadm.go:404] StartCluster: {Name:functional-262391 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1703498848-17857@sha256:81ae12a49915e4f02aa382dd3758a30a6649e1143c32b3d03309750104577c6c Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-262391 Namespace:default APIServerName:minikubeCA APIServerNames:

[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker Moun

tIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 AutoPauseInterval:1m0s GPUs:}

	I1226 22:00:44.074743  722547 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I1226 22:00:44.074802  722547 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I1226 22:00:44.161200  722547 cri.go:89] found id: "c822d55e3c7244a97ad01609df5b78c3fce79bd4eec64ad507404b68998a4d17"

	I1226 22:00:44.161212  722547 cri.go:89] found id: "e26ee425462b716831b83e20c569f4e514e2fa4c6413ef4056d6e78bd6facc52"

	I1226 22:00:44.161217  722547 cri.go:89] found id: "8c61210b5431b6b508e2020ed0dd8a0c96b01bd1f23453dbb7c3388e4cec5be9"

	I1226 22:00:44.161221  722547 cri.go:89] found id: "1ef2a1a3e47ebe5b2a04ac354c6ce5c027694d64a2536f75cc3431a8e1535ae8"

	I1226 22:00:44.161224  722547 cri.go:89] found id: "a34d8d5ed9ea4f1f416f5d388b6188b40b9af4f3a7333580289b2408beeb1b77"

	I1226 22:00:44.161230  722547 cri.go:89] found id: "966133bd698f243db888d7ef30b4d6b869951a41045f90da8aad478517af91f1"

	I1226 22:00:44.161235  722547 cri.go:89] found id: "d8f430ff9b1cde2991cdb177244c7ccd14d87e4017a42ed0df1ec6b53cbd6242"

	I1226 22:00:44.161238  722547 cri.go:89] found id: "0d6b996118725bf2ffc61c626851a3807df1a7c2c242876e22173b8ef119c623"

	I1226 22:00:44.161241  722547 cri.go:89] found id: "b2c24d01056cce186e9a79409051bea69c46dee8a050dbc29367a57fd6eae353"

	I1226 22:00:44.161247  722547 cri.go:89] found id: "83c55d47ff5e935f16789cfbc0fc8bab7c9a4bf757439bd724b64460894f5e51"

	I1226 22:00:44.161251  722547 cri.go:89] found id: "6207fb81b48065f5af35d56fd8b3167db0ada159d9f4222fae7353f737384f6a"

	I1226 22:00:44.161254  722547 cri.go:89] found id: "98e8aac979f46fea23543f19ff47e6bc4dcc0c65d0987b740953535e388d0092"

	I1226 22:00:44.161257  722547 cri.go:89] found id: "15834f50e1c0634720103dd691d7f396f3d713be5acb1c38130bd0723fa9d1a8"

	I1226 22:00:44.161263  722547 cri.go:89] found id: "545494fc13bba801136324a819a23116e43adc0b25ddd0b728dbff63726bda54"

	I1226 22:00:44.161266  722547 cri.go:89] found id: ""

	I1226 22:00:44.161315  722547 ssh_runner.go:195] Run: sudo runc list -f json

	I1226 22:00:44.199369  722547 cri.go:116] JSON = [{"ociVersion":"1.0.2-dev","id":"0d6b996118725bf2ffc61c626851a3807df1a7c2c242876e22173b8ef119c623","pid":0,"status":"stopped","bundle":"/run/containers/storage/overlay-containers/0d6b996118725bf2ffc61c626851a3807df1a7c2c242876e22173b8ef119c623/userdata","rootfs":"/var/lib/containers/storage/overlay/e6f9c7b2649a94c4245c21b8d83869f433959f5576317b997dba4b697ab6d040/merged","created":"2023-12-26T21:59:58.005039581Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"e1639c7a","io.kubernetes.container.name":"kube-scheduler","io.kubernetes.container.restartCount":"2","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"e1639c7a\",\"io.kubernetes.container.restartCount\":\"2\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminatio

nMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"0d6b996118725bf2ffc61c626851a3807df1a7c2c242876e22173b8ef119c623","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2023-12-26T21:59:57.930808397Z","io.kubernetes.cri-o.Image":"05c284c929889d88306fdb3dd14ee2d0132543740f9e247685243214fc3d2c54","io.kubernetes.cri-o.ImageName":"registry.k8s.io/kube-scheduler:v1.28.4","io.kubernetes.cri-o.ImageRef":"05c284c929889d88306fdb3dd14ee2d0132543740f9e247685243214fc3d2c54","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-scheduler\",\"io.kubernetes.pod.name\":\"kube-scheduler-functional-262391\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"4e848c64ec041214c76d5b254470a706\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-scheduler-functional-262391_4e848c64ec041214c76d5b254470a706/kube-scheduler/2.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-scheduler\",

\"attempt\":2}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/e6f9c7b2649a94c4245c21b8d83869f433959f5576317b997dba4b697ab6d040/merged","io.kubernetes.cri-o.Name":"k8s_kube-scheduler_kube-scheduler-functional-262391_kube-system_4e848c64ec041214c76d5b254470a706_2","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/366e6735458fedfa28cfa70967455c9882b1068bc47fbc77eb10a3c732b36f54/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"366e6735458fedfa28cfa70967455c9882b1068bc47fbc77eb10a3c732b36f54","io.kubernetes.cri-o.SandboxName":"k8s_kube-scheduler-functional-262391_kube-system_4e848c64ec041214c76d5b254470a706_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/4e848c64ec041214c76d5b254470a706/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_rel

abel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/4e848c64ec041214c76d5b254470a706/containers/kube-scheduler/cae3b81f\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/kubernetes/scheduler.conf\",\"host_path\":\"/etc/kubernetes/scheduler.conf\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-scheduler-functional-262391","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"4e848c64ec041214c76d5b254470a706","kubernetes.io/config.hash":"4e848c64ec041214c76d5b254470a706","kubernetes.io/config.seen":"2023-12-26T21:58:44.256144332Z","kubernetes.io/config.source":"file"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"15834f50e1c0634720103dd691d7f396f3d713be5acb1c38130bd0723fa9d1a8","pid":0,"status":"stopped","bundle":"/run/containers/storage/overlay-containers/15834f50e1c0634720103dd691d7f396f3d713be5acb1c38130bd0723

fa9d1a8/userdata","rootfs":"/var/lib/containers/storage/overlay/2c37b6f96a67b2d7e480fbe80ea2c6dc9377e9e8443de9eb812392cc2e63749e/merged","created":"2023-12-26T21:59:46.197031125Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"62225a40","io.kubernetes.container.name":"coredns","io.kubernetes.container.ports":"[{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}]","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"62225a40\",\"io.kubernetes.container.ports\":\"[{\\\"name\\\":\\\"dns\\\",\\\"containerPort\\\":53,\\\"protocol\\\":\\\"UDP\\\"},{\\\"name\\\":\\\"dns-tcp\\\",\\\"containerPort\\\":53,\\\"protocol\\\":\\\"TCP\\\"},{\\\"name\\\":\\\"metrics\\\

",\\\"containerPort\\\":9153,\\\"protocol\\\":\\\"TCP\\\"}]\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"15834f50e1c0634720103dd691d7f396f3d713be5acb1c38130bd0723fa9d1a8","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2023-12-26T21:59:45.956486274Z","io.kubernetes.cri-o.IP.0":"10.244.0.2","io.kubernetes.cri-o.Image":"97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108","io.kubernetes.cri-o.ImageName":"registry.k8s.io/coredns/coredns:v1.10.1","io.kubernetes.cri-o.ImageRef":"97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"coredns\",\"io.kubernetes.pod.name\":\"coredns-5dd5756b68-rvzcn\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\

":\"d1d1dee1-9964-4293-b138-a8cba4d4a1b9\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_coredns-5dd5756b68-rvzcn_d1d1dee1-9964-4293-b138-a8cba4d4a1b9/coredns/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"coredns\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/2c37b6f96a67b2d7e480fbe80ea2c6dc9377e9e8443de9eb812392cc2e63749e/merged","io.kubernetes.cri-o.Name":"k8s_coredns_coredns-5dd5756b68-rvzcn_kube-system_d1d1dee1-9964-4293-b138-a8cba4d4a1b9_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/fef827a05791974659b0b84ebbfb174647c84037c272f8d37e49dd4e0a7f2eb5/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"fef827a05791974659b0b84ebbfb174647c84037c272f8d37e49dd4e0a7f2eb5","io.kubernetes.cri-o.SandboxName":"k8s_coredns-5dd5756b68-rvzcn_kube-system_d1d1dee1-9964-4293-b138-a8cba4d4a1b9_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.c

ri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/etc/coredns\",\"host_path\":\"/var/lib/kubelet/pods/d1d1dee1-9964-4293-b138-a8cba4d4a1b9/volumes/kubernetes.io~configmap/config-volume\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/d1d1dee1-9964-4293-b138-a8cba4d4a1b9/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/d1d1dee1-9964-4293-b138-a8cba4d4a1b9/containers/coredns/669fb498\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/run/secrets/kubernetes.io/serviceaccount\",\"host_path\":\"/var/lib/kubelet/pods/d1d1dee1-9964-4293-b138-a8cba4d4a1b9/volumes/kubernetes.io~projected/kube-api-access-k49lp\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"coredns-5dd5756b68-rvzcn","io.kubernetes.pod.namespace":"ku

be-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"d1d1dee1-9964-4293-b138-a8cba4d4a1b9","kubernetes.io/config.seen":"2023-12-26T21:59:36.030593117Z","kubernetes.io/config.source":"api"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"1ef2a1a3e47ebe5b2a04ac354c6ce5c027694d64a2536f75cc3431a8e1535ae8","pid":0,"status":"stopped","bundle":"/run/containers/storage/overlay-containers/1ef2a1a3e47ebe5b2a04ac354c6ce5c027694d64a2536f75cc3431a8e1535ae8/userdata","rootfs":"/var/lib/containers/storage/overlay/46f087607222d23d65b874e64b3479830553447b842a0bee6d8ad26d7bf4ea98/merged","created":"2023-12-26T21:59:58.276848051Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"b60ddd3e","io.kubernetes.container.name":"kube-controller-manager","io.kubernetes.container.restartCount":"2","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.con

tainer.hash\":\"b60ddd3e\",\"io.kubernetes.container.restartCount\":\"2\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"1ef2a1a3e47ebe5b2a04ac354c6ce5c027694d64a2536f75cc3431a8e1535ae8","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2023-12-26T21:59:58.091964135Z","io.kubernetes.cri-o.Image":"9961cbceaf234d59b7dcf8a197a024f3e3ce4b7fe2b67c2378efd3d209ca994b","io.kubernetes.cri-o.ImageName":"registry.k8s.io/kube-controller-manager:v1.28.4","io.kubernetes.cri-o.ImageRef":"9961cbceaf234d59b7dcf8a197a024f3e3ce4b7fe2b67c2378efd3d209ca994b","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-controller-manager\",\"io.kubernetes.pod.name\":\"kube-controller-manager-functional-262391\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"3e22602710f9a895d535604465d6ab

72\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-controller-manager-functional-262391_3e22602710f9a895d535604465d6ab72/kube-controller-manager/2.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-controller-manager\",\"attempt\":2}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/46f087607222d23d65b874e64b3479830553447b842a0bee6d8ad26d7bf4ea98/merged","io.kubernetes.cri-o.Name":"k8s_kube-controller-manager_kube-controller-manager-functional-262391_kube-system_3e22602710f9a895d535604465d6ab72_2","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/ac3b0cf8e4b5b312e960910cb2b32e65a942cf16f1fac38ba8edfbddf7c7793d/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"ac3b0cf8e4b5b312e960910cb2b32e65a942cf16f1fac38ba8edfbddf7c7793d","io.kubernetes.cri-o.SandboxName":"k8s_kube-controller-manager-functional-262391_kube-system_3e22602710f9a895d535604465d6ab72_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kub

ernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/etc/ca-certificates\",\"host_path\":\"/etc/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/3e22602710f9a895d535604465d6ab72/containers/kube-controller-manager/747c3f01\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/3e22602710f9a895d535604465d6ab72/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/ssl/certs\",\"host_path\":\"/etc/ssl/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/kubernetes/controller-manager.conf\",\"host_path\":\"/etc/kubernetes/controller-manager.conf\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/share/ca-certificates\"

,\"host_path\":\"/usr/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/certs\",\"host_path\":\"/var/lib/minikube/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/local/share/ca-certificates\",\"host_path\":\"/usr/local/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/libexec/kubernetes/kubelet-plugins/volume/exec\",\"host_path\":\"/usr/libexec/kubernetes/kubelet-plugins/volume/exec\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-controller-manager-functional-262391","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"3e22602710f9a895d535604465d6ab72","kubernetes.io/config.hash":"3e22602710f9a895d535604465d6ab72","kubernetes.io/config.seen":"2023-12-26T21:58:44.256143077Z","kubernetes.io/config.source":"file

"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"545494fc13bba801136324a819a23116e43adc0b25ddd0b728dbff63726bda54","pid":0,"status":"stopped","bundle":"/run/containers/storage/overlay-containers/545494fc13bba801136324a819a23116e43adc0b25ddd0b728dbff63726bda54/userdata","rootfs":"/var/lib/containers/storage/overlay/dbd9b792b815ccc850e73d5ac3ecd2e7975581ef3d8af89a22f63b2e9c5d75c7/merged","created":"2023-12-26T21:59:46.187835709Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"55ae7856","io.kubernetes.container.name":"kube-apiserver","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"55ae7856\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernete

s.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"545494fc13bba801136324a819a23116e43adc0b25ddd0b728dbff63726bda54","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2023-12-26T21:59:45.925397009Z","io.kubernetes.cri-o.Image":"04b4c447bb9d4840af3bf7e836397379d65df87c86e55dcd27f31a8d11df2419","io.kubernetes.cri-o.ImageName":"registry.k8s.io/kube-apiserver:v1.28.4","io.kubernetes.cri-o.ImageRef":"04b4c447bb9d4840af3bf7e836397379d65df87c86e55dcd27f31a8d11df2419","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-apiserver\",\"io.kubernetes.pod.name\":\"kube-apiserver-functional-262391\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"df6200335158d08f59d995a75303187b\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-apiserver-functional-262391_df6200335158d08f59d995a75303187b/kube-apiserver/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-apiserver\",\"attempt\":1}","io.kubernetes.cri-o.Mou

ntPoint":"/var/lib/containers/storage/overlay/dbd9b792b815ccc850e73d5ac3ecd2e7975581ef3d8af89a22f63b2e9c5d75c7/merged","io.kubernetes.cri-o.Name":"k8s_kube-apiserver_kube-apiserver-functional-262391_kube-system_df6200335158d08f59d995a75303187b_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/cb35f2f6fa9bf27026f38376801e38eea4561a9f629ff5339aa0bf5d18c1139c/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"cb35f2f6fa9bf27026f38376801e38eea4561a9f629ff5339aa0bf5d18c1139c","io.kubernetes.cri-o.SandboxName":"k8s_kube-apiserver-functional-262391_kube-system_df6200335158d08f59d995a75303187b_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/df6200335158d08f59d995a75303187b/containers/kube-apiserver/44f93602\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\

":false},{\"container_path\":\"/etc/ca-certificates\",\"host_path\":\"/etc/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/df6200335158d08f59d995a75303187b/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/share/ca-certificates\",\"host_path\":\"/usr/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/ssl/certs\",\"host_path\":\"/etc/ssl/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/certs\",\"host_path\":\"/var/lib/minikube/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/local/share/ca-certificates\",\"host_path\":\"/usr/local/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-apiserver-functional-262391","io.ku

bernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"df6200335158d08f59d995a75303187b","kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint":"192.168.49.2:8441","kubernetes.io/config.hash":"df6200335158d08f59d995a75303187b","kubernetes.io/config.seen":"2023-12-26T21:58:44.256134954Z","kubernetes.io/config.source":"file"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"6207fb81b48065f5af35d56fd8b3167db0ada159d9f4222fae7353f737384f6a","pid":0,"status":"stopped","bundle":"/run/containers/storage/overlay-containers/6207fb81b48065f5af35d56fd8b3167db0ada159d9f4222fae7353f737384f6a/userdata","rootfs":"/var/lib/containers/storage/overlay/d251e42c242a820a5fb469fa7d2496bedf2d5a0b78b98e4f64627d9207902e25/merged","created":"2023-12-26T21:59:46.23756494Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"cc0ac28c","io.kubernetes.container.name":"kube-proxy","io.kubernetes.container.restartCount":"1","io.kubernetes.container.t

erminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"cc0ac28c\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"6207fb81b48065f5af35d56fd8b3167db0ada159d9f4222fae7353f737384f6a","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2023-12-26T21:59:45.982940625Z","io.kubernetes.cri-o.Image":"3ca3ca488cf13fde14cfc4b3ffde0c53a8c161b030f4a444a797fba6aef38c39","io.kubernetes.cri-o.ImageName":"registry.k8s.io/kube-proxy:v1.28.4","io.kubernetes.cri-o.ImageRef":"3ca3ca488cf13fde14cfc4b3ffde0c53a8c161b030f4a444a797fba6aef38c39","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-proxy\",\"io.kubernetes.pod.name\":\"kube-proxy-9m7p9\

",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"c8184d93-3481-4aa6-bbda-6f73ecb4ee2e\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-proxy-9m7p9_c8184d93-3481-4aa6-bbda-6f73ecb4ee2e/kube-proxy/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-proxy\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/d251e42c242a820a5fb469fa7d2496bedf2d5a0b78b98e4f64627d9207902e25/merged","io.kubernetes.cri-o.Name":"k8s_kube-proxy_kube-proxy-9m7p9_kube-system_c8184d93-3481-4aa6-bbda-6f73ecb4ee2e_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/ced93628785c08737c21e870f51dfccb3a72bf75cbb625a905b814cdb39d300c/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"ced93628785c08737c21e870f51dfccb3a72bf75cbb625a905b814cdb39d300c","io.kubernetes.cri-o.SandboxName":"k8s_kube-proxy-9m7p9_kube-system_c8184d93-3481-4aa6-bbda-6f73ecb4ee2e_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"fals

e","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/run/xtables.lock\",\"host_path\":\"/run/xtables.lock\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/lib/modules\",\"host_path\":\"/lib/modules\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/c8184d93-3481-4aa6-bbda-6f73ecb4ee2e/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/c8184d93-3481-4aa6-bbda-6f73ecb4ee2e/containers/kube-proxy/7c33ce51\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/kube-proxy\",\"host_path\":\"/var/lib/kubelet/pods/c8184d93-3481-4aa6-bbda-6f73ecb4ee2e/volumes/kubernetes.io~configmap/kube-proxy\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container

_path\":\"/var/run/secrets/kubernetes.io/serviceaccount\",\"host_path\":\"/var/lib/kubelet/pods/c8184d93-3481-4aa6-bbda-6f73ecb4ee2e/volumes/kubernetes.io~projected/kube-api-access-hqstw\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-proxy-9m7p9","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"c8184d93-3481-4aa6-bbda-6f73ecb4ee2e","kubernetes.io/config.seen":"2023-12-26T21:59:04.932604429Z","kubernetes.io/config.source":"api"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"8c61210b5431b6b508e2020ed0dd8a0c96b01bd1f23453dbb7c3388e4cec5be9","pid":0,"status":"stopped","bundle":"/run/containers/storage/overlay-containers/8c61210b5431b6b508e2020ed0dd8a0c96b01bd1f23453dbb7c3388e4cec5be9/userdata","rootfs":"/var/lib/containers/storage/overlay/5ffceda8474d3eef9ee31929048476a6259edcea4a696b4ce8b5a610ce691c2c/merged","created":"2023-12-26T21:59:58.27596753Z","annotations":{"io.container.manager":"cri-

o","io.kubernetes.container.hash":"55ae7856","io.kubernetes.container.name":"kube-apiserver","io.kubernetes.container.restartCount":"2","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"55ae7856\",\"io.kubernetes.container.restartCount\":\"2\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"8c61210b5431b6b508e2020ed0dd8a0c96b01bd1f23453dbb7c3388e4cec5be9","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2023-12-26T21:59:58.118598938Z","io.kubernetes.cri-o.Image":"04b4c447bb9d4840af3bf7e836397379d65df87c86e55dcd27f31a8d11df2419","io.kubernetes.cri-o.ImageName":"registry.k8s.io/kube-apiserver:v1.28.4","io.kubernetes.cri-o.ImageRef":"04b4c447bb9d4840af3bf7e83

6397379d65df87c86e55dcd27f31a8d11df2419","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-apiserver\",\"io.kubernetes.pod.name\":\"kube-apiserver-functional-262391\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"df6200335158d08f59d995a75303187b\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-apiserver-functional-262391_df6200335158d08f59d995a75303187b/kube-apiserver/2.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-apiserver\",\"attempt\":2}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/5ffceda8474d3eef9ee31929048476a6259edcea4a696b4ce8b5a610ce691c2c/merged","io.kubernetes.cri-o.Name":"k8s_kube-apiserver_kube-apiserver-functional-262391_kube-system_df6200335158d08f59d995a75303187b_2","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/cb35f2f6fa9bf27026f38376801e38eea4561a9f629ff5339aa0bf5d18c1139c/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"cb35f2f6fa9bf27026f38376801e38eea

4561a9f629ff5339aa0bf5d18c1139c","io.kubernetes.cri-o.SandboxName":"k8s_kube-apiserver-functional-262391_kube-system_df6200335158d08f59d995a75303187b_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/df6200335158d08f59d995a75303187b/containers/kube-apiserver/18039c4b\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/ca-certificates\",\"host_path\":\"/etc/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/df6200335158d08f59d995a75303187b/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/share/ca-certificates\",\"host_path\":\"/usr/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selin

ux_relabel\":false},{\"container_path\":\"/etc/ssl/certs\",\"host_path\":\"/etc/ssl/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/certs\",\"host_path\":\"/var/lib/minikube/certs\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/usr/local/share/ca-certificates\",\"host_path\":\"/usr/local/share/ca-certificates\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-apiserver-functional-262391","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"df6200335158d08f59d995a75303187b","kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint":"192.168.49.2:8441","kubernetes.io/config.hash":"df6200335158d08f59d995a75303187b","kubernetes.io/config.seen":"2023-12-26T21:58:44.256134954Z","kubernetes.io/config.source":"file"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"966133bd698f243db888d7ef30b4d6b86995

1a41045f90da8aad478517af91f1","pid":0,"status":"stopped","bundle":"/run/containers/storage/overlay-containers/966133bd698f243db888d7ef30b4d6b869951a41045f90da8aad478517af91f1/userdata","rootfs":"/var/lib/containers/storage/overlay/bc3ebacb4370729bf822444c829e3715029fd1f5fad73d6a7dfc302bdb147f19/merged","created":"2023-12-26T21:59:58.269023517Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"71d8d38b","io.kubernetes.container.name":"etcd","io.kubernetes.container.restartCount":"2","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"71d8d38b\",\"io.kubernetes.container.restartCount\":\"2\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"966133bd698f243db888d7

ef30b4d6b869951a41045f90da8aad478517af91f1","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2023-12-26T21:59:58.027531275Z","io.kubernetes.cri-o.Image":"9cdd6470f48c8b127530b7ce6ea4b3524137984481e48bcde619735890840ace","io.kubernetes.cri-o.ImageName":"registry.k8s.io/etcd:3.5.9-0","io.kubernetes.cri-o.ImageRef":"9cdd6470f48c8b127530b7ce6ea4b3524137984481e48bcde619735890840ace","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"etcd\",\"io.kubernetes.pod.name\":\"etcd-functional-262391\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"2992b81af20454dbc013086a174a1ba7\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_etcd-functional-262391_2992b81af20454dbc013086a174a1ba7/etcd/2.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"etcd\",\"attempt\":2}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/bc3ebacb4370729bf822444c829e3715029fd1f5fad73d6a7dfc302bdb147f19/merged","io.kubernetes.cri-o.Name":"k8s_etcd_e

tcd-functional-262391_kube-system_2992b81af20454dbc013086a174a1ba7_2","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/04fe9bb0de4db7857fe6aa33597481a9ee720ad67bece900c5b70753748a4820/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"04fe9bb0de4db7857fe6aa33597481a9ee720ad67bece900c5b70753748a4820","io.kubernetes.cri-o.SandboxName":"k8s_etcd-functional-262391_kube-system_2992b81af20454dbc013086a174a1ba7_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/2992b81af20454dbc013086a174a1ba7/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/2992b81af20454dbc013086a174a1ba7/containers/etcd/09dfedbc\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"con

tainer_path\":\"/var/lib/minikube/etcd\",\"host_path\":\"/var/lib/minikube/etcd\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/minikube/certs/etcd\",\"host_path\":\"/var/lib/minikube/certs/etcd\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"etcd-functional-262391","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"2992b81af20454dbc013086a174a1ba7","kubeadm.kubernetes.io/etcd.advertise-client-urls":"https://192.168.49.2:2379","kubernetes.io/config.hash":"2992b81af20454dbc013086a174a1ba7","kubernetes.io/config.seen":"2023-12-26T21:58:44.256146695Z","kubernetes.io/config.source":"file"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"98e8aac979f46fea23543f19ff47e6bc4dcc0c65d0987b740953535e388d0092","pid":0,"status":"stopped","bundle":"/run/containers/storage/overlay-containers/98e8aac979f46fea23543f19ff47e6bc4dcc0c65d0987b740953535e388d0092/userdata","

rootfs":"/var/lib/containers/storage/overlay/e1f8e2dab20b23a1c46bd975534f7b1d734fb88e783d62b8ff4707bc6dec701d/merged","created":"2023-12-26T21:59:46.240643712Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"21c8b9cf","io.kubernetes.container.name":"storage-provisioner","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"21c8b9cf\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"98e8aac979f46fea23543f19ff47e6bc4dcc0c65d0987b740953535e388d0092","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2023-12-26T21:59:45.962954088Z","io.kubernetes.c

ri-o.Image":"ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","io.kubernetes.cri-o.ImageName":"gcr.io/k8s-minikube/storage-provisioner:v5","io.kubernetes.cri-o.ImageRef":"ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"storage-provisioner\",\"io.kubernetes.pod.name\":\"storage-provisioner\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"d0995a50-650c-4928-83fc-533af41c36fc\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_storage-provisioner_d0995a50-650c-4928-83fc-533af41c36fc/storage-provisioner/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"storage-provisioner\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/e1f8e2dab20b23a1c46bd975534f7b1d734fb88e783d62b8ff4707bc6dec701d/merged","io.kubernetes.cri-o.Name":"k8s_storage-provisioner_storage-provisioner_kube-system_d0995a50-650c-4928-83fc-533af41c36fc_1","io.kubernetes.cri-o.Res

olvPath":"/run/containers/storage/overlay-containers/995e88ed74fef62deb6947fa0d06332dc498407081e6e8b35c83661d3d6e0dc8/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"995e88ed74fef62deb6947fa0d06332dc498407081e6e8b35c83661d3d6e0dc8","io.kubernetes.cri-o.SandboxName":"k8s_storage-provisioner_kube-system_d0995a50-650c-4928-83fc-533af41c36fc_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/tmp\",\"host_path\":\"/tmp\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/d0995a50-650c-4928-83fc-533af41c36fc/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/d0995a50-650c-4928-83fc-533af41c36fc/containers/storage-provisioner/adaffa4b\",\"readonly\":false,\"pro

pagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/run/secrets/kubernetes.io/serviceaccount\",\"host_path\":\"/var/lib/kubelet/pods/d0995a50-650c-4928-83fc-533af41c36fc/volumes/kubernetes.io~projected/kube-api-access-475zx\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"storage-provisioner","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"d0995a50-650c-4928-83fc-533af41c36fc","kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"v1\",\"kind\":\"Pod\",\"metadata\":{\"annotations\":{},\"labels\":{\"addonmanager.kubernetes.io/mode\":\"Reconcile\",\"integration-test\":\"storage-provisioner\"},\"name\":\"storage-provisioner\",\"namespace\":\"kube-system\"},\"spec\":{\"containers\":[{\"command\":[\"/storage-provisioner\"],\"image\":\"gcr.io/k8s-minikube/storage-provisioner:v5\",\"imagePullPolicy\":\"IfNotPresent\",\"name\":\"storage-provisioner\",\"volumeMounts\":[{\"mount

Path\":\"/tmp\",\"name\":\"tmp\"}]}],\"hostNetwork\":true,\"serviceAccountName\":\"storage-provisioner\",\"volumes\":[{\"hostPath\":{\"path\":\"/tmp\",\"type\":\"Directory\"},\"name\":\"tmp\"}]}}\n","kubernetes.io/config.seen":"2023-12-26T21:59:36.036905965Z","kubernetes.io/config.source":"api"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"a34d8d5ed9ea4f1f416f5d388b6188b40b9af4f3a7333580289b2408beeb1b77","pid":0,"status":"stopped","bundle":"/run/containers/storage/overlay-containers/a34d8d5ed9ea4f1f416f5d388b6188b40b9af4f3a7333580289b2408beeb1b77/userdata","rootfs":"/var/lib/containers/storage/overlay/c4f7506b2222c1ce1740a835fdc2479f246c9d5eb99d93109bed4afc955875f7/merged","created":"2023-12-26T21:59:58.331142765Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"21c8b9cf","io.kubernetes.container.name":"storage-provisioner","io.kubernetes.container.restartCount":"2","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMess

agePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"21c8b9cf\",\"io.kubernetes.container.restartCount\":\"2\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"a34d8d5ed9ea4f1f416f5d388b6188b40b9af4f3a7333580289b2408beeb1b77","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2023-12-26T21:59:58.059291211Z","io.kubernetes.cri-o.Image":"ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","io.kubernetes.cri-o.ImageName":"gcr.io/k8s-minikube/storage-provisioner:v5","io.kubernetes.cri-o.ImageRef":"ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"storage-provisioner\",\"io.kubernetes.pod.name\":\"storage-provisioner\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.

pod.uid\":\"d0995a50-650c-4928-83fc-533af41c36fc\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_storage-provisioner_d0995a50-650c-4928-83fc-533af41c36fc/storage-provisioner/2.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"storage-provisioner\",\"attempt\":2}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/c4f7506b2222c1ce1740a835fdc2479f246c9d5eb99d93109bed4afc955875f7/merged","io.kubernetes.cri-o.Name":"k8s_storage-provisioner_storage-provisioner_kube-system_d0995a50-650c-4928-83fc-533af41c36fc_2","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/995e88ed74fef62deb6947fa0d06332dc498407081e6e8b35c83661d3d6e0dc8/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"995e88ed74fef62deb6947fa0d06332dc498407081e6e8b35c83661d3d6e0dc8","io.kubernetes.cri-o.SandboxName":"k8s_storage-provisioner_kube-system_d0995a50-650c-4928-83fc-533af41c36fc_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinO

nce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/tmp\",\"host_path\":\"/tmp\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/d0995a50-650c-4928-83fc-533af41c36fc/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/d0995a50-650c-4928-83fc-533af41c36fc/containers/storage-provisioner/419a5a4c\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/run/secrets/kubernetes.io/serviceaccount\",\"host_path\":\"/var/lib/kubelet/pods/d0995a50-650c-4928-83fc-533af41c36fc/volumes/kubernetes.io~projected/kube-api-access-475zx\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"storage-provisioner","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernet

es.pod.uid":"d0995a50-650c-4928-83fc-533af41c36fc","kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"v1\",\"kind\":\"Pod\",\"metadata\":{\"annotations\":{},\"labels\":{\"addonmanager.kubernetes.io/mode\":\"Reconcile\",\"integration-test\":\"storage-provisioner\"},\"name\":\"storage-provisioner\",\"namespace\":\"kube-system\"},\"spec\":{\"containers\":[{\"command\":[\"/storage-provisioner\"],\"image\":\"gcr.io/k8s-minikube/storage-provisioner:v5\",\"imagePullPolicy\":\"IfNotPresent\",\"name\":\"storage-provisioner\",\"volumeMounts\":[{\"mountPath\":\"/tmp\",\"name\":\"tmp\"}]}],\"hostNetwork\":true,\"serviceAccountName\":\"storage-provisioner\",\"volumes\":[{\"hostPath\":{\"path\":\"/tmp\",\"type\":\"Directory\"},\"name\":\"tmp\"}]}}\n","kubernetes.io/config.seen":"2023-12-26T21:59:36.036905965Z","kubernetes.io/config.source":"api"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"b2c24d01056cce186e9a79409051bea69c46dee8a050dbc29367a57fd6eae353","pid":0,"status":"stopped","bundle":"/run/cont

ainers/storage/overlay-containers/b2c24d01056cce186e9a79409051bea69c46dee8a050dbc29367a57fd6eae353/userdata","rootfs":"/var/lib/containers/storage/overlay/cf500b598921e0475d916120485c64ab429394eac00c42ab7dfe3861829130d6/merged","created":"2023-12-26T21:59:46.20206831Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"171df1b7","io.kubernetes.container.name":"kindnet-cni","io.kubernetes.container.restartCount":"1","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"171df1b7\",\"io.kubernetes.container.restartCount\":\"1\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"b2c24d01056cce186e9a79409051bea69c46dee8a050dbc29367a57fd6eae353","io.kubernetes.cri-o.Conta

inerType":"container","io.kubernetes.cri-o.Created":"2023-12-26T21:59:46.01393518Z","io.kubernetes.cri-o.Image":"04b4eaa3d3db8abea4b9ea4d10a0926ebb31db5a31b673aa1cf7a4b3af4add26","io.kubernetes.cri-o.ImageName":"docker.io/kindest/kindnetd:v20230809-80a64d96","io.kubernetes.cri-o.ImageRef":"04b4eaa3d3db8abea4b9ea4d10a0926ebb31db5a31b673aa1cf7a4b3af4add26","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kindnet-cni\",\"io.kubernetes.pod.name\":\"kindnet-cbhzk\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"3d9633f7-0f86-48fa-a658-29ed4c3dc8b9\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kindnet-cbhzk_3d9633f7-0f86-48fa-a658-29ed4c3dc8b9/kindnet-cni/1.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kindnet-cni\",\"attempt\":1}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/cf500b598921e0475d916120485c64ab429394eac00c42ab7dfe3861829130d6/merged","io.kubernetes.cri-o.Name":"k8s_kindnet-cni_kindnet-cbhzk_kube-system_3d9633f7-0f

86-48fa-a658-29ed4c3dc8b9_1","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/d60ff4eb1f096d6d9c9798e18fcd6ea0f7621bfd4c074fe40f3e5b10c9766013/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"d60ff4eb1f096d6d9c9798e18fcd6ea0f7621bfd4c074fe40f3e5b10c9766013","io.kubernetes.cri-o.SandboxName":"k8s_kindnet-cbhzk_kube-system_3d9633f7-0f86-48fa-a658-29ed4c3dc8b9_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/run/xtables.lock\",\"host_path\":\"/run/xtables.lock\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/lib/modules\",\"host_path\":\"/lib/modules\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/3d9633f7-0f86-48fa-a658-29ed4c3dc8b9/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux

_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/3d9633f7-0f86-48fa-a658-29ed4c3dc8b9/containers/kindnet-cni/0836b898\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/cni/net.d\",\"host_path\":\"/etc/cni/net.d\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/run/secrets/kubernetes.io/serviceaccount\",\"host_path\":\"/var/lib/kubelet/pods/3d9633f7-0f86-48fa-a658-29ed4c3dc8b9/volumes/kubernetes.io~projected/kube-api-access-kt5bv\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kindnet-cbhzk","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"3d9633f7-0f86-48fa-a658-29ed4c3dc8b9","kubernetes.io/config.seen":"2023-12-26T21:59:04.930528596Z","kubernetes.io/config.source":"api"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"c822d55e3c7244a97ad01609df5b78c3fce79bd4eec6

4ad507404b68998a4d17","pid":0,"status":"stopped","bundle":"/run/containers/storage/overlay-containers/c822d55e3c7244a97ad01609df5b78c3fce79bd4eec64ad507404b68998a4d17/userdata","rootfs":"/var/lib/containers/storage/overlay/ee3db6ae751c338538b9f35e2d0f07a11cf1b5e2c8b3019944dc06dbbb4d4b25/merged","created":"2023-12-26T22:00:17.664018469Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"62225a40","io.kubernetes.container.name":"coredns","io.kubernetes.container.ports":"[{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}]","io.kubernetes.container.restartCount":"2","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"62225a40\",\"io.kubernetes.container.ports\":\"[{\\\"name\\\":\\\"dns\\\",\\\"conta

inerPort\\\":53,\\\"protocol\\\":\\\"UDP\\\"},{\\\"name\\\":\\\"dns-tcp\\\",\\\"containerPort\\\":53,\\\"protocol\\\":\\\"TCP\\\"},{\\\"name\\\":\\\"metrics\\\",\\\"containerPort\\\":9153,\\\"protocol\\\":\\\"TCP\\\"}]\",\"io.kubernetes.container.restartCount\":\"2\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"c822d55e3c7244a97ad01609df5b78c3fce79bd4eec64ad507404b68998a4d17","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2023-12-26T22:00:17.6292816Z","io.kubernetes.cri-o.IP.0":"10.244.0.2","io.kubernetes.cri-o.Image":"97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108","io.kubernetes.cri-o.ImageName":"registry.k8s.io/coredns/coredns:v1.10.1","io.kubernetes.cri-o.ImageRef":"97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.

container.name\":\"coredns\",\"io.kubernetes.pod.name\":\"coredns-5dd5756b68-rvzcn\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"d1d1dee1-9964-4293-b138-a8cba4d4a1b9\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_coredns-5dd5756b68-rvzcn_d1d1dee1-9964-4293-b138-a8cba4d4a1b9/coredns/2.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"coredns\",\"attempt\":2}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/ee3db6ae751c338538b9f35e2d0f07a11cf1b5e2c8b3019944dc06dbbb4d4b25/merged","io.kubernetes.cri-o.Name":"k8s_coredns_coredns-5dd5756b68-rvzcn_kube-system_d1d1dee1-9964-4293-b138-a8cba4d4a1b9_2","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/fef827a05791974659b0b84ebbfb174647c84037c272f8d37e49dd4e0a7f2eb5/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"fef827a05791974659b0b84ebbfb174647c84037c272f8d37e49dd4e0a7f2eb5","io.kubernetes.cri-o.SandboxName":"k8s_coredns-5dd5756b68-rvzcn_kube-system_d1d1dee1-9964-4293-

b138-a8cba4d4a1b9_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/etc/coredns\",\"host_path\":\"/var/lib/kubelet/pods/d1d1dee1-9964-4293-b138-a8cba4d4a1b9/volumes/kubernetes.io~configmap/config-volume\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/d1d1dee1-9964-4293-b138-a8cba4d4a1b9/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/d1d1dee1-9964-4293-b138-a8cba4d4a1b9/containers/coredns/ad1e97bc\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/run/secrets/kubernetes.io/serviceaccount\",\"host_path\":\"/var/lib/kubelet/pods/d1d1dee1-9964-4293-b138-a8cba4d4a1b9/volumes/kubernetes.io~projected/kube-api-access-k

49lp\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"coredns-5dd5756b68-rvzcn","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"d1d1dee1-9964-4293-b138-a8cba4d4a1b9","kubernetes.io/config.seen":"2023-12-26T21:59:36.030593117Z","kubernetes.io/config.source":"api"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"d8f430ff9b1cde2991cdb177244c7ccd14d87e4017a42ed0df1ec6b53cbd6242","pid":0,"status":"stopped","bundle":"/run/containers/storage/overlay-containers/d8f430ff9b1cde2991cdb177244c7ccd14d87e4017a42ed0df1ec6b53cbd6242/userdata","rootfs":"/var/lib/containers/storage/overlay/f7eff73e1621ed4ec9ee4a34cb55de4c67460572b1141bd723a7d3bce211b96d/merged","created":"2023-12-26T21:59:58.070115242Z","annotations":{"io.container.manager":"cri-o","io.kubernetes.container.hash":"cc0ac28c","io.kubernetes.container.name":"kube-proxy","io.kubernetes.container.restartCount":"2","io.kubernetes.container.terminationMessa

gePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"cc0ac28c\",\"io.kubernetes.container.restartCount\":\"2\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"d8f430ff9b1cde2991cdb177244c7ccd14d87e4017a42ed0df1ec6b53cbd6242","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2023-12-26T21:59:57.98959868Z","io.kubernetes.cri-o.Image":"3ca3ca488cf13fde14cfc4b3ffde0c53a8c161b030f4a444a797fba6aef38c39","io.kubernetes.cri-o.ImageName":"registry.k8s.io/kube-proxy:v1.28.4","io.kubernetes.cri-o.ImageRef":"3ca3ca488cf13fde14cfc4b3ffde0c53a8c161b030f4a444a797fba6aef38c39","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kube-proxy\",\"io.kubernetes.pod.name\":\"kube-proxy-9m7p9\",\"io.kubernete

s.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"c8184d93-3481-4aa6-bbda-6f73ecb4ee2e\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kube-proxy-9m7p9_c8184d93-3481-4aa6-bbda-6f73ecb4ee2e/kube-proxy/2.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kube-proxy\",\"attempt\":2}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/f7eff73e1621ed4ec9ee4a34cb55de4c67460572b1141bd723a7d3bce211b96d/merged","io.kubernetes.cri-o.Name":"k8s_kube-proxy_kube-proxy-9m7p9_kube-system_c8184d93-3481-4aa6-bbda-6f73ecb4ee2e_2","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/ced93628785c08737c21e870f51dfccb3a72bf75cbb625a905b814cdb39d300c/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"ced93628785c08737c21e870f51dfccb3a72bf75cbb625a905b814cdb39d300c","io.kubernetes.cri-o.SandboxName":"k8s_kube-proxy-9m7p9_kube-system_c8184d93-3481-4aa6-bbda-6f73ecb4ee2e_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernete

s.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/run/xtables.lock\",\"host_path\":\"/run/xtables.lock\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/lib/modules\",\"host_path\":\"/lib/modules\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/c8184d93-3481-4aa6-bbda-6f73ecb4ee2e/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/c8184d93-3481-4aa6-bbda-6f73ecb4ee2e/containers/kube-proxy/4972998b\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/lib/kube-proxy\",\"host_path\":\"/var/lib/kubelet/pods/c8184d93-3481-4aa6-bbda-6f73ecb4ee2e/volumes/kubernetes.io~configmap/kube-proxy\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/r

un/secrets/kubernetes.io/serviceaccount\",\"host_path\":\"/var/lib/kubelet/pods/c8184d93-3481-4aa6-bbda-6f73ecb4ee2e/volumes/kubernetes.io~projected/kube-api-access-hqstw\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kube-proxy-9m7p9","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"c8184d93-3481-4aa6-bbda-6f73ecb4ee2e","kubernetes.io/config.seen":"2023-12-26T21:59:04.932604429Z","kubernetes.io/config.source":"api"},"owner":"root"},{"ociVersion":"1.0.2-dev","id":"e26ee425462b716831b83e20c569f4e514e2fa4c6413ef4056d6e78bd6facc52","pid":0,"status":"stopped","bundle":"/run/containers/storage/overlay-containers/e26ee425462b716831b83e20c569f4e514e2fa4c6413ef4056d6e78bd6facc52/userdata","rootfs":"/var/lib/containers/storage/overlay/fc79cf5acf1d3d19667c697227173f3a05c724ff5e552dd3600682d86eb5fdd6/merged","created":"2023-12-26T21:59:58.219071333Z","annotations":{"io.container.manager":"cri-o","io.kubernet

es.container.hash":"171df1b7","io.kubernetes.container.name":"kindnet-cni","io.kubernetes.container.restartCount":"2","io.kubernetes.container.terminationMessagePath":"/dev/termination-log","io.kubernetes.container.terminationMessagePolicy":"File","io.kubernetes.cri-o.Annotations":"{\"io.kubernetes.container.hash\":\"171df1b7\",\"io.kubernetes.container.restartCount\":\"2\",\"io.kubernetes.container.terminationMessagePath\":\"/dev/termination-log\",\"io.kubernetes.container.terminationMessagePolicy\":\"File\",\"io.kubernetes.pod.terminationGracePeriod\":\"30\"}","io.kubernetes.cri-o.ContainerID":"e26ee425462b716831b83e20c569f4e514e2fa4c6413ef4056d6e78bd6facc52","io.kubernetes.cri-o.ContainerType":"container","io.kubernetes.cri-o.Created":"2023-12-26T21:59:58.150791906Z","io.kubernetes.cri-o.Image":"04b4eaa3d3db8abea4b9ea4d10a0926ebb31db5a31b673aa1cf7a4b3af4add26","io.kubernetes.cri-o.ImageName":"docker.io/kindest/kindnetd:v20230809-80a64d96","io.kubernetes.cri-o.ImageRef":"04b4eaa3d3db8abea4b9ea4d10a0926ebb31

db5a31b673aa1cf7a4b3af4add26","io.kubernetes.cri-o.Labels":"{\"io.kubernetes.container.name\":\"kindnet-cni\",\"io.kubernetes.pod.name\":\"kindnet-cbhzk\",\"io.kubernetes.pod.namespace\":\"kube-system\",\"io.kubernetes.pod.uid\":\"3d9633f7-0f86-48fa-a658-29ed4c3dc8b9\"}","io.kubernetes.cri-o.LogPath":"/var/log/pods/kube-system_kindnet-cbhzk_3d9633f7-0f86-48fa-a658-29ed4c3dc8b9/kindnet-cni/2.log","io.kubernetes.cri-o.Metadata":"{\"name\":\"kindnet-cni\",\"attempt\":2}","io.kubernetes.cri-o.MountPoint":"/var/lib/containers/storage/overlay/fc79cf5acf1d3d19667c697227173f3a05c724ff5e552dd3600682d86eb5fdd6/merged","io.kubernetes.cri-o.Name":"k8s_kindnet-cni_kindnet-cbhzk_kube-system_3d9633f7-0f86-48fa-a658-29ed4c3dc8b9_2","io.kubernetes.cri-o.ResolvPath":"/run/containers/storage/overlay-containers/d60ff4eb1f096d6d9c9798e18fcd6ea0f7621bfd4c074fe40f3e5b10c9766013/userdata/resolv.conf","io.kubernetes.cri-o.SandboxID":"d60ff4eb1f096d6d9c9798e18fcd6ea0f7621bfd4c074fe40f3e5b10c9766013","io.kubernetes.cri-o.SandboxName":"

k8s_kindnet-cbhzk_kube-system_3d9633f7-0f86-48fa-a658-29ed4c3dc8b9_0","io.kubernetes.cri-o.SeccompProfilePath":"","io.kubernetes.cri-o.Stdin":"false","io.kubernetes.cri-o.StdinOnce":"false","io.kubernetes.cri-o.TTY":"false","io.kubernetes.cri-o.Volumes":"[{\"container_path\":\"/run/xtables.lock\",\"host_path\":\"/run/xtables.lock\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/lib/modules\",\"host_path\":\"/lib/modules\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/hosts\",\"host_path\":\"/var/lib/kubelet/pods/3d9633f7-0f86-48fa-a658-29ed4c3dc8b9/etc-hosts\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/dev/termination-log\",\"host_path\":\"/var/lib/kubelet/pods/3d9633f7-0f86-48fa-a658-29ed4c3dc8b9/containers/kindnet-cni/010f5a85\",\"readonly\":false,\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/etc/cni/net.d\",\"host_path\":\"/etc/cni/net.d\",\"readonly\":false,

\"propagation\":0,\"selinux_relabel\":false},{\"container_path\":\"/var/run/secrets/kubernetes.io/serviceaccount\",\"host_path\":\"/var/lib/kubelet/pods/3d9633f7-0f86-48fa-a658-29ed4c3dc8b9/volumes/kubernetes.io~projected/kube-api-access-kt5bv\",\"readonly\":true,\"propagation\":0,\"selinux_relabel\":false}]","io.kubernetes.pod.name":"kindnet-cbhzk","io.kubernetes.pod.namespace":"kube-system","io.kubernetes.pod.terminationGracePeriod":"30","io.kubernetes.pod.uid":"3d9633f7-0f86-48fa-a658-29ed4c3dc8b9","kubernetes.io/config.seen":"2023-12-26T21:59:04.930528596Z","kubernetes.io/config.source":"api"},"owner":"root"}]

	I1226 22:00:44.200300  722547 cri.go:126] list returned 13 containers

	I1226 22:00:44.200309  722547 cri.go:129] container: {ID:0d6b996118725bf2ffc61c626851a3807df1a7c2c242876e22173b8ef119c623 Status:stopped}

	I1226 22:00:44.200322  722547 cri.go:135] skipping {0d6b996118725bf2ffc61c626851a3807df1a7c2c242876e22173b8ef119c623 stopped}: state = "stopped", want "paused"

	I1226 22:00:44.200331  722547 cri.go:129] container: {ID:15834f50e1c0634720103dd691d7f396f3d713be5acb1c38130bd0723fa9d1a8 Status:stopped}

	I1226 22:00:44.200337  722547 cri.go:135] skipping {15834f50e1c0634720103dd691d7f396f3d713be5acb1c38130bd0723fa9d1a8 stopped}: state = "stopped", want "paused"

	I1226 22:00:44.200342  722547 cri.go:129] container: {ID:1ef2a1a3e47ebe5b2a04ac354c6ce5c027694d64a2536f75cc3431a8e1535ae8 Status:stopped}

	I1226 22:00:44.200356  722547 cri.go:135] skipping {1ef2a1a3e47ebe5b2a04ac354c6ce5c027694d64a2536f75cc3431a8e1535ae8 stopped}: state = "stopped", want "paused"

	I1226 22:00:44.200362  722547 cri.go:129] container: {ID:545494fc13bba801136324a819a23116e43adc0b25ddd0b728dbff63726bda54 Status:stopped}

	I1226 22:00:44.200367  722547 cri.go:135] skipping {545494fc13bba801136324a819a23116e43adc0b25ddd0b728dbff63726bda54 stopped}: state = "stopped", want "paused"

	I1226 22:00:44.200372  722547 cri.go:129] container: {ID:6207fb81b48065f5af35d56fd8b3167db0ada159d9f4222fae7353f737384f6a Status:stopped}

	I1226 22:00:44.200377  722547 cri.go:135] skipping {6207fb81b48065f5af35d56fd8b3167db0ada159d9f4222fae7353f737384f6a stopped}: state = "stopped", want "paused"

	I1226 22:00:44.200382  722547 cri.go:129] container: {ID:8c61210b5431b6b508e2020ed0dd8a0c96b01bd1f23453dbb7c3388e4cec5be9 Status:stopped}

	I1226 22:00:44.200387  722547 cri.go:135] skipping {8c61210b5431b6b508e2020ed0dd8a0c96b01bd1f23453dbb7c3388e4cec5be9 stopped}: state = "stopped", want "paused"

	I1226 22:00:44.200393  722547 cri.go:129] container: {ID:966133bd698f243db888d7ef30b4d6b869951a41045f90da8aad478517af91f1 Status:stopped}

	I1226 22:00:44.200398  722547 cri.go:135] skipping {966133bd698f243db888d7ef30b4d6b869951a41045f90da8aad478517af91f1 stopped}: state = "stopped", want "paused"

	I1226 22:00:44.200403  722547 cri.go:129] container: {ID:98e8aac979f46fea23543f19ff47e6bc4dcc0c65d0987b740953535e388d0092 Status:stopped}

	I1226 22:00:44.200409  722547 cri.go:135] skipping {98e8aac979f46fea23543f19ff47e6bc4dcc0c65d0987b740953535e388d0092 stopped}: state = "stopped", want "paused"

	I1226 22:00:44.200414  722547 cri.go:129] container: {ID:a34d8d5ed9ea4f1f416f5d388b6188b40b9af4f3a7333580289b2408beeb1b77 Status:stopped}

	I1226 22:00:44.200419  722547 cri.go:135] skipping {a34d8d5ed9ea4f1f416f5d388b6188b40b9af4f3a7333580289b2408beeb1b77 stopped}: state = "stopped", want "paused"

	I1226 22:00:44.200424  722547 cri.go:129] container: {ID:b2c24d01056cce186e9a79409051bea69c46dee8a050dbc29367a57fd6eae353 Status:stopped}

	I1226 22:00:44.200429  722547 cri.go:135] skipping {b2c24d01056cce186e9a79409051bea69c46dee8a050dbc29367a57fd6eae353 stopped}: state = "stopped", want "paused"

	I1226 22:00:44.200434  722547 cri.go:129] container: {ID:c822d55e3c7244a97ad01609df5b78c3fce79bd4eec64ad507404b68998a4d17 Status:stopped}

	I1226 22:00:44.200440  722547 cri.go:135] skipping {c822d55e3c7244a97ad01609df5b78c3fce79bd4eec64ad507404b68998a4d17 stopped}: state = "stopped", want "paused"

	I1226 22:00:44.200444  722547 cri.go:129] container: {ID:d8f430ff9b1cde2991cdb177244c7ccd14d87e4017a42ed0df1ec6b53cbd6242 Status:stopped}

	I1226 22:00:44.200451  722547 cri.go:135] skipping {d8f430ff9b1cde2991cdb177244c7ccd14d87e4017a42ed0df1ec6b53cbd6242 stopped}: state = "stopped", want "paused"

	I1226 22:00:44.200456  722547 cri.go:129] container: {ID:e26ee425462b716831b83e20c569f4e514e2fa4c6413ef4056d6e78bd6facc52 Status:stopped}

	I1226 22:00:44.200461  722547 cri.go:135] skipping {e26ee425462b716831b83e20c569f4e514e2fa4c6413ef4056d6e78bd6facc52 stopped}: state = "stopped", want "paused"

	I1226 22:00:44.200510  722547 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1226 22:00:44.216652  722547 kubeadm.go:419] found existing configuration files, will attempt cluster restart

	I1226 22:00:44.216663  722547 kubeadm.go:636] restartCluster start

	I1226 22:00:44.216716  722547 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I1226 22:00:44.230132  722547 kubeadm.go:127] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I1226 22:00:44.230674  722547 kubeconfig.go:92] found "functional-262391" server: "https://192.168.49.2:8441"

	I1226 22:00:44.232128  722547 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I1226 22:00:44.245508  722547 kubeadm.go:602] needs reconfigure: configs differ:

	-- stdout --

	--- /var/tmp/minikube/kubeadm.yaml	2023-12-26 21:58:35.021070333 +0000

	+++ /var/tmp/minikube/kubeadm.yaml.new	2023-12-26 22:00:43.542120555 +0000

	@@ -22,7 +22,7 @@

	 apiServer:

	   certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]

	   extraArgs:

	-    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	+    enable-admission-plugins: "NamespaceAutoProvision"

	 controllerManager:

	   extraArgs:

	     allocate-node-cidrs: "true"

	-- /stdout --

	I1226 22:00:44.245517  722547 kubeadm.go:1135] stopping kube-system containers ...

	I1226 22:00:44.245527  722547 cri.go:54] listing CRI containers in root : {State:all Name: Namespaces:[kube-system]}

	I1226 22:00:44.245596  722547 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I1226 22:00:44.306649  722547 cri.go:89] found id: "c822d55e3c7244a97ad01609df5b78c3fce79bd4eec64ad507404b68998a4d17"

	I1226 22:00:44.306661  722547 cri.go:89] found id: "e26ee425462b716831b83e20c569f4e514e2fa4c6413ef4056d6e78bd6facc52"

	I1226 22:00:44.306666  722547 cri.go:89] found id: "8c61210b5431b6b508e2020ed0dd8a0c96b01bd1f23453dbb7c3388e4cec5be9"

	I1226 22:00:44.306670  722547 cri.go:89] found id: "1ef2a1a3e47ebe5b2a04ac354c6ce5c027694d64a2536f75cc3431a8e1535ae8"

	I1226 22:00:44.306680  722547 cri.go:89] found id: "a34d8d5ed9ea4f1f416f5d388b6188b40b9af4f3a7333580289b2408beeb1b77"

	I1226 22:00:44.306685  722547 cri.go:89] found id: "966133bd698f243db888d7ef30b4d6b869951a41045f90da8aad478517af91f1"

	I1226 22:00:44.306688  722547 cri.go:89] found id: "d8f430ff9b1cde2991cdb177244c7ccd14d87e4017a42ed0df1ec6b53cbd6242"

	I1226 22:00:44.306691  722547 cri.go:89] found id: "0d6b996118725bf2ffc61c626851a3807df1a7c2c242876e22173b8ef119c623"

	I1226 22:00:44.306694  722547 cri.go:89] found id: ""

	I1226 22:00:44.306698  722547 cri.go:234] Stopping containers: [c822d55e3c7244a97ad01609df5b78c3fce79bd4eec64ad507404b68998a4d17 e26ee425462b716831b83e20c569f4e514e2fa4c6413ef4056d6e78bd6facc52 8c61210b5431b6b508e2020ed0dd8a0c96b01bd1f23453dbb7c3388e4cec5be9 1ef2a1a3e47ebe5b2a04ac354c6ce5c027694d64a2536f75cc3431a8e1535ae8 a34d8d5ed9ea4f1f416f5d388b6188b40b9af4f3a7333580289b2408beeb1b77 966133bd698f243db888d7ef30b4d6b869951a41045f90da8aad478517af91f1 d8f430ff9b1cde2991cdb177244c7ccd14d87e4017a42ed0df1ec6b53cbd6242 0d6b996118725bf2ffc61c626851a3807df1a7c2c242876e22173b8ef119c623]

	I1226 22:00:44.306754  722547 ssh_runner.go:195] Run: which crictl

	I1226 22:00:44.311474  722547 ssh_runner.go:195] Run: sudo /usr/bin/crictl stop --timeout=10 c822d55e3c7244a97ad01609df5b78c3fce79bd4eec64ad507404b68998a4d17 e26ee425462b716831b83e20c569f4e514e2fa4c6413ef4056d6e78bd6facc52 8c61210b5431b6b508e2020ed0dd8a0c96b01bd1f23453dbb7c3388e4cec5be9 1ef2a1a3e47ebe5b2a04ac354c6ce5c027694d64a2536f75cc3431a8e1535ae8 a34d8d5ed9ea4f1f416f5d388b6188b40b9af4f3a7333580289b2408beeb1b77 966133bd698f243db888d7ef30b4d6b869951a41045f90da8aad478517af91f1 d8f430ff9b1cde2991cdb177244c7ccd14d87e4017a42ed0df1ec6b53cbd6242 0d6b996118725bf2ffc61c626851a3807df1a7c2c242876e22173b8ef119c623

	I1226 22:00:44.380046  722547 ssh_runner.go:195] Run: sudo systemctl stop kubelet

	I1226 22:00:44.484101  722547 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1226 22:00:44.495336  722547 kubeadm.go:155] found existing configuration files:

	-rw------- 1 root root 5643 Dec 26 21:58 /etc/kubernetes/admin.conf

	-rw------- 1 root root 5652 Dec 26 21:58 /etc/kubernetes/controller-manager.conf

	-rw------- 1 root root 2007 Dec 26 21:58 /etc/kubernetes/kubelet.conf

	-rw------- 1 root root 5600 Dec 26 21:58 /etc/kubernetes/scheduler.conf

	I1226 22:00:44.495406  722547 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/admin.conf

	I1226 22:00:44.506561  722547 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/kubelet.conf

	I1226 22:00:44.517963  722547 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf

	I1226 22:00:44.528626  722547 kubeadm.go:166] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/controller-manager.conf: Process exited with status 1

	stdout:

	stderr:

	I1226 22:00:44.528687  722547 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I1226 22:00:44.539176  722547 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf

	I1226 22:00:44.549681  722547 kubeadm.go:166] "https://control-plane.minikube.internal:8441" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8441 /etc/kubernetes/scheduler.conf: Process exited with status 1

	stdout:

	stderr:

	I1226 22:00:44.549743  722547 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I1226 22:00:44.560074  722547 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1226 22:00:44.570670  722547 kubeadm.go:713] reconfiguring cluster from /var/tmp/minikube/kubeadm.yaml

	I1226 22:00:44.570684  722547 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase certs all --config /var/tmp/minikube/kubeadm.yaml"

	I1226 22:00:44.633408  722547 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml"

	I1226 22:00:46.789441  722547 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubeconfig all --config /var/tmp/minikube/kubeadm.yaml": (2.156007448s)

	I1226 22:00:46.789460  722547 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase kubelet-start --config /var/tmp/minikube/kubeadm.yaml"

	I1226 22:00:46.994625  722547 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase control-plane all --config /var/tmp/minikube/kubeadm.yaml"

	I1226 22:00:47.063467  722547 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase etcd local --config /var/tmp/minikube/kubeadm.yaml"

	I1226 22:00:47.137462  722547 api_server.go:52] waiting for apiserver process to appear ...

	I1226 22:00:47.137531  722547 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1226 22:00:47.638531  722547 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1226 22:00:48.138257  722547 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1226 22:00:48.165045  722547 api_server.go:72] duration metric: took 1.027582148s to wait for apiserver process to appear ...

	I1226 22:00:48.165060  722547 api_server.go:88] waiting for apiserver healthz status ...

	I1226 22:00:48.165078  722547 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8441/healthz ...

	I1226 22:00:48.165327  722547 api_server.go:269] stopped: https://192.168.49.2:8441/healthz: Get "https://192.168.49.2:8441/healthz": dial tcp 192.168.49.2:8441: connect: connection refused

	I1226 22:00:48.665630  722547 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8441/healthz ...

	I1226 22:00:51.757992  722547 api_server.go:279] https://192.168.49.2:8441/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W1226 22:00:51.758009  722547 api_server.go:103] status: https://192.168.49.2:8441/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I1226 22:00:51.758027  722547 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8441/healthz ...

	I1226 22:00:51.910545  722547 api_server.go:279] https://192.168.49.2:8441/healthz returned 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	W1226 22:00:51.910578  722547 api_server.go:103] status: https://192.168.49.2:8441/healthz returned error 403:

	{"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/healthz\"","reason":"Forbidden","details":{},"code":403}

	I1226 22:00:52.165783  722547 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8441/healthz ...

	I1226 22:00:52.176799  722547 api_server.go:279] https://192.168.49.2:8441/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	W1226 22:00:52.176822  722547 api_server.go:103] status: https://192.168.49.2:8441/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	I1226 22:00:52.665393  722547 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8441/healthz ...

	I1226 22:00:52.681424  722547 api_server.go:279] https://192.168.49.2:8441/healthz returned 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	W1226 22:00:52.681446  722547 api_server.go:103] status: https://192.168.49.2:8441/healthz returned error 500:

	[+]ping ok

	[+]log ok

	[+]etcd ok

	[+]poststarthook/start-kube-apiserver-admission-initializer ok

	[+]poststarthook/generic-apiserver-start-informers ok

	[+]poststarthook/priority-and-fairness-config-consumer ok

	[+]poststarthook/priority-and-fairness-filter ok

	[+]poststarthook/storage-object-count-tracker-hook ok

	[+]poststarthook/start-apiextensions-informers ok

	[+]poststarthook/start-apiextensions-controllers ok

	[+]poststarthook/crd-informer-synced ok

	[+]poststarthook/start-service-ip-repair-controllers ok

	[-]poststarthook/rbac/bootstrap-roles failed: reason withheld

	[-]poststarthook/scheduling/bootstrap-system-priority-classes failed: reason withheld

	[+]poststarthook/priority-and-fairness-config-producer ok

	[+]poststarthook/start-system-namespaces-controller ok

	[+]poststarthook/bootstrap-controller ok

	[+]poststarthook/start-cluster-authentication-info-controller ok

	[+]poststarthook/start-kube-apiserver-identity-lease-controller ok

	[+]poststarthook/start-deprecated-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok

	[+]poststarthook/start-legacy-token-tracking-controller ok

	[+]poststarthook/aggregator-reload-proxy-client-cert ok

	[+]poststarthook/start-kube-aggregator-informers ok

	[+]poststarthook/apiservice-registration-controller ok

	[+]poststarthook/apiservice-status-available-controller ok

	[+]poststarthook/kube-apiserver-autoregistration ok

	[+]autoregister-completion ok

	[+]poststarthook/apiservice-openapi-controller ok

	[+]poststarthook/apiservice-openapiv3-controller ok

	[+]poststarthook/apiservice-discovery-controller ok

	healthz check failed

	I1226 22:00:53.165153  722547 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8441/healthz ...

	I1226 22:00:53.174003  722547 api_server.go:279] https://192.168.49.2:8441/healthz returned 200:

	ok

	I1226 22:00:53.189570  722547 api_server.go:141] control plane version: v1.28.4

	I1226 22:00:53.189588  722547 api_server.go:131] duration metric: took 5.024522659s to wait for apiserver health ...

	I1226 22:00:53.189596  722547 cni.go:84] Creating CNI manager for ""

	I1226 22:00:53.189605  722547 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet

	I1226 22:00:53.191460  722547 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I1226 22:00:53.193250  722547 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I1226 22:00:53.198343  722547 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.28.4/kubectl ...

	I1226 22:00:53.198363  722547 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I1226 22:00:53.220550  722547 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I1226 22:00:54.014694  722547 system_pods.go:43] waiting for kube-system pods to appear ...

	I1226 22:00:54.027888  722547 system_pods.go:59] 8 kube-system pods found

	I1226 22:00:54.027913  722547 system_pods.go:61] "coredns-5dd5756b68-rvzcn" [d1d1dee1-9964-4293-b138-a8cba4d4a1b9] Running / Ready:ContainersNotReady (containers with unready status: [coredns]) / ContainersReady:ContainersNotReady (containers with unready status: [coredns])

	I1226 22:00:54.027921  722547 system_pods.go:61] "etcd-functional-262391" [e9912570-29e4-428e-9bcf-4c0441887af0] Running / Ready:ContainersNotReady (containers with unready status: [etcd]) / ContainersReady:ContainersNotReady (containers with unready status: [etcd])

	I1226 22:00:54.027926  722547 system_pods.go:61] "kindnet-cbhzk" [3d9633f7-0f86-48fa-a658-29ed4c3dc8b9] Running

	I1226 22:00:54.027934  722547 system_pods.go:61] "kube-apiserver-functional-262391" [83b75db3-64e3-4cce-b172-f13888f3b83d] Running / Ready:ContainersNotReady (containers with unready status: [kube-apiserver]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-apiserver])

	I1226 22:00:54.027944  722547 system_pods.go:61] "kube-controller-manager-functional-262391" [2876bbc5-3381-4505-b57e-0ab5ed52475b] Running / Ready:ContainersNotReady (containers with unready status: [kube-controller-manager]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-controller-manager])

	I1226 22:00:54.027949  722547 system_pods.go:61] "kube-proxy-9m7p9" [c8184d93-3481-4aa6-bbda-6f73ecb4ee2e] Running

	I1226 22:00:54.027957  722547 system_pods.go:61] "kube-scheduler-functional-262391" [5c50dfd3-64fd-4086-8283-71fb371ac3e7] Running / Ready:ContainersNotReady (containers with unready status: [kube-scheduler]) / ContainersReady:ContainersNotReady (containers with unready status: [kube-scheduler])

	I1226 22:00:54.027961  722547 system_pods.go:61] "storage-provisioner" [d0995a50-650c-4928-83fc-533af41c36fc] Running

	I1226 22:00:54.027967  722547 system_pods.go:74] duration metric: took 13.262153ms to wait for pod list to return data ...

	I1226 22:00:54.027975  722547 node_conditions.go:102] verifying NodePressure condition ...

	I1226 22:00:54.034687  722547 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki

	I1226 22:00:54.034706  722547 node_conditions.go:123] node cpu capacity is 2

	I1226 22:00:54.034717  722547 node_conditions.go:105] duration metric: took 6.737404ms to run NodePressure ...

	I1226 22:00:54.034734  722547 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init phase addon all --config /var/tmp/minikube/kubeadm.yaml"

	I1226 22:00:54.251601  722547 kubeadm.go:772] waiting for restarted kubelet to initialise ...

	I1226 22:00:54.257609  722547 kubeadm.go:787] kubelet initialised

	I1226 22:00:54.257619  722547 kubeadm.go:788] duration metric: took 6.004769ms waiting for restarted kubelet to initialise ...

	I1226 22:00:54.257626  722547 pod_ready.go:35] extra waiting up to 4m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1226 22:00:54.266658  722547 pod_ready.go:78] waiting up to 4m0s for pod "coredns-5dd5756b68-rvzcn" in "kube-system" namespace to be "Ready" ...

	I1226 22:00:55.773886  722547 pod_ready.go:92] pod "coredns-5dd5756b68-rvzcn" in "kube-system" namespace has status "Ready":"True"

	I1226 22:00:55.773899  722547 pod_ready.go:81] duration metric: took 1.507226832s waiting for pod "coredns-5dd5756b68-rvzcn" in "kube-system" namespace to be "Ready" ...

	I1226 22:00:55.773909  722547 pod_ready.go:78] waiting up to 4m0s for pod "etcd-functional-262391" in "kube-system" namespace to be "Ready" ...

	I1226 22:00:57.780878  722547 pod_ready.go:102] pod "etcd-functional-262391" in "kube-system" namespace has status "Ready":"False"

	I1226 22:00:59.781146  722547 pod_ready.go:102] pod "etcd-functional-262391" in "kube-system" namespace has status "Ready":"False"

	I1226 22:01:00.781170  722547 pod_ready.go:92] pod "etcd-functional-262391" in "kube-system" namespace has status "Ready":"True"

	I1226 22:01:00.781182  722547 pod_ready.go:81] duration metric: took 5.007266592s waiting for pod "etcd-functional-262391" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:00.781203  722547 pod_ready.go:78] waiting up to 4m0s for pod "kube-apiserver-functional-262391" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:00.788066  722547 pod_ready.go:92] pod "kube-apiserver-functional-262391" in "kube-system" namespace has status "Ready":"True"

	I1226 22:01:00.788085  722547 pod_ready.go:81] duration metric: took 6.869176ms waiting for pod "kube-apiserver-functional-262391" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:00.788095  722547 pod_ready.go:78] waiting up to 4m0s for pod "kube-controller-manager-functional-262391" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:00.795473  722547 pod_ready.go:92] pod "kube-controller-manager-functional-262391" in "kube-system" namespace has status "Ready":"True"

	I1226 22:01:00.795485  722547 pod_ready.go:81] duration metric: took 7.383551ms waiting for pod "kube-controller-manager-functional-262391" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:00.795495  722547 pod_ready.go:78] waiting up to 4m0s for pod "kube-proxy-9m7p9" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:00.802165  722547 pod_ready.go:92] pod "kube-proxy-9m7p9" in "kube-system" namespace has status "Ready":"True"

	I1226 22:01:00.802176  722547 pod_ready.go:81] duration metric: took 6.67563ms waiting for pod "kube-proxy-9m7p9" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:00.802186  722547 pod_ready.go:78] waiting up to 4m0s for pod "kube-scheduler-functional-262391" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:02.809067  722547 pod_ready.go:92] pod "kube-scheduler-functional-262391" in "kube-system" namespace has status "Ready":"True"

	I1226 22:01:02.809079  722547 pod_ready.go:81] duration metric: took 2.006885302s waiting for pod "kube-scheduler-functional-262391" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:02.809090  722547 pod_ready.go:38] duration metric: took 8.551455764s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1226 22:01:02.809115  722547 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1226 22:01:02.818458  722547 ops.go:34] apiserver oom_adj: -16

	I1226 22:01:02.818470  722547 kubeadm.go:640] restartCluster took 18.601801805s

	I1226 22:01:02.818478  722547 kubeadm.go:406] StartCluster complete in 18.743842059s

	I1226 22:01:02.818499  722547 settings.go:142] acquiring lock: {Name:mk1b89d623875ac96830001bdd0fc2b8d8c10aec Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 22:01:02.818577  722547 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/17857-697646/kubeconfig

	I1226 22:01:02.819255  722547 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17857-697646/kubeconfig: {Name:mk171fc32e21f516abb68bc5ebeb628b3c1d7f0b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1226 22:01:02.819464  722547 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1226 22:01:02.819735  722547 config.go:182] Loaded profile config "functional-262391": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4

	I1226 22:01:02.819883  722547 addons.go:505] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]

	I1226 22:01:02.819941  722547 addons.go:69] Setting storage-provisioner=true in profile "functional-262391"

	I1226 22:01:02.819950  722547 addons.go:237] Setting addon storage-provisioner=true in "functional-262391"

	W1226 22:01:02.819955  722547 addons.go:246] addon storage-provisioner should already be in state true

	I1226 22:01:02.819996  722547 host.go:66] Checking if "functional-262391" exists ...

	I1226 22:01:02.820326  722547 addons.go:69] Setting default-storageclass=true in profile "functional-262391"

	I1226 22:01:02.820338  722547 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "functional-262391"

	I1226 22:01:02.820429  722547 cli_runner.go:164] Run: docker container inspect functional-262391 --format={{.State.Status}}

	I1226 22:01:02.820628  722547 cli_runner.go:164] Run: docker container inspect functional-262391 --format={{.State.Status}}

	I1226 22:01:02.837382  722547 kapi.go:248] "coredns" deployment in "kube-system" namespace and "functional-262391" context rescaled to 1 replicas

	I1226 22:01:02.837410  722547 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1226 22:01:02.839735  722547 out.go:177] * Verifying Kubernetes components...

	I1226 22:01:02.841732  722547 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1226 22:01:02.851517  722547 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1226 22:01:02.855370  722547 addons.go:429] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1226 22:01:02.855390  722547 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1226 22:01:02.855487  722547 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-262391

	I1226 22:01:02.884285  722547 addons.go:237] Setting addon default-storageclass=true in "functional-262391"

	W1226 22:01:02.884296  722547 addons.go:246] addon default-storageclass should already be in state true

	I1226 22:01:02.884319  722547 host.go:66] Checking if "functional-262391" exists ...

	I1226 22:01:02.886378  722547 cli_runner.go:164] Run: docker container inspect functional-262391 --format={{.State.Status}}

	I1226 22:01:02.920241  722547 addons.go:429] installing /etc/kubernetes/addons/storageclass.yaml

	I1226 22:01:02.920253  722547 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1226 22:01:02.920315  722547 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-262391

	I1226 22:01:02.920643  722547 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33681 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/functional-262391/id_rsa Username:docker}

	I1226 22:01:02.978390  722547 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:33681 SSHKeyPath:/home/jenkins/minikube-integration/17857-697646/.minikube/machines/functional-262391/id_rsa Username:docker}

	I1226 22:01:03.021163  722547 start.go:902] CoreDNS already contains "host.minikube.internal" host record, skipping...

	I1226 22:01:03.021203  722547 node_ready.go:35] waiting up to 6m0s for node "functional-262391" to be "Ready" ...

	I1226 22:01:03.030364  722547 node_ready.go:49] node "functional-262391" has status "Ready":"True"

	I1226 22:01:03.030376  722547 node_ready.go:38] duration metric: took 9.162104ms waiting for node "functional-262391" to be "Ready" ...

	I1226 22:01:03.030386  722547 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1226 22:01:03.043302  722547 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-rvzcn" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:03.077625  722547 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1226 22:01:03.117363  722547 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1226 22:01:03.181064  722547 pod_ready.go:92] pod "coredns-5dd5756b68-rvzcn" in "kube-system" namespace has status "Ready":"True"

	I1226 22:01:03.181084  722547 pod_ready.go:81] duration metric: took 137.750727ms waiting for pod "coredns-5dd5756b68-rvzcn" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:03.181095  722547 pod_ready.go:78] waiting up to 6m0s for pod "etcd-functional-262391" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:03.580360  722547 pod_ready.go:92] pod "etcd-functional-262391" in "kube-system" namespace has status "Ready":"True"

	I1226 22:01:03.580372  722547 pod_ready.go:81] duration metric: took 399.270784ms waiting for pod "etcd-functional-262391" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:03.580392  722547 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-functional-262391" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:03.605616  722547 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I1226 22:01:03.611170  722547 addons.go:508] enable addons completed in 791.29658ms: enabled=[storage-provisioner default-storageclass]

	I1226 22:01:03.978053  722547 pod_ready.go:92] pod "kube-apiserver-functional-262391" in "kube-system" namespace has status "Ready":"True"

	I1226 22:01:03.978064  722547 pod_ready.go:81] duration metric: took 397.66483ms waiting for pod "kube-apiserver-functional-262391" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:03.978075  722547 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-functional-262391" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:04.378003  722547 pod_ready.go:92] pod "kube-controller-manager-functional-262391" in "kube-system" namespace has status "Ready":"True"

	I1226 22:01:04.378014  722547 pod_ready.go:81] duration metric: took 399.932758ms waiting for pod "kube-controller-manager-functional-262391" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:04.378025  722547 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-9m7p9" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:04.781368  722547 pod_ready.go:92] pod "kube-proxy-9m7p9" in "kube-system" namespace has status "Ready":"True"

	I1226 22:01:04.781384  722547 pod_ready.go:81] duration metric: took 403.348901ms waiting for pod "kube-proxy-9m7p9" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:04.781395  722547 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-functional-262391" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:05.179180  722547 pod_ready.go:92] pod "kube-scheduler-functional-262391" in "kube-system" namespace has status "Ready":"True"

	I1226 22:01:05.179193  722547 pod_ready.go:81] duration metric: took 397.791588ms waiting for pod "kube-scheduler-functional-262391" in "kube-system" namespace to be "Ready" ...

	I1226 22:01:05.179205  722547 pod_ready.go:38] duration metric: took 2.148811021s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1226 22:01:05.179220  722547 api_server.go:52] waiting for apiserver process to appear ...

	I1226 22:01:05.179286  722547 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1226 22:01:05.194352  722547 api_server.go:72] duration metric: took 2.356914523s to wait for apiserver process to appear ...

	I1226 22:01:05.194367  722547 api_server.go:88] waiting for apiserver healthz status ...

	I1226 22:01:05.194390  722547 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8441/healthz ...

	I1226 22:01:05.204155  722547 api_server.go:279] https://192.168.49.2:8441/healthz returned 200:

	ok

	I1226 22:01:05.205463  722547 api_server.go:141] control plane version: v1.28.4

	I1226 22:01:05.205487  722547 api_server.go:131] duration metric: took 11.114354ms to wait for apiserver health ...

	I1226 22:01:05.205497  722547 system_pods.go:43] waiting for kube-system pods to appear ...

	I1226 22:01:05.381378  722547 system_pods.go:59] 8 kube-system pods found

	I1226 22:01:05.381393  722547 system_pods.go:61] "coredns-5dd5756b68-rvzcn" [d1d1dee1-9964-4293-b138-a8cba4d4a1b9] Running

	I1226 22:01:05.381398  722547 system_pods.go:61] "etcd-functional-262391" [e9912570-29e4-428e-9bcf-4c0441887af0] Running

	I1226 22:01:05.381402  722547 system_pods.go:61] "kindnet-cbhzk" [3d9633f7-0f86-48fa-a658-29ed4c3dc8b9] Running

	I1226 22:01:05.381407  722547 system_pods.go:61] "kube-apiserver-functional-262391" [83b75db3-64e3-4cce-b172-f13888f3b83d] Running

	I1226 22:01:05.381412  722547 system_pods.go:61] "kube-controller-manager-functional-262391" [2876bbc5-3381-4505-b57e-0ab5ed52475b] Running

	I1226 22:01:05.381416  722547 system_pods.go:61] "kube-proxy-9m7p9" [c8184d93-3481-4aa6-bbda-6f73ecb4ee2e] Running

	I1226 22:01:05.381420  722547 system_pods.go:61] "kube-scheduler-functional-262391" [5c50dfd3-64fd-4086-8283-71fb371ac3e7] Running

	I1226 22:01:05.381425  722547 system_pods.go:61] "storage-provisioner" [d0995a50-650c-4928-83fc-533af41c36fc] Running

	I1226 22:01:05.381430  722547 system_pods.go:74] duration metric: took 175.927033ms to wait for pod list to return data ...

	I1226 22:01:05.381437  722547 default_sa.go:34] waiting for default service account to be created ...

	I1226 22:01:05.577538  722547 default_sa.go:45] found service account: "default"

	I1226 22:01:05.577552  722547 default_sa.go:55] duration metric: took 196.109667ms for default service account to be created ...

	I1226 22:01:05.577559  722547 system_pods.go:116] waiting for k8s-apps to be running ...

	I1226 22:01:05.781758  722547 system_pods.go:86] 8 kube-system pods found

	I1226 22:01:05.781773  722547 system_pods.go:89] "coredns-5dd5756b68-rvzcn" [d1d1dee1-9964-4293-b138-a8cba4d4a1b9] Running

	I1226 22:01:05.781778  722547 system_pods.go:89] "etcd-functional-262391" [e9912570-29e4-428e-9bcf-4c0441887af0] Running

	I1226 22:01:05.781782  722547 system_pods.go:89] "kindnet-cbhzk" [3d9633f7-0f86-48fa-a658-29ed4c3dc8b9] Running

	I1226 22:01:05.781786  722547 system_pods.go:89] "kube-apiserver-functional-262391" [83b75db3-64e3-4cce-b172-f13888f3b83d] Running

	I1226 22:01:05.781790  722547 system_pods.go:89] "kube-controller-manager-functional-262391" [2876bbc5-3381-4505-b57e-0ab5ed52475b] Running

	I1226 22:01:05.781795  722547 system_pods.go:89] "kube-proxy-9m7p9" [c8184d93-3481-4aa6-bbda-6f73ecb4ee2e] Running

	I1226 22:01:05.781800  722547 system_pods.go:89] "kube-scheduler-functional-262391" [5c50dfd3-64fd-4086-8283-71fb371ac3e7] Running

	I1226 22:01:05.781804  722547 system_pods.go:89] "storage-provisioner" [d0995a50-650c-4928-83fc-533af41c36fc] Running

	I1226 22:01:05.781810  722547 system_pods.go:126] duration metric: took 204.245866ms to wait for k8s-apps to be running ...

	I1226 22:01:05.781818  722547 system_svc.go:44] waiting for kubelet service to be running ....

	I1226 22:01:05.781877  722547 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1226 22:01:05.796049  722547 system_svc.go:56] duration metric: took 14.221704ms WaitForService to wait for kubelet.

	I1226 22:01:05.796075  722547 kubeadm.go:581] duration metric: took 2.958645384s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...

	I1226 22:01:05.796095  722547 node_conditions.go:102] verifying NodePressure condition ...

	I1226 22:01:05.977551  722547 node_conditions.go:122] node storage ephemeral capacity is 203034800Ki

	I1226 22:01:05.977566  722547 node_conditions.go:123] node cpu capacity is 2

	I1226 22:01:05.977576  722547 node_conditions.go:105] duration metric: took 181.476453ms to run NodePressure ...

	I1226 22:01:05.977586  722547 start.go:228] waiting for startup goroutines ...

	I1226 22:01:05.977607  722547 start.go:233] waiting for cluster config update ...

	I1226 22:01:05.977616  722547 start.go:242] writing updated cluster config ...

	I1226 22:01:05.977906  722547 ssh_runner.go:195] Run: rm -f paused

	I1226 22:01:06.053519  722547 start.go:600] kubectl: 1.29.0, cluster: 1.28.4 (minor skew: 1)

	I1226 22:01:06.055540  722547 out.go:177] * Done! kubectl is now configured to use "functional-262391" cluster and "default" namespace by default

	==> CRI-O <==

	Dec 26 22:01:48 functional-262391 crio[4353]: time="2023-12-26 22:01:48.362293550Z" level=info msg="Image docker.io/nginx:alpine not found" id=d05fe0cb-dea9-4c66-9b3d-2a54764fd722 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 22:02:01 functional-262391 crio[4353]: time="2023-12-26 22:02:01.176845480Z" level=info msg="Checking image status: docker.io/nginx:alpine" id=973fa3c1-8803-4cc7-b1e0-8402593d0f4e name=/runtime.v1.ImageService/ImageStatus

	Dec 26 22:02:01 functional-262391 crio[4353]: time="2023-12-26 22:02:01.177065955Z" level=info msg="Image docker.io/nginx:alpine not found" id=973fa3c1-8803-4cc7-b1e0-8402593d0f4e name=/runtime.v1.ImageService/ImageStatus

	Dec 26 22:02:18 functional-262391 crio[4353]: time="2023-12-26 22:02:18.172732214Z" level=info msg="Pulling image: docker.io/nginx:alpine" id=746740cf-2bfb-4443-83f0-a282e2f62bcf name=/runtime.v1.ImageService/PullImage

	Dec 26 22:02:18 functional-262391 crio[4353]: time="2023-12-26 22:02:18.174822792Z" level=info msg="Trying to access \"docker.io/library/nginx:alpine\""

	Dec 26 22:02:18 functional-262391 crio[4353]: time="2023-12-26 22:02:18.421094589Z" level=info msg="Checking image status: docker.io/nginx:latest" id=8330013d-bed2-4867-b0e8-dbaedafa61e6 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 22:02:18 functional-262391 crio[4353]: time="2023-12-26 22:02:18.421320151Z" level=info msg="Image docker.io/nginx:latest not found" id=8330013d-bed2-4867-b0e8-dbaedafa61e6 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 22:02:32 functional-262391 crio[4353]: time="2023-12-26 22:02:32.176486694Z" level=info msg="Checking image status: docker.io/nginx:latest" id=c2b9dd5d-f74b-4742-9d2b-b63f90ba5d1a name=/runtime.v1.ImageService/ImageStatus

	Dec 26 22:02:32 functional-262391 crio[4353]: time="2023-12-26 22:02:32.176886036Z" level=info msg="Image docker.io/nginx:latest not found" id=c2b9dd5d-f74b-4742-9d2b-b63f90ba5d1a name=/runtime.v1.ImageService/ImageStatus

	Dec 26 22:03:02 functional-262391 crio[4353]: time="2023-12-26 22:03:02.719948022Z" level=info msg="Pulling image: docker.io/nginx:latest" id=bae736a3-c5d7-4dd0-b876-675855ef52ae name=/runtime.v1.ImageService/PullImage

	Dec 26 22:03:02 functional-262391 crio[4353]: time="2023-12-26 22:03:02.723187061Z" level=info msg="Trying to access \"docker.io/library/nginx:latest\""

	Dec 26 22:03:17 functional-262391 crio[4353]: time="2023-12-26 22:03:17.177122817Z" level=info msg="Checking image status: docker.io/nginx:alpine" id=aaf663dd-d12d-4780-9a4c-f4fba32e61c8 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 22:03:17 functional-262391 crio[4353]: time="2023-12-26 22:03:17.177348042Z" level=info msg="Image docker.io/nginx:alpine not found" id=aaf663dd-d12d-4780-9a4c-f4fba32e61c8 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 22:03:32 functional-262391 crio[4353]: time="2023-12-26 22:03:32.176710999Z" level=info msg="Checking image status: docker.io/nginx:alpine" id=12a800c0-c985-46bf-86d6-272c734f19dd name=/runtime.v1.ImageService/ImageStatus

	Dec 26 22:03:32 functional-262391 crio[4353]: time="2023-12-26 22:03:32.176942337Z" level=info msg="Image docker.io/nginx:alpine not found" id=12a800c0-c985-46bf-86d6-272c734f19dd name=/runtime.v1.ImageService/ImageStatus

	Dec 26 22:03:33 functional-262391 crio[4353]: time="2023-12-26 22:03:33.024418162Z" level=info msg="Pulling image: docker.io/nginx:alpine" id=0dd3e81c-8451-423f-929c-977f5288af50 name=/runtime.v1.ImageService/PullImage

	Dec 26 22:03:33 functional-262391 crio[4353]: time="2023-12-26 22:03:33.027015920Z" level=info msg="Trying to access \"docker.io/library/nginx:alpine\""

	Dec 26 22:03:44 functional-262391 crio[4353]: time="2023-12-26 22:03:44.177674401Z" level=info msg="Checking image status: docker.io/nginx:latest" id=9a702ccb-a735-4bee-a847-836407b6164b name=/runtime.v1.ImageService/ImageStatus

	Dec 26 22:03:44 functional-262391 crio[4353]: time="2023-12-26 22:03:44.177983005Z" level=info msg="Image docker.io/nginx:latest not found" id=9a702ccb-a735-4bee-a847-836407b6164b name=/runtime.v1.ImageService/ImageStatus

	Dec 26 22:03:56 functional-262391 crio[4353]: time="2023-12-26 22:03:56.176891624Z" level=info msg="Checking image status: docker.io/nginx:latest" id=3538ada2-7ae8-4a7a-8e7e-bbc9f55ebcf2 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 22:03:56 functional-262391 crio[4353]: time="2023-12-26 22:03:56.177113814Z" level=info msg="Image docker.io/nginx:latest not found" id=3538ada2-7ae8-4a7a-8e7e-bbc9f55ebcf2 name=/runtime.v1.ImageService/ImageStatus

	Dec 26 22:04:03 functional-262391 crio[4353]: time="2023-12-26 22:04:03.302802347Z" level=info msg="Pulling image: docker.io/nginx:latest" id=b8e8a73e-96f3-4f21-8b79-4c167696e7a5 name=/runtime.v1.ImageService/PullImage

	Dec 26 22:04:03 functional-262391 crio[4353]: time="2023-12-26 22:04:03.304923627Z" level=info msg="Trying to access \"docker.io/library/nginx:latest\""

	Dec 26 22:04:18 functional-262391 crio[4353]: time="2023-12-26 22:04:18.176782389Z" level=info msg="Checking image status: docker.io/nginx:alpine" id=863190fc-638c-4d2a-8593-e84c22c5b6bb name=/runtime.v1.ImageService/ImageStatus

	Dec 26 22:04:18 functional-262391 crio[4353]: time="2023-12-26 22:04:18.177022531Z" level=info msg="Image docker.io/nginx:alpine not found" id=863190fc-638c-4d2a-8593-e84c22c5b6bb name=/runtime.v1.ImageService/ImageStatus

	==> container status <==

	CONTAINER           IMAGE                                                              CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	d2c7b8ff0a10f       3ca3ca488cf13fde14cfc4b3ffde0c53a8c161b030f4a444a797fba6aef38c39   3 minutes ago       Running             kube-proxy                3                   ced93628785c0       kube-proxy-9m7p9

	f30c2ed26c999       97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108   3 minutes ago       Running             coredns                   3                   fef827a057919       coredns-5dd5756b68-rvzcn

	312553732c0c5       ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6   3 minutes ago       Running             storage-provisioner       3                   995e88ed74fef       storage-provisioner

	1df6c7623610b       04b4eaa3d3db8abea4b9ea4d10a0926ebb31db5a31b673aa1cf7a4b3af4add26   3 minutes ago       Running             kindnet-cni               3                   d60ff4eb1f096       kindnet-cbhzk

	bb588759e5092       04b4c447bb9d4840af3bf7e836397379d65df87c86e55dcd27f31a8d11df2419   3 minutes ago       Running             kube-apiserver            0                   9b95fb9e6a9db       kube-apiserver-functional-262391

	4dcd4a3ad372e       05c284c929889d88306fdb3dd14ee2d0132543740f9e247685243214fc3d2c54   3 minutes ago       Running             kube-scheduler            3                   366e6735458fe       kube-scheduler-functional-262391

	07811118ec726       9cdd6470f48c8b127530b7ce6ea4b3524137984481e48bcde619735890840ace   3 minutes ago       Running             etcd                      3                   04fe9bb0de4db       etcd-functional-262391

	e1ece719ec1a1       9961cbceaf234d59b7dcf8a197a024f3e3ce4b7fe2b67c2378efd3d209ca994b   3 minutes ago       Running             kube-controller-manager   3                   ac3b0cf8e4b5b       kube-controller-manager-functional-262391

	c822d55e3c724       97e04611ad43405a2e5863ae17c6f1bc9181bdefdaa78627c432ef754a4eb108   4 minutes ago       Exited              coredns                   2                   fef827a057919       coredns-5dd5756b68-rvzcn

	e26ee425462b7       04b4eaa3d3db8abea4b9ea4d10a0926ebb31db5a31b673aa1cf7a4b3af4add26   4 minutes ago       Exited              kindnet-cni               2                   d60ff4eb1f096       kindnet-cbhzk

	1ef2a1a3e47eb       9961cbceaf234d59b7dcf8a197a024f3e3ce4b7fe2b67c2378efd3d209ca994b   4 minutes ago       Exited              kube-controller-manager   2                   ac3b0cf8e4b5b       kube-controller-manager-functional-262391

	a34d8d5ed9ea4       ba04bb24b95753201135cbc420b233c1b0b9fa2e1fd21d28319c348c33fbcde6   4 minutes ago       Exited              storage-provisioner       2                   995e88ed74fef       storage-provisioner

	966133bd698f2       9cdd6470f48c8b127530b7ce6ea4b3524137984481e48bcde619735890840ace   4 minutes ago       Exited              etcd                      2                   04fe9bb0de4db       etcd-functional-262391

	d8f430ff9b1cd       3ca3ca488cf13fde14cfc4b3ffde0c53a8c161b030f4a444a797fba6aef38c39   4 minutes ago       Exited              kube-proxy                2                   ced93628785c0       kube-proxy-9m7p9

	0d6b996118725       05c284c929889d88306fdb3dd14ee2d0132543740f9e247685243214fc3d2c54   4 minutes ago       Exited              kube-scheduler            2                   366e6735458fe       kube-scheduler-functional-262391

	==> coredns [c822d55e3c7244a97ad01609df5b78c3fce79bd4eec64ad507404b68998a4d17] <==

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = 05e3eaddc414b2d71a69b2e2bc6f2681fc1f4d04bcdd3acc1a41457bb7db518208b95ddfc4c9fffedc59c25a8faf458be1af4915a4a3c0d6777cb7a346bc5d86

	CoreDNS-1.10.1

	linux/arm64, go1.20, 055b2c3

	[INFO] 127.0.0.1:33914 - 41630 "HINFO IN 7247736621702071472.4972413562285624387. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.014654245s

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	==> coredns [f30c2ed26c999a125de4024a8dce2f72ab6cbcd08e87802732cf7d514d32e293] <==

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = 05e3eaddc414b2d71a69b2e2bc6f2681fc1f4d04bcdd3acc1a41457bb7db518208b95ddfc4c9fffedc59c25a8faf458be1af4915a4a3c0d6777cb7a346bc5d86

	CoreDNS-1.10.1

	linux/arm64, go1.20, 055b2c3

	[INFO] 127.0.0.1:34002 - 51540 "HINFO IN 95307415092295182.2909860349863719764. udp 55 false 512" NXDOMAIN qr,rd,ra 55 0.014536766s

	==> describe nodes <==

	Name:               functional-262391

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=arm64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=arm64

	                    kubernetes.io/hostname=functional-262391

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=393f165ced08f66e4386491f243850f87982a22b

	                    minikube.k8s.io/name=functional-262391

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2023_12_26T21_58_53_0700

	                    minikube.k8s.io/version=v1.32.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Tue, 26 Dec 2023 21:58:49 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  functional-262391

	  AcquireTime:     <unset>

	  RenewTime:       Tue, 26 Dec 2023 22:04:16 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Tue, 26 Dec 2023 22:00:52 +0000   Tue, 26 Dec 2023 21:58:45 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Tue, 26 Dec 2023 22:00:52 +0000   Tue, 26 Dec 2023 21:58:45 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Tue, 26 Dec 2023 22:00:52 +0000   Tue, 26 Dec 2023 21:58:45 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Tue, 26 Dec 2023 22:00:52 +0000   Tue, 26 Dec 2023 21:59:35 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.49.2

	  Hostname:    functional-262391

	Capacity:

	  cpu:                2

	  ephemeral-storage:  203034800Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             8022496Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  203034800Ki

	  hugepages-1Gi:      0

	  hugepages-2Mi:      0

	  hugepages-32Mi:     0

	  hugepages-64Ki:     0

	  memory:             8022496Ki

	  pods:               110

	System Info:

	  Machine ID:                 2e6d1292674d43f19296ade50af320f8

	  System UUID:                b32e1f24-f323-4570-af86-7c639bf8b151

	  Boot ID:                    f8f887b2-8c20-433d-a967-90e814370f09

	  Kernel Version:             5.15.0-1051-aws

	  OS Image:                   Ubuntu 22.04.3 LTS

	  Operating System:           linux

	  Architecture:               arm64

	  Container Runtime Version:  cri-o://1.24.6

	  Kubelet Version:            v1.28.4

	  Kube-Proxy Version:         v1.28.4

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (10 in total)

	  Namespace                   Name                                         CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                         ------------  ----------  ---------------  -------------  ---

	  default                     nginx-svc                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m9s

	  default                     sp-pod                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m2s

	  kube-system                 coredns-5dd5756b68-rvzcn                     100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (2%!)(MISSING)     5m20s

	  kube-system                 etcd-functional-262391                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (1%!)(MISSING)       0 (0%!)(MISSING)         5m33s

	  kube-system                 kindnet-cbhzk                                100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      5m21s

	  kube-system                 kube-apiserver-functional-262391             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m33s

	  kube-system                 kube-controller-manager-functional-262391    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m33s

	  kube-system                 kube-proxy-9m7p9                             0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m21s

	  kube-system                 kube-scheduler-functional-262391             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m33s

	  kube-system                 storage-provisioner                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m19s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                850m (42%!)(MISSING)  100m (5%!)(MISSING)

	  memory             220Mi (2%!)(MISSING)  220Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-32Mi     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-64Ki     0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type     Reason                   Age                    From             Message

	  ----     ------                   ----                   ----             -------

	  Normal   Starting                 5m19s                  kube-proxy       

	  Normal   Starting                 3m32s                  kube-proxy       

	  Normal   Starting                 4m22s                  kube-proxy       

	  Normal   Starting                 5m41s                  kubelet          Starting kubelet.

	  Normal   NodeHasSufficientMemory  5m41s (x8 over 5m41s)  kubelet          Node functional-262391 status is now: NodeHasSufficientMemory

	  Normal   NodeHasNoDiskPressure    5m41s (x8 over 5m41s)  kubelet          Node functional-262391 status is now: NodeHasNoDiskPressure

	  Normal   NodeHasSufficientPID     5m41s (x8 over 5m41s)  kubelet          Node functional-262391 status is now: NodeHasSufficientPID

	  Normal   NodeHasSufficientPID     5m33s                  kubelet          Node functional-262391 status is now: NodeHasSufficientPID

	  Normal   NodeHasSufficientMemory  5m33s                  kubelet          Node functional-262391 status is now: NodeHasSufficientMemory

	  Normal   NodeHasNoDiskPressure    5m33s                  kubelet          Node functional-262391 status is now: NodeHasNoDiskPressure

	  Normal   Starting                 5m33s                  kubelet          Starting kubelet.

	  Normal   RegisteredNode           5m21s                  node-controller  Node functional-262391 event: Registered Node functional-262391 in Controller

	  Normal   NodeReady                4m50s                  kubelet          Node functional-262391 status is now: NodeReady

	  Warning  ContainerGCFailed        4m33s                  kubelet          rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /var/run/crio/crio.sock: connect: no such file or directory"

	  Normal   RegisteredNode           4m11s                  node-controller  Node functional-262391 event: Registered Node functional-262391 in Controller

	  Normal   Starting                 3m38s                  kubelet          Starting kubelet.

	  Normal   NodeHasSufficientMemory  3m38s (x8 over 3m38s)  kubelet          Node functional-262391 status is now: NodeHasSufficientMemory

	  Normal   NodeHasNoDiskPressure    3m38s (x8 over 3m38s)  kubelet          Node functional-262391 status is now: NodeHasNoDiskPressure

	  Normal   NodeHasSufficientPID     3m38s (x8 over 3m38s)  kubelet          Node functional-262391 status is now: NodeHasSufficientPID

	  Normal   RegisteredNode           3m21s                  node-controller  Node functional-262391 event: Registered Node functional-262391 in Controller

	==> dmesg <==

	[  +0.001114] FS-Cache: O-key=[8] '635f3b0000000000'

	[  +0.000763] FS-Cache: N-cookie c=00000030 [p=00000027 fl=2 nc=0 na=1]

	[  +0.001031] FS-Cache: N-cookie d=00000000b9607d6a{9p.inode} n=000000000db3c1b7

	[  +0.001157] FS-Cache: N-key=[8] '635f3b0000000000'

	[  +0.002874] FS-Cache: Duplicate cookie detected

	[  +0.000764] FS-Cache: O-cookie c=0000002a [p=00000027 fl=226 nc=0 na=1]

	[  +0.001117] FS-Cache: O-cookie d=00000000b9607d6a{9p.inode} n=000000007ac7c815

	[  +0.001084] FS-Cache: O-key=[8] '635f3b0000000000'

	[  +0.000742] FS-Cache: N-cookie c=00000031 [p=00000027 fl=2 nc=0 na=1]

	[  +0.001038] FS-Cache: N-cookie d=00000000b9607d6a{9p.inode} n=00000000328509c1

	[  +0.001125] FS-Cache: N-key=[8] '635f3b0000000000'

	[  +2.220713] FS-Cache: Duplicate cookie detected

	[  +0.000749] FS-Cache: O-cookie c=00000028 [p=00000027 fl=226 nc=0 na=1]

	[  +0.001122] FS-Cache: O-cookie d=00000000b9607d6a{9p.inode} n=00000000ebeba0e0

	[  +0.001200] FS-Cache: O-key=[8] '615f3b0000000000'

	[  +0.000765] FS-Cache: N-cookie c=00000033 [p=00000027 fl=2 nc=0 na=1]

	[  +0.000989] FS-Cache: N-cookie d=00000000b9607d6a{9p.inode} n=000000008353ea7f

	[  +0.001072] FS-Cache: N-key=[8] '615f3b0000000000'

	[  +0.309997] FS-Cache: Duplicate cookie detected

	[  +0.000749] FS-Cache: O-cookie c=0000002d [p=00000027 fl=226 nc=0 na=1]

	[  +0.001114] FS-Cache: O-cookie d=00000000b9607d6a{9p.inode} n=00000000e02b88cc

	[  +0.001198] FS-Cache: O-key=[8] '695f3b0000000000'

	[  +0.000739] FS-Cache: N-cookie c=00000034 [p=00000027 fl=2 nc=0 na=1]

	[  +0.001020] FS-Cache: N-cookie d=00000000b9607d6a{9p.inode} n=000000000db3c1b7

	[  +0.001131] FS-Cache: N-key=[8] '695f3b0000000000'

	==> etcd [07811118ec726184590369e131eb2abab397c3246388e1fecc22781dae65d731] <==

	{"level":"info","ts":"2023-12-26T22:00:48.081774Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","added-peer-id":"aec36adc501070cc","added-peer-peer-urls":["https://192.168.49.2:2380"]}

	{"level":"info","ts":"2023-12-26T22:00:48.081952Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"fa54960ea34d58be","local-member-id":"aec36adc501070cc","cluster-version":"3.5"}

	{"level":"info","ts":"2023-12-26T22:00:48.084621Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2023-12-26T22:00:48.083184Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap.db","max":5,"interval":"30s"}

	{"level":"info","ts":"2023-12-26T22:00:48.094999Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/snap","suffix":"snap","max":5,"interval":"30s"}

	{"level":"info","ts":"2023-12-26T22:00:48.095225Z","caller":"fileutil/purge.go:44","msg":"started to purge file","dir":"/var/lib/minikube/etcd/member/wal","suffix":"wal","max":5,"interval":"30s"}

	{"level":"info","ts":"2023-12-26T22:00:48.107302Z","caller":"embed/etcd.go:726","msg":"starting with client TLS","tls-info":"cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, client-cert=, client-key=, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = ","cipher-suites":[]}

	{"level":"info","ts":"2023-12-26T22:00:48.107448Z","caller":"embed/etcd.go:597","msg":"serving peer traffic","address":"192.168.49.2:2380"}

	{"level":"info","ts":"2023-12-26T22:00:48.107564Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.49.2:2380"}

	{"level":"info","ts":"2023-12-26T22:00:48.108319Z","caller":"embed/etcd.go:278","msg":"now serving peer/client/metrics","local-member-id":"aec36adc501070cc","initial-advertise-peer-urls":["https://192.168.49.2:2380"],"listen-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"],"listen-client-urls":["https://127.0.0.1:2379","https://192.168.49.2:2379"],"listen-metrics-urls":["http://127.0.0.1:2381"]}

	{"level":"info","ts":"2023-12-26T22:00:48.10841Z","caller":"embed/etcd.go:855","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2023-12-26T22:00:49.760552Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 3"}

	{"level":"info","ts":"2023-12-26T22:00:49.760671Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 3"}

	{"level":"info","ts":"2023-12-26T22:00:49.760719Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 3"}

	{"level":"info","ts":"2023-12-26T22:00:49.760759Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 4"}

	{"level":"info","ts":"2023-12-26T22:00:49.760799Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 4"}

	{"level":"info","ts":"2023-12-26T22:00:49.760842Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 4"}

	{"level":"info","ts":"2023-12-26T22:00:49.760889Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 4"}

	{"level":"info","ts":"2023-12-26T22:00:49.768749Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:functional-262391 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}

	{"level":"info","ts":"2023-12-26T22:00:49.768879Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-12-26T22:00:49.769116Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-12-26T22:00:49.781051Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}

	{"level":"info","ts":"2023-12-26T22:00:49.792376Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-12-26T22:00:49.795458Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-12-26T22:00:49.795495Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	==> etcd [966133bd698f243db888d7ef30b4d6b869951a41045f90da8aad478517af91f1] <==

	{"level":"info","ts":"2023-12-26T21:59:58.700728Z","caller":"embed/etcd.go:855","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2023-12-26T21:59:59.656577Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc is starting a new election at term 2"}

	{"level":"info","ts":"2023-12-26T21:59:59.656625Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became pre-candidate at term 2"}

	{"level":"info","ts":"2023-12-26T21:59:59.656646Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgPreVoteResp from aec36adc501070cc at term 2"}

	{"level":"info","ts":"2023-12-26T21:59:59.656673Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became candidate at term 3"}

	{"level":"info","ts":"2023-12-26T21:59:59.656684Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 3"}

	{"level":"info","ts":"2023-12-26T21:59:59.656696Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"aec36adc501070cc became leader at term 3"}

	{"level":"info","ts":"2023-12-26T21:59:59.656713Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 3"}

	{"level":"info","ts":"2023-12-26T21:59:59.665828Z","caller":"etcdserver/server.go:2062","msg":"published local member to cluster through raft","local-member-id":"aec36adc501070cc","local-member-attributes":"{Name:functional-262391 ClientURLs:[https://192.168.49.2:2379]}","request-path":"/0/members/aec36adc501070cc/attributes","cluster-id":"fa54960ea34d58be","publish-timeout":"7s"}

	{"level":"info","ts":"2023-12-26T21:59:59.665876Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-12-26T21:59:59.666068Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2023-12-26T21:59:59.666131Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2023-12-26T21:59:59.66618Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2023-12-26T21:59:59.666967Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2023-12-26T21:59:59.668811Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.49.2:2379"}

	{"level":"info","ts":"2023-12-26T22:00:30.346229Z","caller":"osutil/interrupt_unix.go:64","msg":"received signal; shutting down","signal":"terminated"}

	{"level":"info","ts":"2023-12-26T22:00:30.346297Z","caller":"embed/etcd.go:376","msg":"closing etcd server","name":"functional-262391","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"]}

	{"level":"warn","ts":"2023-12-26T22:00:30.346388Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}

	{"level":"warn","ts":"2023-12-26T22:00:30.346492Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 127.0.0.1:2379: use of closed network connection"}

	{"level":"warn","ts":"2023-12-26T22:00:30.453048Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.49.2:2379: use of closed network connection"}

	{"level":"warn","ts":"2023-12-26T22:00:30.453103Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.49.2:2379: use of closed network connection"}

	{"level":"info","ts":"2023-12-26T22:00:30.453164Z","caller":"etcdserver/server.go:1465","msg":"skipped leadership transfer for single voting member cluster","local-member-id":"aec36adc501070cc","current-leader-member-id":"aec36adc501070cc"}

	{"level":"info","ts":"2023-12-26T22:00:30.455643Z","caller":"embed/etcd.go:579","msg":"stopping serving peer traffic","address":"192.168.49.2:2380"}

	{"level":"info","ts":"2023-12-26T22:00:30.455764Z","caller":"embed/etcd.go:584","msg":"stopped serving peer traffic","address":"192.168.49.2:2380"}

	{"level":"info","ts":"2023-12-26T22:00:30.455836Z","caller":"embed/etcd.go:378","msg":"closed etcd server","name":"functional-262391","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.49.2:2380"],"advertise-client-urls":["https://192.168.49.2:2379"]}

	==> kernel <==

	 22:04:25 up  5:46,  0 users,  load average: 0.22, 0.73, 1.11

	Linux functional-262391 5.15.0-1051-aws #56~20.04.1-Ubuntu SMP Tue Nov 28 15:43:06 UTC 2023 aarch64 aarch64 aarch64 GNU/Linux

	PRETTY_NAME="Ubuntu 22.04.3 LTS"

	==> kindnet [1df6c7623610bbf8c6b273c1740811d523e0b388e3b58285ccb585dec2832714] <==

	I1226 22:02:23.136856       1 main.go:227] handling current node

	I1226 22:02:33.146037       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 22:02:33.146068       1 main.go:227] handling current node

	I1226 22:02:43.150872       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 22:02:43.150974       1 main.go:227] handling current node

	I1226 22:02:53.154534       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 22:02:53.154566       1 main.go:227] handling current node

	I1226 22:03:03.164930       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 22:03:03.164959       1 main.go:227] handling current node

	I1226 22:03:13.169435       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 22:03:13.169466       1 main.go:227] handling current node

	I1226 22:03:23.180839       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 22:03:23.180939       1 main.go:227] handling current node

	I1226 22:03:33.185631       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 22:03:33.185657       1 main.go:227] handling current node

	I1226 22:03:43.196067       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 22:03:43.196097       1 main.go:227] handling current node

	I1226 22:03:53.200206       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 22:03:53.200236       1 main.go:227] handling current node

	I1226 22:04:03.212932       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 22:04:03.212964       1 main.go:227] handling current node

	I1226 22:04:13.224504       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 22:04:13.224562       1 main.go:227] handling current node

	I1226 22:04:23.232653       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 22:04:23.232689       1 main.go:227] handling current node

	==> kindnet [e26ee425462b716831b83e20c569f4e514e2fa4c6413ef4056d6e78bd6facc52] <==

	I1226 21:59:58.372081       1 main.go:102] connected to apiserver: https://10.96.0.1:443

	I1226 21:59:58.372349       1 main.go:107] hostIP = 192.168.49.2

	podIP = 192.168.49.2

	I1226 21:59:58.372950       1 main.go:116] setting mtu 1500 for CNI 

	I1226 21:59:58.372998       1 main.go:146] kindnetd IP family: "ipv4"

	I1226 21:59:58.373048       1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]

	I1226 22:00:02.954600       1 main.go:191] Failed to get nodes, retrying after error: nodes is forbidden: User "system:serviceaccount:kube-system:kindnet" cannot list resource "nodes" in API group "" at the cluster scope

	I1226 22:00:02.984743       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 22:00:02.984854       1 main.go:227] handling current node

	I1226 22:00:13.002693       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 22:00:13.002728       1 main.go:227] handling current node

	I1226 22:00:23.016215       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]

	I1226 22:00:23.016363       1 main.go:227] handling current node

	==> kube-apiserver [bb588759e509222c7f1078424a8f078415da95e47ab661f0dc3d09afabecff7f] <==

	I1226 22:00:51.782495       1 shared_informer.go:311] Waiting for caches to sync for crd-autoregister

	I1226 22:00:51.989128       1 shared_informer.go:318] Caches are synced for cluster_authentication_trust_controller

	I1226 22:00:51.989170       1 apf_controller.go:377] Running API Priority and Fairness config worker

	I1226 22:00:51.989176       1 apf_controller.go:380] Running API Priority and Fairness periodic rebalancing process

	I1226 22:00:51.989407       1 shared_informer.go:318] Caches are synced for crd-autoregister

	I1226 22:00:51.989678       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I1226 22:00:51.992399       1 shared_informer.go:318] Caches are synced for node_authorizer

	I1226 22:00:51.992508       1 aggregator.go:166] initial CRD sync complete...

	I1226 22:00:51.992588       1 autoregister_controller.go:141] Starting autoregister controller

	I1226 22:00:51.992618       1 cache.go:32] Waiting for caches to sync for autoregister controller

	I1226 22:00:51.992661       1 cache.go:39] Caches are synced for autoregister controller

	I1226 22:00:51.995887       1 shared_informer.go:318] Caches are synced for configmaps

	I1226 22:00:52.002022       1 cache.go:39] Caches are synced for AvailableConditionController controller

	E1226 22:00:52.007913       1 controller.go:97] Error removing old endpoints from kubernetes service: no API server IP addresses were listed in storage, refusing to erase all endpoints for the kubernetes Service

	I1226 22:00:52.038705       1 controller.go:624] quota admission added evaluator for: leases.coordination.k8s.io

	I1226 22:00:52.718176       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.

	I1226 22:00:54.005370       1 controller.go:624] quota admission added evaluator for: daemonsets.apps

	I1226 22:00:54.157230       1 controller.go:624] quota admission added evaluator for: serviceaccounts

	I1226 22:00:54.167103       1 controller.go:624] quota admission added evaluator for: deployments.apps

	I1226 22:00:54.231141       1 controller.go:624] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I1226 22:00:54.238992       1 controller.go:624] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I1226 22:01:10.192830       1 controller.go:624] quota admission added evaluator for: endpoints

	I1226 22:01:10.337110       1 alloc.go:330] "allocated clusterIPs" service="default/invalid-svc" clusterIPs={"IPv4":"10.98.77.75"}

	I1226 22:01:10.359103       1 controller.go:624] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I1226 22:01:17.039859       1 alloc.go:330] "allocated clusterIPs" service="default/nginx-svc" clusterIPs={"IPv4":"10.99.144.81"}

	==> kube-controller-manager [1ef2a1a3e47ebe5b2a04ac354c6ce5c027694d64a2536f75cc3431a8e1535ae8] <==

	I1226 22:00:14.974449       1 range_allocator.go:178] "Starting range CIDR allocator"

	I1226 22:00:14.974518       1 shared_informer.go:311] Waiting for caches to sync for cidrallocator

	I1226 22:00:14.974557       1 shared_informer.go:318] Caches are synced for cidrallocator

	I1226 22:00:14.973852       1 shared_informer.go:318] Caches are synced for GC

	I1226 22:00:14.976513       1 shared_informer.go:318] Caches are synced for namespace

	I1226 22:00:14.976597       1 shared_informer.go:318] Caches are synced for job

	I1226 22:00:14.978614       1 shared_informer.go:318] Caches are synced for certificate-csrsigning-kube-apiserver-client

	I1226 22:00:14.980508       1 shared_informer.go:318] Caches are synced for certificate-csrapproving

	I1226 22:00:14.981876       1 shared_informer.go:318] Caches are synced for certificate-csrsigning-legacy-unknown

	I1226 22:00:14.982760       1 shared_informer.go:318] Caches are synced for PVC protection

	I1226 22:00:14.985455       1 shared_informer.go:318] Caches are synced for daemon sets

	I1226 22:00:14.996674       1 shared_informer.go:318] Caches are synced for HPA

	I1226 22:00:14.997307       1 shared_informer.go:318] Caches are synced for service account

	I1226 22:00:14.997394       1 shared_informer.go:318] Caches are synced for ephemeral

	I1226 22:00:15.013664       1 shared_informer.go:318] Caches are synced for disruption

	I1226 22:00:15.018059       1 shared_informer.go:318] Caches are synced for ClusterRoleAggregator

	I1226 22:00:15.076300       1 shared_informer.go:318] Caches are synced for resource quota

	I1226 22:00:15.120907       1 shared_informer.go:318] Caches are synced for resource quota

	I1226 22:00:15.132513       1 shared_informer.go:318] Caches are synced for attach detach

	I1226 22:00:15.505453       1 shared_informer.go:318] Caches are synced for garbage collector

	I1226 22:00:15.505485       1 garbagecollector.go:166] "All resource monitors have synced. Proceeding to collect garbage"

	I1226 22:00:15.520800       1 shared_informer.go:318] Caches are synced for garbage collector

	I1226 22:00:18.061962       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="92.962µs"

	I1226 22:00:18.085084       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="10.748274ms"

	I1226 22:00:18.085172       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="50.666µs"

	==> kube-controller-manager [e1ece719ec1a10c589149010507e7de5c8094e4c14f55d6fd4584a7566a63b25] <==

	I1226 22:01:04.771016       1 node_lifecycle_controller.go:1071] "Controller detected that zone is now in new state" zone="" newState="Normal"

	I1226 22:01:04.771473       1 shared_informer.go:318] Caches are synced for certificate-csrapproving

	I1226 22:01:04.770198       1 shared_informer.go:318] Caches are synced for service account

	I1226 22:01:04.771707       1 event.go:307] "Event occurred" object="functional-262391" fieldPath="" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node functional-262391 event: Registered Node functional-262391 in Controller"

	I1226 22:01:04.773223       1 shared_informer.go:318] Caches are synced for cronjob

	I1226 22:01:04.774573       1 shared_informer.go:318] Caches are synced for persistent volume

	I1226 22:01:04.777953       1 shared_informer.go:318] Caches are synced for ephemeral

	I1226 22:01:04.821041       1 shared_informer.go:318] Caches are synced for GC

	I1226 22:01:04.821061       1 shared_informer.go:318] Caches are synced for daemon sets

	I1226 22:01:04.821081       1 shared_informer.go:318] Caches are synced for HPA

	I1226 22:01:04.823559       1 shared_informer.go:318] Caches are synced for job

	I1226 22:01:04.835970       1 shared_informer.go:318] Caches are synced for endpoint

	I1226 22:01:04.844142       1 shared_informer.go:318] Caches are synced for ReplicaSet

	I1226 22:01:04.844345       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/coredns-5dd5756b68" duration="108.403µs"

	I1226 22:01:04.851551       1 shared_informer.go:318] Caches are synced for PVC protection

	I1226 22:01:04.861935       1 shared_informer.go:318] Caches are synced for endpoint_slice

	I1226 22:01:04.864694       1 shared_informer.go:318] Caches are synced for resource quota

	I1226 22:01:04.873289       1 shared_informer.go:318] Caches are synced for ReplicationController

	I1226 22:01:04.877638       1 shared_informer.go:318] Caches are synced for resource quota

	I1226 22:01:04.884822       1 shared_informer.go:318] Caches are synced for disruption

	I1226 22:01:04.895080       1 shared_informer.go:318] Caches are synced for attach detach

	I1226 22:01:05.305251       1 shared_informer.go:318] Caches are synced for garbage collector

	I1226 22:01:05.312450       1 shared_informer.go:318] Caches are synced for garbage collector

	I1226 22:01:05.312485       1 garbagecollector.go:166] "All resource monitors have synced. Proceeding to collect garbage"

	I1226 22:01:23.316988       1 event.go:307] "Event occurred" object="default/myclaim" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="Waiting for a volume to be created either by the external provisioner 'k8s.io/minikube-hostpath' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered."

	==> kube-proxy [d2c7b8ff0a10f748682604cace54439cecb66a17767ffdd7df7f8e96de842b2e] <==

	I1226 22:00:52.725024       1 server_others.go:69] "Using iptables proxy"

	I1226 22:00:52.751556       1 node.go:141] Successfully retrieved node IP: 192.168.49.2

	I1226 22:00:52.811655       1 server.go:632] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"

	I1226 22:00:52.815551       1 server_others.go:152] "Using iptables Proxier"

	I1226 22:00:52.815623       1 server_others.go:421] "Detect-local-mode set to ClusterCIDR, but no cluster CIDR for family" ipFamily="IPv6"

	I1226 22:00:52.815632       1 server_others.go:438] "Defaulting to no-op detect-local"

	I1226 22:00:52.815666       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I1226 22:00:52.816095       1 server.go:846] "Version info" version="v1.28.4"

	I1226 22:00:52.816115       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1226 22:00:52.817510       1 config.go:188] "Starting service config controller"

	I1226 22:00:52.817534       1 shared_informer.go:311] Waiting for caches to sync for service config

	I1226 22:00:52.817553       1 config.go:97] "Starting endpoint slice config controller"

	I1226 22:00:52.817557       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I1226 22:00:52.817964       1 config.go:315] "Starting node config controller"

	I1226 22:00:52.817981       1 shared_informer.go:311] Waiting for caches to sync for node config

	I1226 22:00:52.918637       1 shared_informer.go:318] Caches are synced for node config

	I1226 22:00:52.918671       1 shared_informer.go:318] Caches are synced for service config

	I1226 22:00:52.918724       1 shared_informer.go:318] Caches are synced for endpoint slice config

	==> kube-proxy [d8f430ff9b1cde2991cdb177244c7ccd14d87e4017a42ed0df1ec6b53cbd6242] <==

	I1226 22:00:01.318569       1 server_others.go:69] "Using iptables proxy"

	I1226 22:00:03.050894       1 node.go:141] Successfully retrieved node IP: 192.168.49.2

	I1226 22:00:03.110300       1 server.go:632] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"

	I1226 22:00:03.116719       1 server_others.go:152] "Using iptables Proxier"

	I1226 22:00:03.116866       1 server_others.go:421] "Detect-local-mode set to ClusterCIDR, but no cluster CIDR for family" ipFamily="IPv6"

	I1226 22:00:03.116910       1 server_others.go:438] "Defaulting to no-op detect-local"

	I1226 22:00:03.117029       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I1226 22:00:03.117340       1 server.go:846] "Version info" version="v1.28.4"

	I1226 22:00:03.117617       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1226 22:00:03.119434       1 config.go:188] "Starting service config controller"

	I1226 22:00:03.119556       1 shared_informer.go:311] Waiting for caches to sync for service config

	I1226 22:00:03.119614       1 config.go:97] "Starting endpoint slice config controller"

	I1226 22:00:03.119649       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config

	I1226 22:00:03.120195       1 config.go:315] "Starting node config controller"

	I1226 22:00:03.120260       1 shared_informer.go:311] Waiting for caches to sync for node config

	I1226 22:00:03.220989       1 shared_informer.go:318] Caches are synced for node config

	I1226 22:00:03.221031       1 shared_informer.go:318] Caches are synced for service config

	I1226 22:00:03.221068       1 shared_informer.go:318] Caches are synced for endpoint slice config

	==> kube-scheduler [0d6b996118725bf2ffc61c626851a3807df1a7c2c242876e22173b8ef119c623] <==

	I1226 22:00:01.995786       1 serving.go:348] Generated self-signed cert in-memory

	I1226 22:00:03.301095       1 server.go:154] "Starting Kubernetes Scheduler" version="v1.28.4"

	I1226 22:00:03.301211       1 server.go:156] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1226 22:00:03.311079       1 secure_serving.go:213] Serving securely on 127.0.0.1:10259

	I1226 22:00:03.311302       1 requestheader_controller.go:169] Starting RequestHeaderAuthRequestController

	I1226 22:00:03.311350       1 shared_informer.go:311] Waiting for caches to sync for RequestHeaderAuthRequestController

	I1226 22:00:03.311394       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	I1226 22:00:03.320075       1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I1226 22:00:03.320296       1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1226 22:00:03.320680       1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file"

	I1226 22:00:03.320991       1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file

	I1226 22:00:03.412392       1 shared_informer.go:318] Caches are synced for RequestHeaderAuthRequestController

	I1226 22:00:03.421000       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1226 22:00:03.421147       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::requestheader-client-ca-file

	I1226 22:00:30.344734       1 secure_serving.go:258] Stopped listening on 127.0.0.1:10259

	I1226 22:00:30.345539       1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController"

	E1226 22:00:30.345780       1 run.go:74] "command failed" err="finished without leader elect"

	==> kube-scheduler [4dcd4a3ad372e91c67360adb38c85ffb52ff6ba6a94492c75a7cfc9d92935baa] <==

	I1226 22:00:49.322439       1 serving.go:348] Generated self-signed cert in-memory

	W1226 22:00:51.900951       1 requestheader_controller.go:193] Unable to get configmap/extension-apiserver-authentication in kube-system.  Usually fixed by 'kubectl create rolebinding -n kube-system ROLEBINDING_NAME --role=extension-apiserver-authentication-reader --serviceaccount=YOUR_NS:YOUR_SA'

	W1226 22:00:51.901057       1 authentication.go:368] Error looking up in-cluster authentication configuration: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot get resource "configmaps" in API group "" in the namespace "kube-system"

	W1226 22:00:51.901093       1 authentication.go:369] Continuing without authentication configuration. This may treat all requests as anonymous.

	W1226 22:00:51.901142       1 authentication.go:370] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false

	I1226 22:00:51.969047       1 server.go:154] "Starting Kubernetes Scheduler" version="v1.28.4"

	I1226 22:00:51.969150       1 server.go:156] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1226 22:00:51.972071       1 secure_serving.go:213] Serving securely on 127.0.0.1:10259

	I1226 22:00:51.972640       1 configmap_cafile_content.go:202] "Starting controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	I1226 22:00:51.973103       1 shared_informer.go:311] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	I1226 22:00:51.972670       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	I1226 22:00:52.073693       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	==> kubelet <==

	Dec 26 22:03:33 functional-262391 kubelet[4675]: E1226 22:03:33.023471    4675 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"myfrontend\" with ErrImagePull: \"reading manifest latest in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit\"" pod="default/sp-pod" podUID="265d1a5f-6c1b-41a9-830c-235ee9d55ffe"

	Dec 26 22:03:44 functional-262391 kubelet[4675]: E1226 22:03:44.178334    4675 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"myfrontend\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx\\\"\"" pod="default/sp-pod" podUID="265d1a5f-6c1b-41a9-830c-235ee9d55ffe"

	Dec 26 22:03:47 functional-262391 kubelet[4675]: E1226 22:03:47.306065    4675 manager.go:1106] Failed to create existing container: /crio-94929afe0d0c23b274bad43180080edef96f59530ce4bff50ee74bb6edd6d636: Error finding container 94929afe0d0c23b274bad43180080edef96f59530ce4bff50ee74bb6edd6d636: Status 404 returned error can't find the container with id 94929afe0d0c23b274bad43180080edef96f59530ce4bff50ee74bb6edd6d636

	Dec 26 22:03:47 functional-262391 kubelet[4675]: E1226 22:03:47.306696    4675 manager.go:1106] Failed to create existing container: /docker/0f329dae541ede1670d5c7556e5f4b260ee3b6f71728967a170153f52271f2cf/crio-fef827a05791974659b0b84ebbfb174647c84037c272f8d37e49dd4e0a7f2eb5: Error finding container fef827a05791974659b0b84ebbfb174647c84037c272f8d37e49dd4e0a7f2eb5: Status 404 returned error can't find the container with id fef827a05791974659b0b84ebbfb174647c84037c272f8d37e49dd4e0a7f2eb5

	Dec 26 22:03:47 functional-262391 kubelet[4675]: E1226 22:03:47.306987    4675 manager.go:1106] Failed to create existing container: /crio-ced93628785c08737c21e870f51dfccb3a72bf75cbb625a905b814cdb39d300c: Error finding container ced93628785c08737c21e870f51dfccb3a72bf75cbb625a905b814cdb39d300c: Status 404 returned error can't find the container with id ced93628785c08737c21e870f51dfccb3a72bf75cbb625a905b814cdb39d300c

	Dec 26 22:03:47 functional-262391 kubelet[4675]: E1226 22:03:47.307272    4675 manager.go:1106] Failed to create existing container: /docker/0f329dae541ede1670d5c7556e5f4b260ee3b6f71728967a170153f52271f2cf/crio-94929afe0d0c23b274bad43180080edef96f59530ce4bff50ee74bb6edd6d636: Error finding container 94929afe0d0c23b274bad43180080edef96f59530ce4bff50ee74bb6edd6d636: Status 404 returned error can't find the container with id 94929afe0d0c23b274bad43180080edef96f59530ce4bff50ee74bb6edd6d636

	Dec 26 22:03:47 functional-262391 kubelet[4675]: E1226 22:03:47.307478    4675 manager.go:1106] Failed to create existing container: /crio-366e6735458fedfa28cfa70967455c9882b1068bc47fbc77eb10a3c732b36f54: Error finding container 366e6735458fedfa28cfa70967455c9882b1068bc47fbc77eb10a3c732b36f54: Status 404 returned error can't find the container with id 366e6735458fedfa28cfa70967455c9882b1068bc47fbc77eb10a3c732b36f54

	Dec 26 22:03:47 functional-262391 kubelet[4675]: E1226 22:03:47.307688    4675 manager.go:1106] Failed to create existing container: /docker/0f329dae541ede1670d5c7556e5f4b260ee3b6f71728967a170153f52271f2cf/crio-ced93628785c08737c21e870f51dfccb3a72bf75cbb625a905b814cdb39d300c: Error finding container ced93628785c08737c21e870f51dfccb3a72bf75cbb625a905b814cdb39d300c: Status 404 returned error can't find the container with id ced93628785c08737c21e870f51dfccb3a72bf75cbb625a905b814cdb39d300c

	Dec 26 22:03:47 functional-262391 kubelet[4675]: E1226 22:03:47.307879    4675 manager.go:1106] Failed to create existing container: /crio-ac3b0cf8e4b5b312e960910cb2b32e65a942cf16f1fac38ba8edfbddf7c7793d: Error finding container ac3b0cf8e4b5b312e960910cb2b32e65a942cf16f1fac38ba8edfbddf7c7793d: Status 404 returned error can't find the container with id ac3b0cf8e4b5b312e960910cb2b32e65a942cf16f1fac38ba8edfbddf7c7793d

	Dec 26 22:03:47 functional-262391 kubelet[4675]: E1226 22:03:47.308063    4675 manager.go:1106] Failed to create existing container: /docker/0f329dae541ede1670d5c7556e5f4b260ee3b6f71728967a170153f52271f2cf/crio-04fe9bb0de4db7857fe6aa33597481a9ee720ad67bece900c5b70753748a4820: Error finding container 04fe9bb0de4db7857fe6aa33597481a9ee720ad67bece900c5b70753748a4820: Status 404 returned error can't find the container with id 04fe9bb0de4db7857fe6aa33597481a9ee720ad67bece900c5b70753748a4820

	Dec 26 22:03:47 functional-262391 kubelet[4675]: E1226 22:03:47.308365    4675 manager.go:1106] Failed to create existing container: /docker/0f329dae541ede1670d5c7556e5f4b260ee3b6f71728967a170153f52271f2cf/crio-995e88ed74fef62deb6947fa0d06332dc498407081e6e8b35c83661d3d6e0dc8: Error finding container 995e88ed74fef62deb6947fa0d06332dc498407081e6e8b35c83661d3d6e0dc8: Status 404 returned error can't find the container with id 995e88ed74fef62deb6947fa0d06332dc498407081e6e8b35c83661d3d6e0dc8

	Dec 26 22:03:47 functional-262391 kubelet[4675]: E1226 22:03:47.308626    4675 manager.go:1106] Failed to create existing container: /docker/0f329dae541ede1670d5c7556e5f4b260ee3b6f71728967a170153f52271f2cf/crio-cb35f2f6fa9bf27026f38376801e38eea4561a9f629ff5339aa0bf5d18c1139c: Error finding container cb35f2f6fa9bf27026f38376801e38eea4561a9f629ff5339aa0bf5d18c1139c: Status 404 returned error can't find the container with id cb35f2f6fa9bf27026f38376801e38eea4561a9f629ff5339aa0bf5d18c1139c

	Dec 26 22:03:47 functional-262391 kubelet[4675]: E1226 22:03:47.308929    4675 manager.go:1106] Failed to create existing container: /crio-d60ff4eb1f096d6d9c9798e18fcd6ea0f7621bfd4c074fe40f3e5b10c9766013: Error finding container d60ff4eb1f096d6d9c9798e18fcd6ea0f7621bfd4c074fe40f3e5b10c9766013: Status 404 returned error can't find the container with id d60ff4eb1f096d6d9c9798e18fcd6ea0f7621bfd4c074fe40f3e5b10c9766013

	Dec 26 22:03:47 functional-262391 kubelet[4675]: E1226 22:03:47.309206    4675 manager.go:1106] Failed to create existing container: /crio-cb35f2f6fa9bf27026f38376801e38eea4561a9f629ff5339aa0bf5d18c1139c: Error finding container cb35f2f6fa9bf27026f38376801e38eea4561a9f629ff5339aa0bf5d18c1139c: Status 404 returned error can't find the container with id cb35f2f6fa9bf27026f38376801e38eea4561a9f629ff5339aa0bf5d18c1139c

	Dec 26 22:03:47 functional-262391 kubelet[4675]: E1226 22:03:47.309433    4675 manager.go:1106] Failed to create existing container: /docker/0f329dae541ede1670d5c7556e5f4b260ee3b6f71728967a170153f52271f2cf/crio-ac3b0cf8e4b5b312e960910cb2b32e65a942cf16f1fac38ba8edfbddf7c7793d: Error finding container ac3b0cf8e4b5b312e960910cb2b32e65a942cf16f1fac38ba8edfbddf7c7793d: Status 404 returned error can't find the container with id ac3b0cf8e4b5b312e960910cb2b32e65a942cf16f1fac38ba8edfbddf7c7793d

	Dec 26 22:03:47 functional-262391 kubelet[4675]: E1226 22:03:47.309659    4675 manager.go:1106] Failed to create existing container: /docker/0f329dae541ede1670d5c7556e5f4b260ee3b6f71728967a170153f52271f2cf/crio-366e6735458fedfa28cfa70967455c9882b1068bc47fbc77eb10a3c732b36f54: Error finding container 366e6735458fedfa28cfa70967455c9882b1068bc47fbc77eb10a3c732b36f54: Status 404 returned error can't find the container with id 366e6735458fedfa28cfa70967455c9882b1068bc47fbc77eb10a3c732b36f54

	Dec 26 22:03:47 functional-262391 kubelet[4675]: E1226 22:03:47.309829    4675 manager.go:1106] Failed to create existing container: /crio-995e88ed74fef62deb6947fa0d06332dc498407081e6e8b35c83661d3d6e0dc8: Error finding container 995e88ed74fef62deb6947fa0d06332dc498407081e6e8b35c83661d3d6e0dc8: Status 404 returned error can't find the container with id 995e88ed74fef62deb6947fa0d06332dc498407081e6e8b35c83661d3d6e0dc8

	Dec 26 22:03:47 functional-262391 kubelet[4675]: E1226 22:03:47.310037    4675 manager.go:1106] Failed to create existing container: /docker/0f329dae541ede1670d5c7556e5f4b260ee3b6f71728967a170153f52271f2cf/crio-d60ff4eb1f096d6d9c9798e18fcd6ea0f7621bfd4c074fe40f3e5b10c9766013: Error finding container d60ff4eb1f096d6d9c9798e18fcd6ea0f7621bfd4c074fe40f3e5b10c9766013: Status 404 returned error can't find the container with id d60ff4eb1f096d6d9c9798e18fcd6ea0f7621bfd4c074fe40f3e5b10c9766013

	Dec 26 22:03:47 functional-262391 kubelet[4675]: E1226 22:03:47.310290    4675 manager.go:1106] Failed to create existing container: /crio-fef827a05791974659b0b84ebbfb174647c84037c272f8d37e49dd4e0a7f2eb5: Error finding container fef827a05791974659b0b84ebbfb174647c84037c272f8d37e49dd4e0a7f2eb5: Status 404 returned error can't find the container with id fef827a05791974659b0b84ebbfb174647c84037c272f8d37e49dd4e0a7f2eb5

	Dec 26 22:03:47 functional-262391 kubelet[4675]: E1226 22:03:47.310471    4675 manager.go:1106] Failed to create existing container: /crio-04fe9bb0de4db7857fe6aa33597481a9ee720ad67bece900c5b70753748a4820: Error finding container 04fe9bb0de4db7857fe6aa33597481a9ee720ad67bece900c5b70753748a4820: Status 404 returned error can't find the container with id 04fe9bb0de4db7857fe6aa33597481a9ee720ad67bece900c5b70753748a4820

	Dec 26 22:04:03 functional-262391 kubelet[4675]: E1226 22:04:03.302077    4675 remote_image.go:180] "PullImage from image service failed" err="rpc error: code = Unknown desc = reading manifest alpine in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" image="docker.io/nginx:alpine"

	Dec 26 22:04:03 functional-262391 kubelet[4675]: E1226 22:04:03.302133    4675 kuberuntime_image.go:53] "Failed to pull image" err="reading manifest alpine in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit" image="docker.io/nginx:alpine"

	Dec 26 22:04:03 functional-262391 kubelet[4675]: E1226 22:04:03.302365    4675 kuberuntime_manager.go:1261] container &Container{Name:nginx,Image:docker.io/nginx:alpine,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{ContainerPort{Name:,HostPort:0,ContainerPort:80,Protocol:TCP,HostIP:,},},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-75hs6,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod nginx-svc_default(8b3bd6d9-b5bc-4a9b-9342-a27341ae613

0): ErrImagePull: reading manifest alpine in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	Dec 26 22:04:03 functional-262391 kubelet[4675]: E1226 22:04:03.302408    4675 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ErrImagePull: \"reading manifest alpine in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit\"" pod="default/nginx-svc" podUID="8b3bd6d9-b5bc-4a9b-9342-a27341ae6130"

	Dec 26 22:04:18 functional-262391 kubelet[4675]: E1226 22:04:18.178312    4675 pod_workers.go:1300] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"nginx\" with ImagePullBackOff: \"Back-off pulling image \\\"docker.io/nginx:alpine\\\"\"" pod="default/nginx-svc" podUID="8b3bd6d9-b5bc-4a9b-9342-a27341ae6130"

	==> storage-provisioner [312553732c0c5f3bb72b7c7cbbb9bf51f96775ad4a09c51ca62e4d6d2a24c91b] <==

	I1226 22:00:52.728575       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1226 22:00:52.790110       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1226 22:00:52.790273       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1226 22:01:10.199656       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1226 22:01:10.199901       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-262391_775a6439-92fa-4604-8739-d60b7d78fd26!

	I1226 22:01:10.200860       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"a200dfb9-8de7-4759-be4f-3372cc14fa73", APIVersion:"v1", ResourceVersion:"652", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-262391_775a6439-92fa-4604-8739-d60b7d78fd26 became leader

	I1226 22:01:10.301054       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-262391_775a6439-92fa-4604-8739-d60b7d78fd26!

	I1226 22:01:23.314604       1 controller.go:1332] provision "default/myclaim" class "standard": started

	I1226 22:01:23.314663       1 storage_provisioner.go:61] Provisioning volume {&StorageClass{ObjectMeta:{standard    e7439051-2e3f-4605-b293-6fc725214ae8 405 0 2023-12-26 21:59:06 +0000 UTC <nil> <nil> map[addonmanager.kubernetes.io/mode:EnsureExists] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{"storageclass.kubernetes.io/is-default-class":"true"},"labels":{"addonmanager.kubernetes.io/mode":"EnsureExists"},"name":"standard"},"provisioner":"k8s.io/minikube-hostpath"}

	 storageclass.kubernetes.io/is-default-class:true] [] []  [{kubectl-client-side-apply Update storage.k8s.io/v1 2023-12-26 21:59:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{},"f:storageclass.kubernetes.io/is-default-class":{}},"f:labels":{".":{},"f:addonmanager.kubernetes.io/mode":{}}},"f:provisioner":{},"f:reclaimPolicy":{},"f:volumeBindingMode":{}}}]},Provisioner:k8s.io/minikube-hostpath,Parameters:map[string]string{},ReclaimPolicy:*Delete,MountOptions:[],AllowVolumeExpansion:nil,VolumeBindingMode:*Immediate,AllowedTopologies:[]TopologySelectorTerm{},} pvc-c0347271-c017-4b68-ad50-b7f9527c0b76 &PersistentVolumeClaim{ObjectMeta:{myclaim  default  c0347271-c017-4b68-ad50-b7f9527c0b76 708 0 2023-12-26 22:01:23 +0000 UTC <nil> <nil> map[] map[kubectl.kubernetes.io/last-applied-configuration:{"apiVersion":"v1","kind":"PersistentVolumeClaim","metadata":{"annotations":{},"name":"myclaim","namespace":"default"},"spec":{"accessModes":["Rea

dWriteOnce"],"resources":{"requests":{"storage":"500Mi"}},"volumeMode":"Filesystem"}}

	 volume.beta.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath volume.kubernetes.io/storage-provisioner:k8s.io/minikube-hostpath] [] [kubernetes.io/pvc-protection]  [{kube-controller-manager Update v1 2023-12-26 22:01:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:volume.beta.kubernetes.io/storage-provisioner":{},"f:volume.kubernetes.io/storage-provisioner":{}}}}} {kubectl-client-side-apply Update v1 2023-12-26 22:01:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:kubectl.kubernetes.io/last-applied-configuration":{}}},"f:spec":{"f:accessModes":{},"f:resources":{"f:requests":{".":{},"f:storage":{}}},"f:volumeMode":{}}}}]},Spec:PersistentVolumeClaimSpec{AccessModes:[ReadWriteOnce],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{storage: {{524288000 0} {<nil>} 500Mi BinarySI},},},VolumeName:,Selector:nil,StorageClassName:*standard,VolumeMode:*Filesystem,DataSource:nil,},Status:PersistentVolumeClaimStatus{Phase:Pending,AccessModes:[],Capacity:

ResourceList{},Conditions:[]PersistentVolumeClaimCondition{},},} nil} to /tmp/hostpath-provisioner/default/myclaim

	I1226 22:01:23.317582       1 controller.go:1439] provision "default/myclaim" class "standard": volume "pvc-c0347271-c017-4b68-ad50-b7f9527c0b76" provisioned

	I1226 22:01:23.317607       1 controller.go:1456] provision "default/myclaim" class "standard": succeeded

	I1226 22:01:23.317614       1 volume_store.go:212] Trying to save persistentvolume "pvc-c0347271-c017-4b68-ad50-b7f9527c0b76"

	I1226 22:01:23.318587       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"c0347271-c017-4b68-ad50-b7f9527c0b76", APIVersion:"v1", ResourceVersion:"708", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/myclaim"

	I1226 22:01:23.343648       1 volume_store.go:219] persistentvolume "pvc-c0347271-c017-4b68-ad50-b7f9527c0b76" saved

	I1226 22:01:23.343747       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"myclaim", UID:"c0347271-c017-4b68-ad50-b7f9527c0b76", APIVersion:"v1", ResourceVersion:"708", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume pvc-c0347271-c017-4b68-ad50-b7f9527c0b76

	==> storage-provisioner [a34d8d5ed9ea4f1f416f5d388b6188b40b9af4f3a7333580289b2408beeb1b77] <==

	I1226 21:59:59.075528       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I1226 22:00:03.061761       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I1226 22:00:03.061918       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I1226 22:00:20.478235       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I1226 22:00:20.479308       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_functional-262391_41c437c0-f9a2-44bc-b491-21885d0fe963!

	I1226 22:00:20.481227       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"a200dfb9-8de7-4759-be4f-3372cc14fa73", APIVersion:"v1", ResourceVersion:"556", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' functional-262391_41c437c0-f9a2-44bc-b491-21885d0fe963 became leader

	I1226 22:00:20.579865       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_functional-262391_41c437c0-f9a2-44bc-b491-21885d0fe963!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-arm64 status --format={{.APIServer}} -p functional-262391 -n functional-262391

helpers_test.go:261: (dbg) Run:  kubectl --context functional-262391 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: nginx-svc sp-pod

helpers_test.go:274: ======> post-mortem[TestFunctional/parallel/PersistentVolumeClaim]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context functional-262391 describe pod nginx-svc sp-pod

helpers_test.go:282: (dbg) kubectl --context functional-262391 describe pod nginx-svc sp-pod:

-- stdout --

	Name:             nginx-svc

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             functional-262391/192.168.49.2

	Start Time:       Tue, 26 Dec 2023 22:01:17 +0000

	Labels:           run=nginx-svc

	Annotations:      <none>

	Status:           Pending

	IP:               10.244.0.4

	IPs:

	  IP:  10.244.0.4

	Containers:

	  nginx:

	    Container ID:   

	    Image:          docker.io/nginx:alpine

	    Image ID:       

	    Port:           80/TCP

	    Host Port:      0/TCP

	    State:          Waiting

	      Reason:       ErrImagePull

	    Ready:          False

	    Restart Count:  0

	    Environment:    <none>

	    Mounts:

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-75hs6 (ro)

	Conditions:

	  Type              Status

	  Initialized       True 

	  Ready             False 

	  ContainersReady   False 

	  PodScheduled      True 

	Volumes:

	  kube-api-access-75hs6:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	QoS Class:                   BestEffort

	Node-Selectors:              <none>

	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason     Age                  From               Message

	  ----     ------     ----                 ----               -------

	  Normal   Scheduled  3m10s                default-scheduler  Successfully assigned default/nginx-svc to functional-262391

	  Warning  Failed     2m40s                kubelet            Failed to pull image "docker.io/nginx:alpine": initializing source docker://nginx:alpine: reading manifest alpine in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Warning  Failed     85s                  kubelet            Failed to pull image "docker.io/nginx:alpine": loading manifest for target platform: reading manifest sha256:7913e8fa2e6a5f0160a5e6b7ea48b7d4a301c6058d63c3d632a35a59093cb4eb in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Normal   Pulling    55s (x3 over 3m10s)  kubelet            Pulling image "docker.io/nginx:alpine"

	  Warning  Failed     24s (x3 over 2m40s)  kubelet            Error: ErrImagePull

	  Warning  Failed     24s                  kubelet            Failed to pull image "docker.io/nginx:alpine": reading manifest alpine in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Normal   BackOff    9s (x3 over 2m39s)   kubelet            Back-off pulling image "docker.io/nginx:alpine"

	  Warning  Failed     9s (x3 over 2m39s)   kubelet            Error: ImagePullBackOff

	Name:             sp-pod

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             functional-262391/192.168.49.2

	Start Time:       Tue, 26 Dec 2023 22:01:23 +0000

	Labels:           test=storage-provisioner

	Annotations:      <none>

	Status:           Pending

	IP:               10.244.0.5

	IPs:

	  IP:  10.244.0.5

	Containers:

	  myfrontend:

	    Container ID:   

	    Image:          docker.io/nginx

	    Image ID:       

	    Port:           <none>

	    Host Port:      <none>

	    State:          Waiting

	      Reason:       ImagePullBackOff

	    Ready:          False

	    Restart Count:  0

	    Environment:    <none>

	    Mounts:

	      /tmp/mount from mypd (rw)

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-4hc7k (ro)

	Conditions:

	  Type              Status

	  Initialized       True 

	  Ready             False 

	  ContainersReady   False 

	  PodScheduled      True 

	Volumes:

	  mypd:

	    Type:       PersistentVolumeClaim (a reference to a PersistentVolumeClaim in the same namespace)

	    ClaimName:  myclaim

	    ReadOnly:   false

	  kube-api-access-4hc7k:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	QoS Class:                   BestEffort

	Node-Selectors:              <none>

	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason     Age                 From               Message

	  ----     ------     ----                ----               -------

	  Normal   Scheduled  3m4s                default-scheduler  Successfully assigned default/sp-pod to functional-262391

	  Warning  Failed     54s (x2 over 2m9s)  kubelet            Failed to pull image "docker.io/nginx": reading manifest latest in docker.io/library/nginx: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit

	  Warning  Failed     54s (x2 over 2m9s)  kubelet            Error: ErrImagePull

	  Normal   BackOff    43s (x2 over 2m9s)  kubelet            Back-off pulling image "docker.io/nginx"

	  Warning  Failed     43s (x2 over 2m9s)  kubelet            Error: ImagePullBackOff

	  Normal   Pulling    31s (x3 over 3m4s)  kubelet            Pulling image "docker.io/nginx"

-- /stdout --

helpers_test.go:285: <<< TestFunctional/parallel/PersistentVolumeClaim FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestFunctional/parallel/PersistentVolumeClaim (190.23s)