Test Report: Docker_Linux_crio 18284

                    
                      5ddb71fe0a42bb2133c9d6493465817bfdb3ae9e:2024-03-04:33407
                    
                

Test fail (3/320)

Order failed test Duration
39 TestAddons/parallel/Ingress 150.66
45 TestAddons/parallel/Headlamp 2.8
171 TestIngressAddonLegacy/serial/ValidateIngressAddons 175.42
x
+
TestAddons/parallel/Ingress (150.66s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:207: (dbg) Run:  kubectl --context addons-975865 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:232: (dbg) Run:  kubectl --context addons-975865 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:245: (dbg) Run:  kubectl --context addons-975865 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [7cec65fb-dd3f-4f06-8f45-41742249b981] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [7cec65fb-dd3f-4f06-8f45-41742249b981] Running
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 8.004004697s
addons_test.go:262: (dbg) Run:  out/minikube-linux-amd64 -p addons-975865 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 -p addons-975865 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'": exit status 1 (2m10.683057899s)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 28

                                                
                                                
** /stderr **
addons_test.go:278: failed to get expected response from http://127.0.0.1/ within minikube: exit status 1
addons_test.go:286: (dbg) Run:  kubectl --context addons-975865 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:291: (dbg) Run:  out/minikube-linux-amd64 -p addons-975865 ip
addons_test.go:297: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:306: (dbg) Run:  out/minikube-linux-amd64 -p addons-975865 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:306: (dbg) Done: out/minikube-linux-amd64 -p addons-975865 addons disable ingress-dns --alsologtostderr -v=1: (1.344349035s)
addons_test.go:311: (dbg) Run:  out/minikube-linux-amd64 -p addons-975865 addons disable ingress --alsologtostderr -v=1
addons_test.go:311: (dbg) Done: out/minikube-linux-amd64 -p addons-975865 addons disable ingress --alsologtostderr -v=1: (7.58799042s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestAddons/parallel/Ingress]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect addons-975865
helpers_test.go:235: (dbg) docker inspect addons-975865:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "89c01ac9a8151395a60453aa534f39efedae7b9a9a00081eb711e101e4ec0822",
	        "Created": "2024-03-04T11:47:28.217220092Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 405771,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2024-03-04T11:47:28.4851528Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:a5b872dc86053f77fb58d93168e89c4b0fa5961a7ed628d630f6cd6decd7bca0",
	        "ResolvConfPath": "/var/lib/docker/containers/89c01ac9a8151395a60453aa534f39efedae7b9a9a00081eb711e101e4ec0822/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/89c01ac9a8151395a60453aa534f39efedae7b9a9a00081eb711e101e4ec0822/hostname",
	        "HostsPath": "/var/lib/docker/containers/89c01ac9a8151395a60453aa534f39efedae7b9a9a00081eb711e101e4ec0822/hosts",
	        "LogPath": "/var/lib/docker/containers/89c01ac9a8151395a60453aa534f39efedae7b9a9a00081eb711e101e4ec0822/89c01ac9a8151395a60453aa534f39efedae7b9a9a00081eb711e101e4ec0822-json.log",
	        "Name": "/addons-975865",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "addons-975865:/var",
	                "/lib/modules:/lib/modules:ro"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "addons-975865",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4194304000,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8388608000,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/253033a75c16ac5a48ed46bd3191215abb9e05a7e4bde3c4b78dd1c214dc30ad-init/diff:/var/lib/docker/overlay2/6777c34f254c285e28a6f05fba96b29f9919e3bc636ac1ce063284fa05399be2/diff",
	                "MergedDir": "/var/lib/docker/overlay2/253033a75c16ac5a48ed46bd3191215abb9e05a7e4bde3c4b78dd1c214dc30ad/merged",
	                "UpperDir": "/var/lib/docker/overlay2/253033a75c16ac5a48ed46bd3191215abb9e05a7e4bde3c4b78dd1c214dc30ad/diff",
	                "WorkDir": "/var/lib/docker/overlay2/253033a75c16ac5a48ed46bd3191215abb9e05a7e4bde3c4b78dd1c214dc30ad/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "addons-975865",
	                "Source": "/var/lib/docker/volumes/addons-975865/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "addons-975865",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "addons-975865",
	                "name.minikube.sigs.k8s.io": "addons-975865",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "3c90a56b0ec89e5133468e4c04a5bb975d9d3e0a7654dd94bcba3071c4f43d24",
	            "SandboxKey": "/var/run/docker/netns/3c90a56b0ec8",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32772"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32771"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32768"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32770"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32769"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "addons-975865": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "89c01ac9a815",
	                        "addons-975865"
	                    ],
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "NetworkID": "f4830c9d5cd160b632f2898af432c4b95a45a24a8479cf1921e5a84d1f69222d",
	                    "EndpointID": "ccb85eaef81a21887717b52abb827d886ff825808f8574ddf6039376acf21f0b",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DriverOpts": null,
	                    "DNSNames": [
	                        "addons-975865",
	                        "89c01ac9a815"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p addons-975865 -n addons-975865
helpers_test.go:244: <<< TestAddons/parallel/Ingress FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Ingress]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p addons-975865 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p addons-975865 logs -n 25: (1.197130315s)
helpers_test.go:252: TestAddons/parallel/Ingress logs: 
-- stdout --
	
	==> Audit <==
	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| Command |                                            Args                                             |        Profile         |  User   | Version |     Start Time      |      End Time       |
	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| delete  | -p download-only-239468                                                                     | download-only-239468   | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC | 04 Mar 24 11:47 UTC |
	| delete  | -p download-only-675340                                                                     | download-only-675340   | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC | 04 Mar 24 11:47 UTC |
	| start   | --download-only -p                                                                          | download-docker-291405 | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC |                     |
	|         | download-docker-291405                                                                      |                        |         |         |                     |                     |
	|         | --alsologtostderr                                                                           |                        |         |         |                     |                     |
	|         | --driver=docker                                                                             |                        |         |         |                     |                     |
	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |
	| delete  | -p download-docker-291405                                                                   | download-docker-291405 | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC | 04 Mar 24 11:47 UTC |
	| start   | --download-only -p                                                                          | binary-mirror-624411   | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC |                     |
	|         | binary-mirror-624411                                                                        |                        |         |         |                     |                     |
	|         | --alsologtostderr                                                                           |                        |         |         |                     |                     |
	|         | --binary-mirror                                                                             |                        |         |         |                     |                     |
	|         | http://127.0.0.1:34831                                                                      |                        |         |         |                     |                     |
	|         | --driver=docker                                                                             |                        |         |         |                     |                     |
	|         | --container-runtime=crio                                                                    |                        |         |         |                     |                     |
	| delete  | -p binary-mirror-624411                                                                     | binary-mirror-624411   | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC | 04 Mar 24 11:47 UTC |
	| addons  | enable dashboard -p                                                                         | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC |                     |
	|         | addons-975865                                                                               |                        |         |         |                     |                     |
	| addons  | disable dashboard -p                                                                        | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC |                     |
	|         | addons-975865                                                                               |                        |         |         |                     |                     |
	| start   | -p addons-975865 --wait=true                                                                | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC | 04 Mar 24 11:49 UTC |
	|         | --memory=4000 --alsologtostderr                                                             |                        |         |         |                     |                     |
	|         | --addons=registry                                                                           |                        |         |         |                     |                     |
	|         | --addons=metrics-server                                                                     |                        |         |         |                     |                     |
	|         | --addons=volumesnapshots                                                                    |                        |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver                                                                |                        |         |         |                     |                     |
	|         | --addons=gcp-auth                                                                           |                        |         |         |                     |                     |
	|         | --addons=cloud-spanner                                                                      |                        |         |         |                     |                     |
	|         | --addons=inspektor-gadget                                                                   |                        |         |         |                     |                     |
	|         | --addons=storage-provisioner-rancher                                                        |                        |         |         |                     |                     |
	|         | --addons=nvidia-device-plugin                                                               |                        |         |         |                     |                     |
	|         | --addons=yakd --driver=docker                                                               |                        |         |         |                     |                     |
	|         |  --container-runtime=crio                                                                   |                        |         |         |                     |                     |
	|         | --addons=ingress                                                                            |                        |         |         |                     |                     |
	|         | --addons=ingress-dns                                                                        |                        |         |         |                     |                     |
	|         | --addons=helm-tiller                                                                        |                        |         |         |                     |                     |
	| addons  | disable nvidia-device-plugin                                                                | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:49 UTC | 04 Mar 24 11:49 UTC |
	|         | -p addons-975865                                                                            |                        |         |         |                     |                     |
	| addons  | addons-975865 addons disable                                                                | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:49 UTC | 04 Mar 24 11:49 UTC |
	|         | helm-tiller --alsologtostderr                                                               |                        |         |         |                     |                     |
	|         | -v=1                                                                                        |                        |         |         |                     |                     |
	| addons  | addons-975865 addons                                                                        | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:49 UTC | 04 Mar 24 11:49 UTC |
	|         | disable metrics-server                                                                      |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| ip      | addons-975865 ip                                                                            | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:49 UTC | 04 Mar 24 11:49 UTC |
	| addons  | addons-975865 addons disable                                                                | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:49 UTC | 04 Mar 24 11:49 UTC |
	|         | registry --alsologtostderr                                                                  |                        |         |         |                     |                     |
	|         | -v=1                                                                                        |                        |         |         |                     |                     |
	| addons  | enable headlamp                                                                             | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:49 UTC |                     |
	|         | -p addons-975865                                                                            |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| addons  | disable cloud-spanner -p                                                                    | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:49 UTC | 04 Mar 24 11:49 UTC |
	|         | addons-975865                                                                               |                        |         |         |                     |                     |
	| ssh     | addons-975865 ssh cat                                                                       | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:49 UTC | 04 Mar 24 11:49 UTC |
	|         | /opt/local-path-provisioner/pvc-b19b11ba-71fe-4d1c-b122-7cb5d5ad1463_default_test-pvc/file1 |                        |         |         |                     |                     |
	| addons  | addons-975865 addons disable                                                                | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:49 UTC | 04 Mar 24 11:50 UTC |
	|         | storage-provisioner-rancher                                                                 |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| addons  | disable inspektor-gadget -p                                                                 | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:49 UTC | 04 Mar 24 11:49 UTC |
	|         | addons-975865                                                                               |                        |         |         |                     |                     |
	| ssh     | addons-975865 ssh curl -s                                                                   | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:49 UTC |                     |
	|         | http://127.0.0.1/ -H 'Host:                                                                 |                        |         |         |                     |                     |
	|         | nginx.example.com'                                                                          |                        |         |         |                     |                     |
	| addons  | addons-975865 addons                                                                        | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:50 UTC | 04 Mar 24 11:50 UTC |
	|         | disable csi-hostpath-driver                                                                 |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| addons  | addons-975865 addons                                                                        | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:50 UTC | 04 Mar 24 11:50 UTC |
	|         | disable volumesnapshots                                                                     |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                        |         |         |                     |                     |
	| ip      | addons-975865 ip                                                                            | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:51 UTC | 04 Mar 24 11:51 UTC |
	| addons  | addons-975865 addons disable                                                                | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:51 UTC | 04 Mar 24 11:51 UTC |
	|         | ingress-dns --alsologtostderr                                                               |                        |         |         |                     |                     |
	|         | -v=1                                                                                        |                        |         |         |                     |                     |
	| addons  | addons-975865 addons disable                                                                | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:51 UTC | 04 Mar 24 11:51 UTC |
	|         | ingress --alsologtostderr -v=1                                                              |                        |         |         |                     |                     |
	|---------|---------------------------------------------------------------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/04 11:47:06
	Running on machine: ubuntu-20-agent-13
	Binary: Built with gc go1.22.0 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0304 11:47:06.988340  405110 out.go:291] Setting OutFile to fd 1 ...
	I0304 11:47:06.988575  405110 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 11:47:06.988584  405110 out.go:304] Setting ErrFile to fd 2...
	I0304 11:47:06.988588  405110 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 11:47:06.988779  405110 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18284-396872/.minikube/bin
	I0304 11:47:06.989396  405110 out.go:298] Setting JSON to false
	I0304 11:47:06.990274  405110 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":41376,"bootTime":1709511451,"procs":174,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1052-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0304 11:47:06.990339  405110 start.go:139] virtualization: kvm guest
	I0304 11:47:06.992610  405110 out.go:177] * [addons-975865] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
	I0304 11:47:06.994053  405110 out.go:177]   - MINIKUBE_LOCATION=18284
	I0304 11:47:06.994057  405110 notify.go:220] Checking for updates...
	I0304 11:47:06.995393  405110 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 11:47:06.996959  405110 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/18284-396872/kubeconfig
	I0304 11:47:06.998325  405110 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/18284-396872/.minikube
	I0304 11:47:06.999572  405110 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0304 11:47:07.000930  405110 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 11:47:07.002283  405110 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 11:47:07.023655  405110 docker.go:122] docker version: linux-25.0.3:Docker Engine - Community
	I0304 11:47:07.023761  405110 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0304 11:47:07.072632  405110 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:50 SystemTime:2024-03-04 11:47:07.064043148 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1052-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-13 Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerEr
rors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.6] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0304 11:47:07.072739  405110 docker.go:295] overlay module found
	I0304 11:47:07.074605  405110 out.go:177] * Using the docker driver based on user configuration
	I0304 11:47:07.076060  405110 start.go:299] selected driver: docker
	I0304 11:47:07.076079  405110 start.go:903] validating driver "docker" against <nil>
	I0304 11:47:07.076091  405110 start.go:914] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 11:47:07.076850  405110 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0304 11:47:07.126412  405110 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:50 SystemTime:2024-03-04 11:47:07.118238899 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1052-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-13 Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerEr
rors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.6] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0304 11:47:07.126647  405110 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I0304 11:47:07.126916  405110 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 11:47:07.128687  405110 out.go:177] * Using Docker driver with root privileges
	I0304 11:47:07.130257  405110 cni.go:84] Creating CNI manager for ""
	I0304 11:47:07.130279  405110 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0304 11:47:07.130292  405110 start_flags.go:318] Found "CNI" CNI - setting NetworkPlugin=cni
	I0304 11:47:07.130308  405110 start_flags.go:323] config:
	{Name:addons-975865 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:addons-975865 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 11:47:07.131882  405110 out.go:177] * Starting control plane node addons-975865 in cluster addons-975865
	I0304 11:47:07.133092  405110 cache.go:121] Beginning downloading kic base image for docker with crio
	I0304 11:47:07.134373  405110 out.go:177] * Pulling base image v0.0.42-1708944392-18244 ...
	I0304 11:47:07.135430  405110 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
	I0304 11:47:07.135458  405110 preload.go:148] Found local preload: /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
	I0304 11:47:07.135470  405110 cache.go:56] Caching tarball of preloaded images
	I0304 11:47:07.135540  405110 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon
	I0304 11:47:07.135577  405110 preload.go:174] Found /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0304 11:47:07.135593  405110 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on crio
	I0304 11:47:07.135923  405110 profile.go:148] Saving config to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/config.json ...
	I0304 11:47:07.135949  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/config.json: {Name:mk3f00c0f4322abdd4f1128affae9fcc3b49acd7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:07.150541  405110 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 to local cache
	I0304 11:47:07.150672  405110 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local cache directory
	I0304 11:47:07.150690  405110 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local cache directory, skipping pull
	I0304 11:47:07.150694  405110 image.go:105] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 exists in cache, skipping pull
	I0304 11:47:07.150702  405110 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 as a tarball
	I0304 11:47:07.150707  405110 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 from local cache
	I0304 11:47:19.683893  405110 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 from cached tarball
	I0304 11:47:19.683949  405110 cache.go:194] Successfully downloaded all kic artifacts
	I0304 11:47:19.683989  405110 start.go:365] acquiring machines lock for addons-975865: {Name:mk7f1f17845ce0ed3897db6ffbca47361b4bc960 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 11:47:19.684099  405110 start.go:369] acquired machines lock for "addons-975865" in 88.884µs
	I0304 11:47:19.684125  405110 start.go:93] Provisioning new machine with config: &{Name:addons-975865 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:addons-975865 Namespace:default APIServerName:minikubeCA A
PIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disabl
eMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0304 11:47:19.684231  405110 start.go:125] createHost starting for "" (driver="docker")
	I0304 11:47:19.745217  405110 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...
	I0304 11:47:19.745586  405110 start.go:159] libmachine.API.Create for "addons-975865" (driver="docker")
	I0304 11:47:19.745627  405110 client.go:168] LocalClient.Create starting
	I0304 11:47:19.745827  405110 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem
	I0304 11:47:20.206770  405110 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/cert.pem
	I0304 11:47:20.316630  405110 cli_runner.go:164] Run: docker network inspect addons-975865 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0304 11:47:20.332800  405110 cli_runner.go:211] docker network inspect addons-975865 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0304 11:47:20.332892  405110 network_create.go:281] running [docker network inspect addons-975865] to gather additional debugging logs...
	I0304 11:47:20.332919  405110 cli_runner.go:164] Run: docker network inspect addons-975865
	W0304 11:47:20.347994  405110 cli_runner.go:211] docker network inspect addons-975865 returned with exit code 1
	I0304 11:47:20.348033  405110 network_create.go:284] error running [docker network inspect addons-975865]: docker network inspect addons-975865: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network addons-975865 not found
	I0304 11:47:20.348061  405110 network_create.go:286] output of [docker network inspect addons-975865]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network addons-975865 not found
	
	** /stderr **
	I0304 11:47:20.348230  405110 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0304 11:47:20.363345  405110 network.go:207] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00314ee60}
	I0304 11:47:20.363400  405110 network_create.go:124] attempt to create docker network addons-975865 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0304 11:47:20.363452  405110 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-975865 addons-975865
	I0304 11:47:20.671371  405110 network_create.go:108] docker network addons-975865 192.168.49.0/24 created
	I0304 11:47:20.671406  405110 kic.go:121] calculated static IP "192.168.49.2" for the "addons-975865" container
	I0304 11:47:20.671459  405110 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0304 11:47:20.686372  405110 cli_runner.go:164] Run: docker volume create addons-975865 --label name.minikube.sigs.k8s.io=addons-975865 --label created_by.minikube.sigs.k8s.io=true
	I0304 11:47:20.798695  405110 oci.go:103] Successfully created a docker volume addons-975865
	I0304 11:47:20.798777  405110 cli_runner.go:164] Run: docker run --rm --name addons-975865-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-975865 --entrypoint /usr/bin/test -v addons-975865:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -d /var/lib
	I0304 11:47:23.071096  405110 cli_runner.go:217] Completed: docker run --rm --name addons-975865-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-975865 --entrypoint /usr/bin/test -v addons-975865:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -d /var/lib: (2.272273091s)
	I0304 11:47:23.071126  405110 oci.go:107] Successfully prepared a docker volume addons-975865
	I0304 11:47:23.071153  405110 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
	I0304 11:47:23.071174  405110 kic.go:194] Starting extracting preloaded images to volume ...
	I0304 11:47:23.071242  405110 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v addons-975865:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -I lz4 -xf /preloaded.tar -C /extractDir
	I0304 11:47:28.151505  405110 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v addons-975865:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -I lz4 -xf /preloaded.tar -C /extractDir: (5.080223086s)
	I0304 11:47:28.151540  405110 kic.go:203] duration metric: took 5.080361 seconds to extract preloaded images to volume
	W0304 11:47:28.151672  405110 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0304 11:47:28.151774  405110 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0304 11:47:28.203351  405110 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-975865 --name addons-975865 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-975865 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-975865 --network addons-975865 --ip 192.168.49.2 --volume addons-975865:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08
	I0304 11:47:28.491998  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Running}}
	I0304 11:47:28.508553  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:28.525427  405110 cli_runner.go:164] Run: docker exec addons-975865 stat /var/lib/dpkg/alternatives/iptables
	I0304 11:47:28.564349  405110 oci.go:144] the created container "addons-975865" has a running status.
	I0304 11:47:28.564390  405110 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa...
	I0304 11:47:28.934240  405110 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0304 11:47:28.957820  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:28.974277  405110 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0304 11:47:28.974300  405110 kic_runner.go:114] Args: [docker exec --privileged addons-975865 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0304 11:47:29.011820  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:29.027682  405110 machine.go:88] provisioning docker machine ...
	I0304 11:47:29.027721  405110 ubuntu.go:169] provisioning hostname "addons-975865"
	I0304 11:47:29.027781  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:29.046147  405110 main.go:141] libmachine: Using SSH client type: native
	I0304 11:47:29.046353  405110 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil>  [] 0s} 127.0.0.1 32772 <nil> <nil>}
	I0304 11:47:29.046367  405110 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-975865 && echo "addons-975865" | sudo tee /etc/hostname
	I0304 11:47:29.186222  405110 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-975865
	
	I0304 11:47:29.186320  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:29.204008  405110 main.go:141] libmachine: Using SSH client type: native
	I0304 11:47:29.204191  405110 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil>  [] 0s} 127.0.0.1 32772 <nil> <nil>}
	I0304 11:47:29.204209  405110 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-975865' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-975865/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-975865' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0304 11:47:29.317859  405110 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0304 11:47:29.317900  405110 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18284-396872/.minikube CaCertPath:/home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18284-396872/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18284-396872/.minikube}
	I0304 11:47:29.317924  405110 ubuntu.go:177] setting up certificates
	I0304 11:47:29.317937  405110 provision.go:83] configureAuth start
	I0304 11:47:29.318005  405110 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-975865
	I0304 11:47:29.333780  405110 provision.go:138] copyHostCerts
	I0304 11:47:29.333858  405110 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18284-396872/.minikube/key.pem (1679 bytes)
	I0304 11:47:29.333989  405110 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18284-396872/.minikube/ca.pem (1082 bytes)
	I0304 11:47:29.334064  405110 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18284-396872/.minikube/cert.pem (1123 bytes)
	I0304 11:47:29.334140  405110 provision.go:112] generating server cert: /home/jenkins/minikube-integration/18284-396872/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca-key.pem org=jenkins.addons-975865 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube addons-975865]
	I0304 11:47:29.602955  405110 provision.go:172] copyRemoteCerts
	I0304 11:47:29.603015  405110 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0304 11:47:29.603055  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:29.619060  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:29.702061  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0304 11:47:29.722869  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)
	I0304 11:47:29.743224  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0304 11:47:29.763673  405110 provision.go:86] duration metric: configureAuth took 445.718609ms
	I0304 11:47:29.763704  405110 ubuntu.go:193] setting minikube options for container-runtime
	I0304 11:47:29.763893  405110 config.go:182] Loaded profile config "addons-975865": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
	I0304 11:47:29.764001  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:29.779723  405110 main.go:141] libmachine: Using SSH client type: native
	I0304 11:47:29.779897  405110 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil>  [] 0s} 127.0.0.1 32772 <nil> <nil>}
	I0304 11:47:29.779913  405110 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0304 11:47:29.976164  405110 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0304 11:47:29.976197  405110 machine.go:91] provisioned docker machine in 948.490773ms
	I0304 11:47:29.976210  405110 client.go:171] LocalClient.Create took 10.230574681s
	I0304 11:47:29.976226  405110 start.go:167] duration metric: libmachine.API.Create for "addons-975865" took 10.230643781s
	I0304 11:47:29.976236  405110 start.go:300] post-start starting for "addons-975865" (driver="docker")
	I0304 11:47:29.976249  405110 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0304 11:47:29.976370  405110 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0304 11:47:29.976441  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:29.992480  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:30.078920  405110 ssh_runner.go:195] Run: cat /etc/os-release
	I0304 11:47:30.081992  405110 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0304 11:47:30.082022  405110 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0304 11:47:30.082032  405110 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0304 11:47:30.082038  405110 info.go:137] Remote host: Ubuntu 22.04.3 LTS
	I0304 11:47:30.082056  405110 filesync.go:126] Scanning /home/jenkins/minikube-integration/18284-396872/.minikube/addons for local assets ...
	I0304 11:47:30.082148  405110 filesync.go:126] Scanning /home/jenkins/minikube-integration/18284-396872/.minikube/files for local assets ...
	I0304 11:47:30.082176  405110 start.go:303] post-start completed in 105.934632ms
	I0304 11:47:30.082524  405110 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-975865
	I0304 11:47:30.099512  405110 profile.go:148] Saving config to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/config.json ...
	I0304 11:47:30.099743  405110 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0304 11:47:30.099789  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:30.115041  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:30.194622  405110 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0304 11:47:30.198654  405110 start.go:128] duration metric: createHost completed in 10.51440593s
	I0304 11:47:30.198680  405110 start.go:83] releasing machines lock for "addons-975865", held for 10.514568384s
	I0304 11:47:30.198750  405110 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-975865
	I0304 11:47:30.214400  405110 ssh_runner.go:195] Run: cat /version.json
	I0304 11:47:30.214418  405110 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0304 11:47:30.214454  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:30.214474  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:30.231675  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:30.232848  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:30.380067  405110 ssh_runner.go:195] Run: systemctl --version
	I0304 11:47:30.383975  405110 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0304 11:47:30.519789  405110 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0304 11:47:30.523956  405110 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0304 11:47:30.541013  405110 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0304 11:47:30.541095  405110 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0304 11:47:30.565879  405110 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0304 11:47:30.565900  405110 start.go:475] detecting cgroup driver to use...
	I0304 11:47:30.565928  405110 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0304 11:47:30.565965  405110 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0304 11:47:30.578810  405110 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0304 11:47:30.588322  405110 docker.go:217] disabling cri-docker service (if available) ...
	I0304 11:47:30.588366  405110 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0304 11:47:30.600375  405110 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0304 11:47:30.612196  405110 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0304 11:47:30.682747  405110 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0304 11:47:30.754382  405110 docker.go:233] disabling docker service ...
	I0304 11:47:30.754441  405110 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0304 11:47:30.772169  405110 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0304 11:47:30.781654  405110 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0304 11:47:30.854489  405110 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0304 11:47:30.932383  405110 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0304 11:47:30.941914  405110 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0304 11:47:30.955467  405110 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
	I0304 11:47:30.955517  405110 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0304 11:47:30.963851  405110 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
	I0304 11:47:30.963899  405110 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0304 11:47:30.971987  405110 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0304 11:47:30.980115  405110 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0304 11:47:30.988025  405110 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0304 11:47:30.995412  405110 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0304 11:47:31.002322  405110 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0304 11:47:31.009087  405110 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0304 11:47:31.078241  405110 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0304 11:47:31.197604  405110 start.go:522] Will wait 60s for socket path /var/run/crio/crio.sock
	I0304 11:47:31.197690  405110 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0304 11:47:31.201014  405110 start.go:543] Will wait 60s for crictl version
	I0304 11:47:31.201057  405110 ssh_runner.go:195] Run: which crictl
	I0304 11:47:31.204108  405110 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0304 11:47:31.236308  405110 start.go:559] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0304 11:47:31.236384  405110 ssh_runner.go:195] Run: crio --version
	I0304 11:47:31.269672  405110 ssh_runner.go:195] Run: crio --version
	I0304 11:47:31.304683  405110 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.6 ...
	I0304 11:47:31.306027  405110 cli_runner.go:164] Run: docker network inspect addons-975865 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0304 11:47:31.321137  405110 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0304 11:47:31.324468  405110 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0304 11:47:31.334168  405110 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
	I0304 11:47:31.334228  405110 ssh_runner.go:195] Run: sudo crictl images --output json
	I0304 11:47:31.391168  405110 crio.go:496] all images are preloaded for cri-o runtime.
	I0304 11:47:31.391191  405110 crio.go:415] Images already preloaded, skipping extraction
	I0304 11:47:31.391234  405110 ssh_runner.go:195] Run: sudo crictl images --output json
	I0304 11:47:31.421901  405110 crio.go:496] all images are preloaded for cri-o runtime.
	I0304 11:47:31.421923  405110 cache_images.go:84] Images are preloaded, skipping loading
	I0304 11:47:31.422010  405110 ssh_runner.go:195] Run: crio config
	I0304 11:47:31.463157  405110 cni.go:84] Creating CNI manager for ""
	I0304 11:47:31.463185  405110 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0304 11:47:31.463208  405110 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0304 11:47:31.463234  405110 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-975865 NodeName:addons-975865 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuberne
tes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0304 11:47:31.463410  405110 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "addons-975865"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.28.4
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0304 11:47:31.463527  405110 kubeadm.go:976] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=addons-975865 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.28.4 ClusterName:addons-975865 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0304 11:47:31.463594  405110 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
	I0304 11:47:31.471473  405110 binaries.go:44] Found k8s binaries, skipping transfer
	I0304 11:47:31.471538  405110 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0304 11:47:31.479093  405110 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (423 bytes)
	I0304 11:47:31.494299  405110 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0304 11:47:31.509807  405110 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2094 bytes)
	I0304 11:47:31.524998  405110 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0304 11:47:31.527811  405110 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0304 11:47:31.536844  405110 certs.go:56] Setting up /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865 for IP: 192.168.49.2
	I0304 11:47:31.536872  405110 certs.go:190] acquiring lock for shared ca certs: {Name:mk5c6efb4e5160f77d4a7ed847715b71b13576b2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.536991  405110 certs.go:204] generating minikubeCA CA: /home/jenkins/minikube-integration/18284-396872/.minikube/ca.key
	I0304 11:47:31.597291  405110 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt ...
	I0304 11:47:31.597321  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt: {Name:mk527fa21905de3da04822f225503376de5b070d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.597510  405110 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18284-396872/.minikube/ca.key ...
	I0304 11:47:31.597528  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/ca.key: {Name:mk5fbb52f995b3dbbf13bfa4c1fa9a85f66dcb7f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.597729  405110 certs.go:204] generating proxyClientCA CA: /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.key
	I0304 11:47:31.658282  405110 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.crt ...
	I0304 11:47:31.658304  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.crt: {Name:mk8e4209d54d9fb7d1f32971d3ce2d86f3ddce91 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.658455  405110 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.key ...
	I0304 11:47:31.658469  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.key: {Name:mkf1cf515da76cd9f08b577f56a6ca1bd1e26bf3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.658599  405110 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.key
	I0304 11:47:31.658614  405110 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt with IP's: []
	I0304 11:47:31.760787  405110 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt ...
	I0304 11:47:31.760823  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: {Name:mk65d9066c469fe1cb3e07d25448787a1c5eca6c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.761011  405110 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.key ...
	I0304 11:47:31.761026  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.key: {Name:mk84a514d2f88045a2a84ab0ed23693ef3afcc9e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.761121  405110 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.key.dd3b5fb2
	I0304 11:47:31.761155  405110 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0304 11:47:31.822978  405110 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.crt.dd3b5fb2 ...
	I0304 11:47:31.823015  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.crt.dd3b5fb2: {Name:mk331bbfc5b6c9bb8e7ea6172cc5f1f858dba99b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.823199  405110 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.key.dd3b5fb2 ...
	I0304 11:47:31.823218  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.key.dd3b5fb2: {Name:mk928d79f10799cd15090509253ef8044bf21d4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.823317  405110 certs.go:337] copying /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.crt
	I0304 11:47:31.823422  405110 certs.go:341] copying /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.key
	I0304 11:47:31.823490  405110 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/proxy-client.key
	I0304 11:47:31.823515  405110 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/proxy-client.crt with IP's: []
	I0304 11:47:31.915630  405110 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/proxy-client.crt ...
	I0304 11:47:31.915666  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/proxy-client.crt: {Name:mk7be1ebdf5ddc3631b099ebd985181c7ebf4caa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.915859  405110 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/proxy-client.key ...
	I0304 11:47:31.915881  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/proxy-client.key: {Name:mkc64f62a316b99be4af0764f2f356e184d1e530 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.916080  405110 certs.go:437] found cert: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca-key.pem (1679 bytes)
	I0304 11:47:31.916138  405110 certs.go:437] found cert: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem (1082 bytes)
	I0304 11:47:31.916179  405110 certs.go:437] found cert: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/home/jenkins/minikube-integration/18284-396872/.minikube/certs/cert.pem (1123 bytes)
	I0304 11:47:31.916214  405110 certs.go:437] found cert: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/home/jenkins/minikube-integration/18284-396872/.minikube/certs/key.pem (1679 bytes)
	I0304 11:47:31.916879  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0304 11:47:31.938658  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0304 11:47:31.959370  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0304 11:47:31.980046  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0304 11:47:32.000742  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0304 11:47:32.021193  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0304 11:47:32.041572  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0304 11:47:32.062065  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0304 11:47:32.081921  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0304 11:47:32.101972  405110 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0304 11:47:32.116887  405110 ssh_runner.go:195] Run: openssl version
	I0304 11:47:32.121702  405110 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0304 11:47:32.129881  405110 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0304 11:47:32.132877  405110 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Mar  4 11:47 /usr/share/ca-certificates/minikubeCA.pem
	I0304 11:47:32.132926  405110 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0304 11:47:32.138960  405110 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0304 11:47:32.146910  405110 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0304 11:47:32.149810  405110 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I0304 11:47:32.149877  405110 kubeadm.go:404] StartCluster: {Name:addons-975865 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:addons-975865 Namespace:default APIServerName:minikubeCA APIServerNames:[] APISe
rverIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:f
alse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 11:47:32.149976  405110 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0304 11:47:32.150029  405110 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0304 11:47:32.182720  405110 cri.go:89] found id: ""
	I0304 11:47:32.182798  405110 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0304 11:47:32.190727  405110 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0304 11:47:32.198830  405110 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I0304 11:47:32.198889  405110 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0304 11:47:32.206183  405110 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0304 11:47:32.206227  405110 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0304 11:47:32.284013  405110 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1052-gcp\n", err: exit status 1
	I0304 11:47:32.345992  405110 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0304 11:47:41.966037  405110 kubeadm.go:322] [init] Using Kubernetes version: v1.28.4
	I0304 11:47:41.966159  405110 kubeadm.go:322] [preflight] Running pre-flight checks
	I0304 11:47:41.966310  405110 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I0304 11:47:41.966408  405110 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1052-gcp
	I0304 11:47:41.966443  405110 kubeadm.go:322] OS: Linux
	I0304 11:47:41.966502  405110 kubeadm.go:322] CGROUPS_CPU: enabled
	I0304 11:47:41.966557  405110 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I0304 11:47:41.966602  405110 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I0304 11:47:41.966642  405110 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I0304 11:47:41.966717  405110 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I0304 11:47:41.966801  405110 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I0304 11:47:41.966854  405110 kubeadm.go:322] CGROUPS_PIDS: enabled
	I0304 11:47:41.966923  405110 kubeadm.go:322] CGROUPS_HUGETLB: enabled
	I0304 11:47:41.966980  405110 kubeadm.go:322] CGROUPS_BLKIO: enabled
	I0304 11:47:41.967045  405110 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0304 11:47:41.967123  405110 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0304 11:47:41.967201  405110 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0304 11:47:41.967271  405110 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0304 11:47:41.968950  405110 out.go:204]   - Generating certificates and keys ...
	I0304 11:47:41.969036  405110 kubeadm.go:322] [certs] Using existing ca certificate authority
	I0304 11:47:41.969111  405110 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I0304 11:47:41.969174  405110 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0304 11:47:41.969233  405110 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I0304 11:47:41.969301  405110 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I0304 11:47:41.969345  405110 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I0304 11:47:41.969390  405110 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I0304 11:47:41.969496  405110 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-975865 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0304 11:47:41.969544  405110 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I0304 11:47:41.969639  405110 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-975865 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0304 11:47:41.969695  405110 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0304 11:47:41.969752  405110 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I0304 11:47:41.969788  405110 kubeadm.go:322] [certs] Generating "sa" key and public key
	I0304 11:47:41.969833  405110 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0304 11:47:41.969876  405110 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0304 11:47:41.969937  405110 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0304 11:47:41.970014  405110 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0304 11:47:41.970081  405110 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0304 11:47:41.970181  405110 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0304 11:47:41.970280  405110 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0304 11:47:41.971813  405110 out.go:204]   - Booting up control plane ...
	I0304 11:47:41.971887  405110 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0304 11:47:41.971954  405110 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0304 11:47:41.972011  405110 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0304 11:47:41.972095  405110 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0304 11:47:41.972187  405110 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0304 11:47:41.972232  405110 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I0304 11:47:41.972397  405110 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0304 11:47:41.972502  405110 kubeadm.go:322] [apiclient] All control plane components are healthy after 5.502163 seconds
	I0304 11:47:41.972651  405110 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0304 11:47:41.972824  405110 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0304 11:47:41.972914  405110 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I0304 11:47:41.973179  405110 kubeadm.go:322] [mark-control-plane] Marking the node addons-975865 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0304 11:47:41.973237  405110 kubeadm.go:322] [bootstrap-token] Using token: 9z6uuf.lw2hqqhls9qyf1u8
	I0304 11:47:41.974622  405110 out.go:204]   - Configuring RBAC rules ...
	I0304 11:47:41.974710  405110 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0304 11:47:41.974780  405110 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0304 11:47:41.974930  405110 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0304 11:47:41.975098  405110 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0304 11:47:41.975237  405110 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0304 11:47:41.975334  405110 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0304 11:47:41.975433  405110 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0304 11:47:41.975486  405110 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I0304 11:47:41.975525  405110 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I0304 11:47:41.975531  405110 kubeadm.go:322] 
	I0304 11:47:41.975582  405110 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I0304 11:47:41.975588  405110 kubeadm.go:322] 
	I0304 11:47:41.975655  405110 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I0304 11:47:41.975661  405110 kubeadm.go:322] 
	I0304 11:47:41.975681  405110 kubeadm.go:322]   mkdir -p $HOME/.kube
	I0304 11:47:41.975730  405110 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0304 11:47:41.975772  405110 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0304 11:47:41.975778  405110 kubeadm.go:322] 
	I0304 11:47:41.975826  405110 kubeadm.go:322] Alternatively, if you are the root user, you can run:
	I0304 11:47:41.975832  405110 kubeadm.go:322] 
	I0304 11:47:41.975870  405110 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0304 11:47:41.975876  405110 kubeadm.go:322] 
	I0304 11:47:41.975918  405110 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I0304 11:47:41.975979  405110 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0304 11:47:41.976036  405110 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0304 11:47:41.976042  405110 kubeadm.go:322] 
	I0304 11:47:41.976109  405110 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I0304 11:47:41.976175  405110 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I0304 11:47:41.976181  405110 kubeadm.go:322] 
	I0304 11:47:41.976281  405110 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token 9z6uuf.lw2hqqhls9qyf1u8 \
	I0304 11:47:41.976424  405110 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:a5b052ccc96434307975887cf00b655123d510584cfc7a3a600211bdeb8da90e \
	I0304 11:47:41.976444  405110 kubeadm.go:322] 	--control-plane 
	I0304 11:47:41.976450  405110 kubeadm.go:322] 
	I0304 11:47:41.976539  405110 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I0304 11:47:41.976551  405110 kubeadm.go:322] 
	I0304 11:47:41.976674  405110 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 9z6uuf.lw2hqqhls9qyf1u8 \
	I0304 11:47:41.976838  405110 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:a5b052ccc96434307975887cf00b655123d510584cfc7a3a600211bdeb8da90e 
	I0304 11:47:41.976854  405110 cni.go:84] Creating CNI manager for ""
	I0304 11:47:41.976863  405110 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0304 11:47:41.978365  405110 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0304 11:47:41.979627  405110 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0304 11:47:41.983316  405110 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.28.4/kubectl ...
	I0304 11:47:41.983332  405110 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
	I0304 11:47:41.999731  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0304 11:47:42.613252  405110 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0304 11:47:42.613333  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:42.613406  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl label nodes minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=ab57ba9f65fd4cb3ac8815e4f9baeeca5604e645 minikube.k8s.io/name=addons-975865 minikube.k8s.io/updated_at=2024_03_04T11_47_42_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:42.706801  405110 ops.go:34] apiserver oom_adj: -16
	I0304 11:47:42.706922  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:43.207481  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:43.707234  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:44.207413  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:44.707078  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:45.207254  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:45.707689  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:46.207992  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:46.706974  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:47.207968  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:47.707011  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:48.207106  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:48.707212  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:49.207344  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:49.707634  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:50.207937  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:50.707407  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:51.207356  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:51.707359  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:52.207880  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:52.707241  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:53.207309  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:53.707385  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:54.207974  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:54.707244  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:55.206966  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:55.272533  405110 kubeadm.go:1088] duration metric: took 12.659252926s to wait for elevateKubeSystemPrivileges.
	I0304 11:47:55.272576  405110 kubeadm.go:406] StartCluster complete in 23.122706356s
	I0304 11:47:55.272600  405110 settings.go:142] acquiring lock: {Name:mkdbf9b8466495a7e4be006d870bd7dffc473c0c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:55.272737  405110 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/18284-396872/kubeconfig
	I0304 11:47:55.273282  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/kubeconfig: {Name:mkcbf3bf1380cc7c2802e86e24097181dc1a959a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:55.273534  405110 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0304 11:47:55.273659  405110 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:true inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volumesnapshots:true yakd:true]
	I0304 11:47:55.273755  405110 config.go:182] Loaded profile config "addons-975865": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
	I0304 11:47:55.273798  405110 addons.go:69] Setting ingress-dns=true in profile "addons-975865"
	I0304 11:47:55.273810  405110 addons.go:69] Setting inspektor-gadget=true in profile "addons-975865"
	I0304 11:47:55.273816  405110 addons.go:234] Setting addon ingress-dns=true in "addons-975865"
	I0304 11:47:55.273822  405110 addons.go:234] Setting addon inspektor-gadget=true in "addons-975865"
	I0304 11:47:55.273876  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.273881  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.274014  405110 addons.go:69] Setting metrics-server=true in profile "addons-975865"
	I0304 11:47:55.274027  405110 addons.go:234] Setting addon metrics-server=true in "addons-975865"
	I0304 11:47:55.274055  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.274241  405110 addons.go:69] Setting gcp-auth=true in profile "addons-975865"
	I0304 11:47:55.274281  405110 mustload.go:65] Loading cluster: addons-975865
	I0304 11:47:55.274288  405110 addons.go:69] Setting ingress=true in profile "addons-975865"
	I0304 11:47:55.274318  405110 addons.go:234] Setting addon ingress=true in "addons-975865"
	I0304 11:47:55.274374  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.274442  405110 config.go:182] Loaded profile config "addons-975865": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
	I0304 11:47:55.274453  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.274466  405110 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-975865"
	I0304 11:47:55.274480  405110 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-975865"
	I0304 11:47:55.274493  405110 addons.go:69] Setting helm-tiller=true in profile "addons-975865"
	I0304 11:47:55.274512  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.274514  405110 addons.go:234] Setting addon helm-tiller=true in "addons-975865"
	I0304 11:47:55.274558  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.274683  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.274828  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.273796  405110 addons.go:69] Setting yakd=true in profile "addons-975865"
	I0304 11:47:55.274897  405110 addons.go:234] Setting addon yakd=true in "addons-975865"
	I0304 11:47:55.274906  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.274937  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.274961  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.274980  405110 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-975865"
	I0304 11:47:55.275009  405110 addons.go:69] Setting storage-provisioner=true in profile "addons-975865"
	I0304 11:47:55.275037  405110 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-975865"
	I0304 11:47:55.275065  405110 addons.go:234] Setting addon storage-provisioner=true in "addons-975865"
	I0304 11:47:55.275075  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.275289  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.275795  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.276059  405110 addons.go:69] Setting default-storageclass=true in profile "addons-975865"
	I0304 11:47:55.276085  405110 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-975865"
	I0304 11:47:55.276393  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.276492  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.276576  405110 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-975865"
	I0304 11:47:55.276597  405110 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-975865"
	I0304 11:47:55.276867  405110 addons.go:69] Setting cloud-spanner=true in profile "addons-975865"
	I0304 11:47:55.276980  405110 addons.go:234] Setting addon cloud-spanner=true in "addons-975865"
	I0304 11:47:55.277144  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.277262  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.277713  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.278160  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.276856  405110 addons.go:69] Setting registry=true in profile "addons-975865"
	I0304 11:47:55.278789  405110 addons.go:234] Setting addon registry=true in "addons-975865"
	I0304 11:47:55.278863  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.279420  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.274454  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.280086  405110 addons.go:69] Setting volumesnapshots=true in profile "addons-975865"
	I0304 11:47:55.280109  405110 addons.go:234] Setting addon volumesnapshots=true in "addons-975865"
	I0304 11:47:55.280154  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.276868  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.304651  405110 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.10.0
	I0304 11:47:55.306081  405110 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0
	I0304 11:47:55.307578  405110 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0
	I0304 11:47:55.306801  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.309616  405110 addons.go:426] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I0304 11:47:55.309672  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
	I0304 11:47:55.309733  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.321039  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.326382  405110 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0304 11:47:55.329563  405110 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0304 11:47:55.329586  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0304 11:47:55.329655  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.333270  405110 out.go:177]   - Using image ghcr.io/helm/tiller:v2.17.0
	I0304 11:47:55.335547  405110 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-dp.yaml
	I0304 11:47:55.335569  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-dp.yaml (2422 bytes)
	I0304 11:47:55.335631  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.341208  405110 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.25.1
	I0304 11:47:55.344584  405110 addons.go:426] installing /etc/kubernetes/addons/ig-namespace.yaml
	I0304 11:47:55.344611  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
	I0304 11:47:55.344669  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.344593  405110 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2
	I0304 11:47:55.346693  405110 addons.go:426] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0304 11:47:55.344523  405110 addons.go:234] Setting addon default-storageclass=true in "addons-975865"
	I0304 11:47:55.346831  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.347783  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
	I0304 11:47:55.347867  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.349458  405110 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.14
	I0304 11:47:55.351360  405110 addons.go:426] installing /etc/kubernetes/addons/deployment.yaml
	I0304 11:47:55.351380  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
	I0304 11:47:55.351432  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.350402  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.362211  405110 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.14.4
	I0304 11:47:55.361028  405110 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-975865"
	I0304 11:47:55.365379  405110 addons.go:426] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0304 11:47:55.365582  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
	I0304 11:47:55.365651  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.365862  405110 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I0304 11:47:55.365955  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.367390  405110 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I0304 11:47:55.367949  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.371218  405110 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I0304 11:47:55.371300  405110 out.go:177]   - Using image docker.io/registry:2.8.3
	I0304 11:47:55.377300  405110 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.0
	I0304 11:47:55.375702  405110 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I0304 11:47:55.378700  405110 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0304 11:47:55.380283  405110 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.5
	I0304 11:47:55.380302  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0304 11:47:55.382054  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.382286  405110 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I0304 11:47:55.385428  405110 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	I0304 11:47:55.387459  405110 addons.go:426] installing /etc/kubernetes/addons/registry-rc.yaml
	I0304 11:47:55.387477  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)
	I0304 11:47:55.387536  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.387244  405110 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I0304 11:47:55.389322  405110 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I0304 11:47:55.391035  405110 addons.go:426] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I0304 11:47:55.391061  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I0304 11:47:55.391121  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.397320  405110 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	I0304 11:47:55.407110  405110 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I0304 11:47:55.407140  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I0304 11:47:55.407355  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.405496  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.420247  405110 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
	I0304 11:47:55.420275  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0304 11:47:55.420334  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.427170  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.427410  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.430009  405110 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22
	I0304 11:47:55.428286  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.431947  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.436090  405110 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.4
	I0304 11:47:55.437756  405110 out.go:177]   - Using image docker.io/busybox:stable
	I0304 11:47:55.439375  405110 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0304 11:47:55.439395  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
	I0304 11:47:55.437575  405110 addons.go:426] installing /etc/kubernetes/addons/yakd-ns.yaml
	I0304 11:47:55.439458  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.439458  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
	I0304 11:47:55.439523  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.454632  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.455209  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.464417  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.470329  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.470580  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.475842  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.476459  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.479181  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.491511  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	W0304 11:47:55.504806  405110 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0304 11:47:55.504850  405110 retry.go:31] will retry after 287.041267ms: ssh: handshake failed: EOF
	I0304 11:47:55.522306  405110 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0304 11:47:55.725420  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I0304 11:47:55.810498  405110 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-rbac.yaml
	I0304 11:47:55.810537  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-rbac.yaml (1188 bytes)
	I0304 11:47:55.812209  405110 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-975865" context rescaled to 1 replicas
	I0304 11:47:55.812261  405110 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0304 11:47:55.814630  405110 out.go:177] * Verifying Kubernetes components...
	I0304 11:47:55.816175  405110 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0304 11:47:55.820838  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0304 11:47:55.925351  405110 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-svc.yaml
	I0304 11:47:55.925440  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-svc.yaml (951 bytes)
	I0304 11:47:56.017365  405110 addons.go:426] installing /etc/kubernetes/addons/yakd-sa.yaml
	I0304 11:47:56.017397  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
	I0304 11:47:56.019889  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0304 11:47:56.026528  405110 addons.go:426] installing /etc/kubernetes/addons/registry-svc.yaml
	I0304 11:47:56.026573  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I0304 11:47:56.105226  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I0304 11:47:56.111104  405110 addons.go:426] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I0304 11:47:56.111135  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I0304 11:47:56.117256  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0304 11:47:56.119611  405110 addons.go:426] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
	I0304 11:47:56.119639  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
	I0304 11:47:56.127848  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0304 11:47:56.203310  405110 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I0304 11:47:56.203349  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I0304 11:47:56.204375  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml
	I0304 11:47:56.210718  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0304 11:47:56.314431  405110 addons.go:426] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I0304 11:47:56.314465  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I0304 11:47:56.403543  405110 addons.go:426] installing /etc/kubernetes/addons/registry-proxy.yaml
	I0304 11:47:56.403637  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I0304 11:47:56.404101  405110 addons.go:426] installing /etc/kubernetes/addons/yakd-crb.yaml
	I0304 11:47:56.404170  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
	I0304 11:47:56.415492  405110 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I0304 11:47:56.415565  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I0304 11:47:56.608965  405110 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0304 11:47:56.609058  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I0304 11:47:56.629352  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I0304 11:47:56.703926  405110 addons.go:426] installing /etc/kubernetes/addons/yakd-svc.yaml
	I0304 11:47:56.703956  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
	I0304 11:47:56.703926  405110 addons.go:426] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I0304 11:47:56.704033  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I0304 11:47:56.704928  405110 addons.go:426] installing /etc/kubernetes/addons/ig-role.yaml
	I0304 11:47:56.704995  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
	I0304 11:47:56.812511  405110 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I0304 11:47:56.812538  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I0304 11:47:57.206715  405110 addons.go:426] installing /etc/kubernetes/addons/yakd-dp.yaml
	I0304 11:47:57.206739  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
	I0304 11:47:57.207641  405110 addons.go:426] installing /etc/kubernetes/addons/ig-rolebinding.yaml
	I0304 11:47:57.207663  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
	I0304 11:47:57.222874  405110 addons.go:426] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I0304 11:47:57.222907  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I0304 11:47:57.223342  405110 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0304 11:47:57.223367  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0304 11:47:57.324883  405110 addons.go:426] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I0304 11:47:57.324914  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I0304 11:47:57.513557  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
	I0304 11:47:57.514712  405110 addons.go:426] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0304 11:47:57.514745  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I0304 11:47:57.516860  405110 addons.go:426] installing /etc/kubernetes/addons/ig-clusterrole.yaml
	I0304 11:47:57.516879  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
	I0304 11:47:57.524118  405110 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0304 11:47:57.524199  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0304 11:47:57.607452  405110 addons.go:426] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I0304 11:47:57.607488  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I0304 11:47:58.113675  405110 addons.go:426] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
	I0304 11:47:58.113753  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
	I0304 11:47:58.205094  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0304 11:47:58.304896  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0304 11:47:58.403572  405110 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I0304 11:47:58.403606  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I0304 11:47:58.421447  405110 addons.go:426] installing /etc/kubernetes/addons/ig-crd.yaml
	I0304 11:47:58.421489  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
	I0304 11:47:58.511690  405110 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.989336999s)
	I0304 11:47:58.511727  405110 start.go:929] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0304 11:47:58.803084  405110 addons.go:426] installing /etc/kubernetes/addons/ig-daemonset.yaml
	I0304 11:47:58.803201  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
	I0304 11:47:59.124670  405110 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I0304 11:47:59.124700  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I0304 11:47:59.402812  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
	I0304 11:47:59.718742  405110 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I0304 11:47:59.718778  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I0304 11:48:00.008104  405110 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I0304 11:48:00.008133  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I0304 11:48:00.015923  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (4.290456592s)
	I0304 11:48:00.016034  405110 ssh_runner.go:235] Completed: sudo systemctl is-active --quiet service kubelet: (4.199830442s)
	I0304 11:48:00.017172  405110 node_ready.go:35] waiting up to 6m0s for node "addons-975865" to be "Ready" ...
	I0304 11:48:00.317374  405110 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0304 11:48:00.317414  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I0304 11:48:00.619185  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0304 11:48:00.804153  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (4.983272137s)
	I0304 11:48:01.820126  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (5.80018686s)
	I0304 11:48:02.127201  405110 node_ready.go:58] node "addons-975865" has status "Ready":"False"
	I0304 11:48:02.212347  405110 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I0304 11:48:02.212508  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:48:02.236308  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:48:02.629096  405110 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I0304 11:48:02.723856  405110 addons.go:234] Setting addon gcp-auth=true in "addons-975865"
	I0304 11:48:02.724004  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:48:02.724666  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:48:02.743706  405110 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I0304 11:48:02.743771  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:48:02.759810  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:48:03.508513  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (7.403242839s)
	I0304 11:48:03.508546  405110 addons.go:470] Verifying addon ingress=true in "addons-975865"
	I0304 11:48:03.510212  405110 out.go:177] * Verifying ingress addon...
	I0304 11:48:03.508610  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (7.391310849s)
	I0304 11:48:03.508689  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.380812558s)
	I0304 11:48:03.508751  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml: (7.304340821s)
	I0304 11:48:03.508790  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (7.298038509s)
	I0304 11:48:03.508829  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (6.879445016s)
	I0304 11:48:03.508904  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (5.995308057s)
	I0304 11:48:03.509017  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (5.303829168s)
	I0304 11:48:03.509069  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (5.204144338s)
	I0304 11:48:03.509144  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (4.106203977s)
	I0304 11:48:03.511812  405110 addons.go:470] Verifying addon registry=true in "addons-975865"
	W0304 11:48:03.511866  405110 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0304 11:48:03.511882  405110 addons.go:470] Verifying addon metrics-server=true in "addons-975865"
	I0304 11:48:03.513414  405110 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
	
		minikube -p addons-975865 service yakd-dashboard -n yakd-dashboard
	
	I0304 11:48:03.511902  405110 retry.go:31] will retry after 341.058837ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0304 11:48:03.512590  405110 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	I0304 11:48:03.514872  405110 out.go:177] * Verifying registry addon...
	I0304 11:48:03.517997  405110 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I0304 11:48:03.522021  405110 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=registry
	I0304 11:48:03.522042  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:03.522400  405110 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I0304 11:48:03.522416  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:03.855745  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0304 11:48:04.024480  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:04.024856  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:04.232752  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (3.613447156s)
	I0304 11:48:04.232793  405110 addons.go:470] Verifying addon csi-hostpath-driver=true in "addons-975865"
	I0304 11:48:04.235002  405110 out.go:177] * Verifying csi-hostpath-driver addon...
	I0304 11:48:04.232998  405110 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (1.489263585s)
	I0304 11:48:04.304448  405110 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0
	I0304 11:48:04.306137  405110 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.1
	I0304 11:48:04.307029  405110 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I0304 11:48:04.307660  405110 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I0304 11:48:04.307847  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I0304 11:48:04.313235  405110 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0304 11:48:04.313307  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:04.503133  405110 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I0304 11:48:04.503244  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I0304 11:48:04.609687  405110 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0304 11:48:04.609779  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
	I0304 11:48:04.613770  405110 node_ready.go:49] node "addons-975865" has status "Ready":"True"
	I0304 11:48:04.613850  405110 node_ready.go:38] duration metric: took 4.596651625s waiting for node "addons-975865" to be "Ready" ...
	I0304 11:48:04.613879  405110 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0304 11:48:04.709040  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:04.710935  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:04.730637  405110 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-nhbdq" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:04.816240  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0304 11:48:04.917170  405110 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0304 11:48:04.917220  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:05.105249  405110 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I0304 11:48:05.105288  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:05.105338  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:05.318699  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:05.525835  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:05.526087  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:05.814289  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:06.104964  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:06.106280  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:06.413756  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:06.520882  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:06.605595  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:06.811900  405110 pod_ready.go:102] pod "coredns-5dd5756b68-nhbdq" in "kube-system" namespace has status "Ready":"False"
	I0304 11:48:06.819792  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:07.022941  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:07.026020  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:07.317068  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:07.527633  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:07.618930  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:07.814075  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:08.020478  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:08.030236  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:08.216232  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (4.360410356s)
	I0304 11:48:08.315149  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:08.427413  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (3.61105968s)
	I0304 11:48:08.429686  405110 addons.go:470] Verifying addon gcp-auth=true in "addons-975865"
	I0304 11:48:08.431198  405110 out.go:177] * Verifying gcp-auth addon...
	I0304 11:48:08.433785  405110 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I0304 11:48:08.505192  405110 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I0304 11:48:08.505216  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:08.523326  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:08.526097  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:08.813598  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:08.937331  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:09.019608  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:09.023062  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:09.236861  405110 pod_ready.go:92] pod "coredns-5dd5756b68-nhbdq" in "kube-system" namespace has status "Ready":"True"
	I0304 11:48:09.236884  405110 pod_ready.go:81] duration metric: took 4.50621803s waiting for pod "coredns-5dd5756b68-nhbdq" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.236903  405110 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-975865" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.241503  405110 pod_ready.go:92] pod "etcd-addons-975865" in "kube-system" namespace has status "Ready":"True"
	I0304 11:48:09.241523  405110 pod_ready.go:81] duration metric: took 4.613448ms waiting for pod "etcd-addons-975865" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.241533  405110 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-975865" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.245932  405110 pod_ready.go:92] pod "kube-apiserver-addons-975865" in "kube-system" namespace has status "Ready":"True"
	I0304 11:48:09.245959  405110 pod_ready.go:81] duration metric: took 4.4156ms waiting for pod "kube-apiserver-addons-975865" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.245971  405110 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-975865" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.250790  405110 pod_ready.go:92] pod "kube-controller-manager-addons-975865" in "kube-system" namespace has status "Ready":"True"
	I0304 11:48:09.250808  405110 pod_ready.go:81] duration metric: took 4.829598ms waiting for pod "kube-controller-manager-addons-975865" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.250819  405110 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-t5cbf" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.255576  405110 pod_ready.go:92] pod "kube-proxy-t5cbf" in "kube-system" namespace has status "Ready":"True"
	I0304 11:48:09.255597  405110 pod_ready.go:81] duration metric: took 4.769898ms waiting for pod "kube-proxy-t5cbf" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.255607  405110 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-975865" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.313693  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:09.437102  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:09.519493  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:09.522948  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:09.635755  405110 pod_ready.go:92] pod "kube-scheduler-addons-975865" in "kube-system" namespace has status "Ready":"True"
	I0304 11:48:09.635794  405110 pod_ready.go:81] duration metric: took 380.177675ms waiting for pod "kube-scheduler-addons-975865" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.635809  405110 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.813829  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:09.938167  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:10.020052  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:10.023060  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:10.313055  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:10.436946  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:10.519273  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:10.522455  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:10.812327  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:10.937372  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:11.018924  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:11.021766  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:11.315026  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:11.438154  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:11.519873  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:11.523891  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:11.642864  405110 pod_ready.go:102] pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace has status "Ready":"False"
	I0304 11:48:11.814254  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:11.937904  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:12.020179  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:12.023059  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:12.314878  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:12.438443  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:12.519165  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:12.523935  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:12.813356  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:12.937479  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:13.019074  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:13.021969  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:13.314082  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:13.437426  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:13.519387  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:13.522630  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:13.813731  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:13.937978  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:14.019919  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:14.022825  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:14.141925  405110 pod_ready.go:102] pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace has status "Ready":"False"
	I0304 11:48:14.313684  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:14.437717  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:14.519214  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:14.522620  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:14.813452  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:14.937958  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:15.020152  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:15.025376  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:15.313692  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:15.506062  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:15.520156  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:15.523341  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:15.814401  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:15.938553  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:16.019766  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:16.023069  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:16.142308  405110 pod_ready.go:102] pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace has status "Ready":"False"
	I0304 11:48:16.314484  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:16.437925  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:16.520059  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:16.523466  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:16.813857  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:16.937544  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:17.020235  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:17.022494  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:17.312780  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:17.437186  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:17.519156  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:17.522558  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:17.814888  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:17.938211  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:18.020036  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:18.023252  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:18.313786  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:18.437457  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:18.519132  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:18.604265  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:18.647386  405110 pod_ready.go:102] pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace has status "Ready":"False"
	I0304 11:48:18.813464  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:18.937588  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:19.019361  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:19.021876  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:19.313809  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:19.438553  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:19.519730  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:19.523350  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:19.813142  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:19.937743  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:20.019676  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:20.022571  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:20.312809  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:20.437088  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:20.519544  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:20.522149  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:20.813947  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:21.005387  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:21.020541  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:21.025143  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:21.209279  405110 pod_ready.go:102] pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace has status "Ready":"False"
	I0304 11:48:21.323768  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:21.438221  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:21.522699  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:21.526741  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:21.814013  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:22.008636  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:22.019976  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:22.023244  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:22.314267  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:22.437434  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:22.519358  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:22.524044  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:22.816792  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:22.938482  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:23.019711  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:23.023012  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:23.313242  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:23.437503  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:23.519372  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:23.522178  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:23.642158  405110 pod_ready.go:102] pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace has status "Ready":"False"
	I0304 11:48:23.814388  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:23.937552  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:24.019797  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:24.022271  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:24.314512  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:24.437503  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:24.519656  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:24.522452  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:24.813383  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:24.937562  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:25.019618  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:25.022091  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:25.314060  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:25.504674  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:25.522682  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:25.526622  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:25.642716  405110 pod_ready.go:102] pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace has status "Ready":"False"
	I0304 11:48:25.814404  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:25.938355  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:26.018873  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:26.023244  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:26.313637  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:26.437772  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:26.519627  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:26.523688  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:26.813264  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:26.938300  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:27.019996  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:27.022950  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:27.314344  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:27.437523  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:27.519819  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:27.522488  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:27.642766  405110 pod_ready.go:102] pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace has status "Ready":"False"
	I0304 11:48:27.814590  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:27.937293  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:28.018545  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:28.022302  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:28.312738  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:28.436848  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:28.519924  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:28.523700  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:28.709268  405110 pod_ready.go:92] pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace has status "Ready":"True"
	I0304 11:48:28.709349  405110 pod_ready.go:81] duration metric: took 19.073531586s waiting for pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:28.709384  405110 pod_ready.go:38] duration metric: took 24.09543076s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0304 11:48:28.709427  405110 api_server.go:52] waiting for apiserver process to appear ...
	I0304 11:48:28.709504  405110 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0304 11:48:28.724587  405110 api_server.go:72] duration metric: took 32.912275823s to wait for apiserver process to appear ...
	I0304 11:48:28.724621  405110 api_server.go:88] waiting for apiserver healthz status ...
	I0304 11:48:28.724653  405110 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0304 11:48:28.729243  405110 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0304 11:48:28.730519  405110 api_server.go:141] control plane version: v1.28.4
	I0304 11:48:28.730548  405110 api_server.go:131] duration metric: took 5.918615ms to wait for apiserver health ...
	I0304 11:48:28.730560  405110 system_pods.go:43] waiting for kube-system pods to appear ...
	I0304 11:48:28.740660  405110 system_pods.go:59] 19 kube-system pods found
	I0304 11:48:28.740692  405110 system_pods.go:61] "coredns-5dd5756b68-nhbdq" [b09b4830-c38e-427e-9dd1-9754c212be10] Running
	I0304 11:48:28.740701  405110 system_pods.go:61] "csi-hostpath-attacher-0" [7e7f11f4-0b99-4ea3-99d2-a6249ef62a0a] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0304 11:48:28.740710  405110 system_pods.go:61] "csi-hostpath-resizer-0" [eb3b9680-f9a1-4562-b314-2ce09e7af0d3] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0304 11:48:28.740717  405110 system_pods.go:61] "csi-hostpathplugin-2w6kz" [d5584c82-412c-4c84-9350-1969e595731e] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0304 11:48:28.740721  405110 system_pods.go:61] "etcd-addons-975865" [cf48172d-da33-4575-867c-83faec826304] Running
	I0304 11:48:28.740724  405110 system_pods.go:61] "kindnet-tm2pm" [79d918c2-77d7-4651-b44a-0e371f3d551e] Running
	I0304 11:48:28.740728  405110 system_pods.go:61] "kube-apiserver-addons-975865" [9abd61a8-f937-46ce-af14-d169011623b1] Running
	I0304 11:48:28.740731  405110 system_pods.go:61] "kube-controller-manager-addons-975865" [06c59838-f212-4a65-ab8b-a059b58cf341] Running
	I0304 11:48:28.740736  405110 system_pods.go:61] "kube-ingress-dns-minikube" [5e9dec0c-a3a0-4515-9aa6-00d0505cccfc] Running
	I0304 11:48:28.740741  405110 system_pods.go:61] "kube-proxy-t5cbf" [16f8a838-cc14-401b-9589-c35dab3319f0] Running
	I0304 11:48:28.740745  405110 system_pods.go:61] "kube-scheduler-addons-975865" [60d23df3-9dc4-4378-8602-fb53244ee1e9] Running
	I0304 11:48:28.740755  405110 system_pods.go:61] "metrics-server-69cf46c98-b8n47" [cc50fbf1-ba8e-4734-b9e3-0ae2668c0265] Running
	I0304 11:48:28.740761  405110 system_pods.go:61] "nvidia-device-plugin-daemonset-blxlb" [7420b97c-e9cb-4738-b13a-1fc100a3bf50] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
	I0304 11:48:28.740766  405110 system_pods.go:61] "registry-proxy-rvr4d" [b5a1edef-e542-4acc-8e53-db66447354b3] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0304 11:48:28.740774  405110 system_pods.go:61] "registry-zl52r" [eeab5c60-f96a-488e-b668-8316e0664295] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0304 11:48:28.740777  405110 system_pods.go:61] "snapshot-controller-58dbcc7b99-ffxvv" [efa84fb0-21a4-4bed-a8fd-f4574cab3dce] Running
	I0304 11:48:28.740784  405110 system_pods.go:61] "snapshot-controller-58dbcc7b99-rlpjq" [a96ec197-1feb-43ce-a850-fb10b3f9e5e2] Running
	I0304 11:48:28.740788  405110 system_pods.go:61] "storage-provisioner" [29c40fc3-2ff5-46e5-b897-57b1cad1ad0c] Running
	I0304 11:48:28.740793  405110 system_pods.go:61] "tiller-deploy-7b677967b9-rq8jg" [448a96d7-e9e5-4ea5-8c75-5eecbbb2cb1f] Pending / Ready:ContainersNotReady (containers with unready status: [tiller]) / ContainersReady:ContainersNotReady (containers with unready status: [tiller])
	I0304 11:48:28.740805  405110 system_pods.go:74] duration metric: took 10.238573ms to wait for pod list to return data ...
	I0304 11:48:28.740815  405110 default_sa.go:34] waiting for default service account to be created ...
	I0304 11:48:28.805050  405110 default_sa.go:45] found service account: "default"
	I0304 11:48:28.805081  405110 default_sa.go:55] duration metric: took 64.256627ms for default service account to be created ...
	I0304 11:48:28.805095  405110 system_pods.go:116] waiting for k8s-apps to be running ...
	I0304 11:48:28.817438  405110 system_pods.go:86] 19 kube-system pods found
	I0304 11:48:28.817474  405110 system_pods.go:89] "coredns-5dd5756b68-nhbdq" [b09b4830-c38e-427e-9dd1-9754c212be10] Running
	I0304 11:48:28.817521  405110 system_pods.go:89] "csi-hostpath-attacher-0" [7e7f11f4-0b99-4ea3-99d2-a6249ef62a0a] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0304 11:48:28.817535  405110 system_pods.go:89] "csi-hostpath-resizer-0" [eb3b9680-f9a1-4562-b314-2ce09e7af0d3] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0304 11:48:28.817549  405110 system_pods.go:89] "csi-hostpathplugin-2w6kz" [d5584c82-412c-4c84-9350-1969e595731e] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0304 11:48:28.817560  405110 system_pods.go:89] "etcd-addons-975865" [cf48172d-da33-4575-867c-83faec826304] Running
	I0304 11:48:28.817568  405110 system_pods.go:89] "kindnet-tm2pm" [79d918c2-77d7-4651-b44a-0e371f3d551e] Running
	I0304 11:48:28.817596  405110 system_pods.go:89] "kube-apiserver-addons-975865" [9abd61a8-f937-46ce-af14-d169011623b1] Running
	I0304 11:48:28.817606  405110 system_pods.go:89] "kube-controller-manager-addons-975865" [06c59838-f212-4a65-ab8b-a059b58cf341] Running
	I0304 11:48:28.817621  405110 system_pods.go:89] "kube-ingress-dns-minikube" [5e9dec0c-a3a0-4515-9aa6-00d0505cccfc] Running
	I0304 11:48:28.817631  405110 system_pods.go:89] "kube-proxy-t5cbf" [16f8a838-cc14-401b-9589-c35dab3319f0] Running
	I0304 11:48:28.817640  405110 system_pods.go:89] "kube-scheduler-addons-975865" [60d23df3-9dc4-4378-8602-fb53244ee1e9] Running
	I0304 11:48:28.817649  405110 system_pods.go:89] "metrics-server-69cf46c98-b8n47" [cc50fbf1-ba8e-4734-b9e3-0ae2668c0265] Running
	I0304 11:48:28.817674  405110 system_pods.go:89] "nvidia-device-plugin-daemonset-blxlb" [7420b97c-e9cb-4738-b13a-1fc100a3bf50] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
	I0304 11:48:28.817686  405110 system_pods.go:89] "registry-proxy-rvr4d" [b5a1edef-e542-4acc-8e53-db66447354b3] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0304 11:48:28.817708  405110 system_pods.go:89] "registry-zl52r" [eeab5c60-f96a-488e-b668-8316e0664295] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0304 11:48:28.817718  405110 system_pods.go:89] "snapshot-controller-58dbcc7b99-ffxvv" [efa84fb0-21a4-4bed-a8fd-f4574cab3dce] Running
	I0304 11:48:28.817724  405110 system_pods.go:89] "snapshot-controller-58dbcc7b99-rlpjq" [a96ec197-1feb-43ce-a850-fb10b3f9e5e2] Running
	I0304 11:48:28.817733  405110 system_pods.go:89] "storage-provisioner" [29c40fc3-2ff5-46e5-b897-57b1cad1ad0c] Running
	I0304 11:48:28.817768  405110 system_pods.go:89] "tiller-deploy-7b677967b9-rq8jg" [448a96d7-e9e5-4ea5-8c75-5eecbbb2cb1f] Pending / Ready:ContainersNotReady (containers with unready status: [tiller]) / ContainersReady:ContainersNotReady (containers with unready status: [tiller])
	I0304 11:48:28.817787  405110 system_pods.go:126] duration metric: took 12.677861ms to wait for k8s-apps to be running ...
	I0304 11:48:28.817801  405110 system_svc.go:44] waiting for kubelet service to be running ....
	I0304 11:48:28.817873  405110 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0304 11:48:28.819607  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:28.835359  405110 system_svc.go:56] duration metric: took 17.548062ms WaitForService to wait for kubelet.
	I0304 11:48:28.835388  405110 kubeadm.go:581] duration metric: took 33.023084821s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0304 11:48:28.835413  405110 node_conditions.go:102] verifying NodePressure condition ...
	I0304 11:48:28.905537  405110 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0304 11:48:28.905623  405110 node_conditions.go:123] node cpu capacity is 8
	I0304 11:48:28.905657  405110 node_conditions.go:105] duration metric: took 70.234142ms to run NodePressure ...
	I0304 11:48:28.905694  405110 start.go:228] waiting for startup goroutines ...
	I0304 11:48:28.937975  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:29.020570  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:29.023976  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:29.313663  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:29.437146  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:29.519422  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:29.522381  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:29.813758  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:29.937659  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:30.019758  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:30.022535  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:30.313979  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:30.438439  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:30.521941  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:30.523992  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:30.813793  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:30.937731  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:31.019321  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:31.021902  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:31.312402  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:31.437615  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:31.519203  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:31.521811  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:31.813281  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:31.937890  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:32.020208  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:32.023337  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:32.313489  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:32.437756  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:32.519719  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:32.522505  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:32.816244  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:32.937601  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:33.019251  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:33.021900  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:33.314207  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:33.438258  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:33.520549  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:33.524197  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:33.815071  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:34.006480  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:34.019863  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:34.023572  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:34.316579  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:34.506983  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:34.523386  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:34.524215  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:34.814584  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:34.938422  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:35.020338  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:35.023579  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:35.314533  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:35.438028  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:35.520861  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:35.523443  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:35.813505  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:35.938098  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:36.020135  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:36.023460  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:36.314688  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:36.438517  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:36.523284  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:36.523425  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:36.813690  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:36.937969  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:37.019325  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:37.022519  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:37.316394  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:37.438157  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:37.520337  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:37.521979  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:37.814299  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:37.937410  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:38.019579  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:38.022074  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:38.313024  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:38.437818  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:38.519193  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:38.522147  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:38.812595  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:38.937867  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:39.019692  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:39.022163  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:39.313729  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:39.438090  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:39.519740  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:39.522501  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:39.813260  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:39.937836  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:40.020151  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:40.022910  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:40.313898  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:40.438374  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:40.519568  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:40.521953  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:40.813661  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:40.937281  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:41.019714  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:41.022174  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:41.313251  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:41.437992  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:41.520024  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:41.522749  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:41.814063  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:41.937729  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:42.020198  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:42.026882  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:42.314410  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:42.437393  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:42.518583  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:42.523243  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:42.813025  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:42.938587  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:43.019504  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:43.022134  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:43.312912  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:43.436925  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:43.568143  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:43.569257  405110 kapi.go:107] duration metric: took 40.051255907s to wait for kubernetes.io/minikube-addons=registry ...
	I0304 11:48:43.814087  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:43.937042  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:44.119443  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:44.313615  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:44.438262  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:44.518838  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:44.813304  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:44.938292  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:45.019270  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:45.313814  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:45.438293  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:45.519294  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:45.814061  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:45.937581  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:46.019187  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:46.312969  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:46.436663  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:46.519709  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:46.814585  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:47.005291  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:47.020519  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:47.313418  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:47.506866  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:47.524558  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:47.822785  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:48.009425  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:48.020216  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:48.321278  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:48.506573  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:48.519814  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:48.813806  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:48.937581  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:49.019416  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:49.313433  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:49.497274  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:49.519742  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:49.813635  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:49.937517  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:50.020430  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:50.313109  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:50.437573  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:50.520134  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:50.813751  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:50.937349  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:51.019193  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:51.314159  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:51.437306  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:51.518845  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:51.813356  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:51.937354  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:52.019847  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:52.313378  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:52.437428  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:52.518910  405110 kapi.go:107] duration metric: took 49.006313841s to wait for app.kubernetes.io/name=ingress-nginx ...
	I0304 11:48:52.813255  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:52.937481  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:53.316860  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:53.437419  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:53.813919  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:53.944247  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:54.315898  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:54.438243  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:54.813496  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:54.937934  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:55.313662  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:55.438777  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:55.814459  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:55.937826  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:56.312588  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:56.437727  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:56.813771  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:56.937570  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:57.313248  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:57.437667  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:57.813620  405110 kapi.go:107] duration metric: took 53.506588988s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I0304 11:48:57.938000  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:58.437283  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:58.937290  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:59.437665  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:59.938431  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:00.437921  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:00.937366  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:01.437726  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:01.937009  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:02.437562  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:02.937766  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:03.437165  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:03.937238  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:04.437286  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:04.937855  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:05.437256  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:05.937501  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:06.437697  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:06.938514  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:07.437148  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:07.937457  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:08.437806  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:08.937532  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:09.438001  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:09.936960  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:10.437342  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:10.937701  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:11.436913  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:11.936894  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:12.437401  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:12.937819  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:13.438497  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:13.938095  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:14.437063  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:14.937403  405110 kapi.go:107] duration metric: took 1m6.503612883s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I0304 11:49:14.939245  405110 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-975865 cluster.
	I0304 11:49:14.940691  405110 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I0304 11:49:14.942077  405110 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I0304 11:49:14.943660  405110 out.go:177] * Enabled addons: cloud-spanner, ingress-dns, storage-provisioner-rancher, inspektor-gadget, nvidia-device-plugin, storage-provisioner, helm-tiller, metrics-server, yakd, default-storageclass, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth
	I0304 11:49:14.944981  405110 addons.go:505] enable addons completed in 1m19.671322257s: enabled=[cloud-spanner ingress-dns storage-provisioner-rancher inspektor-gadget nvidia-device-plugin storage-provisioner helm-tiller metrics-server yakd default-storageclass volumesnapshots registry ingress csi-hostpath-driver gcp-auth]
	I0304 11:49:14.945027  405110 start.go:233] waiting for cluster config update ...
	I0304 11:49:14.945049  405110 start.go:242] writing updated cluster config ...
	I0304 11:49:14.945297  405110 ssh_runner.go:195] Run: rm -f paused
	I0304 11:49:15.004852  405110 start.go:601] kubectl: 1.29.2, cluster: 1.28.4 (minor skew: 1)
	I0304 11:49:15.006925  405110 out.go:177] * Done! kubectl is now configured to use "addons-975865" cluster and "default" namespace by default
	
	
	==> CRI-O <==
	Mar 04 11:51:50 addons-975865 crio[959]: time="2024-03-04 11:51:50.732592411Z" level=info msg="Pulled image: gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7" id=ffd10eec-01ee-4b33-b910-112b78d82a0a name=/runtime.v1.ImageService/PullImage
	Mar 04 11:51:50 addons-975865 crio[959]: time="2024-03-04 11:51:50.733568934Z" level=info msg="Checking image status: gcr.io/google-samples/hello-app:1.0" id=181579ab-0a5c-4a3e-b15c-9b4ec07fed83 name=/runtime.v1.ImageService/ImageStatus
	Mar 04 11:51:50 addons-975865 crio[959]: time="2024-03-04 11:51:50.734593607Z" level=info msg="Image status: &ImageStatusResponse{Image:&Image{Id:dd1b12fcb60978ac32686ef6732d56f612c8636ef86693c09613946a54c69d79,RepoTags:[gcr.io/google-samples/hello-app:1.0],RepoDigests:[gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7],Size_:28999827,Uid:nil,Username:nonroot,Spec:nil,},Info:map[string]string{},}" id=181579ab-0a5c-4a3e-b15c-9b4ec07fed83 name=/runtime.v1.ImageService/ImageStatus
	Mar 04 11:51:50 addons-975865 crio[959]: time="2024-03-04 11:51:50.735425702Z" level=info msg="Creating container: default/hello-world-app-5d77478584-r7hpv/hello-world-app" id=dbd86d9d-c955-443e-b873-c00486cf0714 name=/runtime.v1.RuntimeService/CreateContainer
	Mar 04 11:51:50 addons-975865 crio[959]: time="2024-03-04 11:51:50.735535530Z" level=warning msg="Allowed annotations are specified for workload []"
	Mar 04 11:51:50 addons-975865 crio[959]: time="2024-03-04 11:51:50.784212634Z" level=info msg="Created container 092a77ba1e07012a98663576aff64400e9c466d7619d99a2410fa027cbdd4db2: default/hello-world-app-5d77478584-r7hpv/hello-world-app" id=dbd86d9d-c955-443e-b873-c00486cf0714 name=/runtime.v1.RuntimeService/CreateContainer
	Mar 04 11:51:50 addons-975865 crio[959]: time="2024-03-04 11:51:50.784741058Z" level=info msg="Starting container: 092a77ba1e07012a98663576aff64400e9c466d7619d99a2410fa027cbdd4db2" id=e860eeb9-7cfd-4ea0-9f78-be75cf672bed name=/runtime.v1.RuntimeService/StartContainer
	Mar 04 11:51:50 addons-975865 crio[959]: time="2024-03-04 11:51:50.790249242Z" level=info msg="Started container" PID=10094 containerID=092a77ba1e07012a98663576aff64400e9c466d7619d99a2410fa027cbdd4db2 description=default/hello-world-app-5d77478584-r7hpv/hello-world-app id=e860eeb9-7cfd-4ea0-9f78-be75cf672bed name=/runtime.v1.RuntimeService/StartContainer sandboxID=92d3a13215c0490241aa221363d40e1a79e73b4c1e85f8e5e8734643bdc369dc
	Mar 04 11:51:50 addons-975865 crio[959]: time="2024-03-04 11:51:50.936358575Z" level=info msg="Removing container: 3072dbc893d97a45df97f637d3329964d0f3c0d2bfd84d0abef6cd59b84b09a2" id=25bfe109-3eac-44e7-b881-fea9b175e2dd name=/runtime.v1.RuntimeService/RemoveContainer
	Mar 04 11:51:50 addons-975865 crio[959]: time="2024-03-04 11:51:50.950463429Z" level=info msg="Removed container 3072dbc893d97a45df97f637d3329964d0f3c0d2bfd84d0abef6cd59b84b09a2: kube-system/kube-ingress-dns-minikube/minikube-ingress-dns" id=25bfe109-3eac-44e7-b881-fea9b175e2dd name=/runtime.v1.RuntimeService/RemoveContainer
	Mar 04 11:51:52 addons-975865 crio[959]: time="2024-03-04 11:51:52.468179364Z" level=info msg="Stopping container: c0dcc09452d34191ddfe3a43a43ec858943cbf9b49f6b242ddc56ec3e7a0079b (timeout: 2s)" id=e6412fc7-fb12-4172-882c-28d22c61f39a name=/runtime.v1.RuntimeService/StopContainer
	Mar 04 11:51:54 addons-975865 crio[959]: time="2024-03-04 11:51:54.474704603Z" level=warning msg="Stopping container c0dcc09452d34191ddfe3a43a43ec858943cbf9b49f6b242ddc56ec3e7a0079b with stop signal timed out: timeout reached after 2 seconds waiting for container process to exit" id=e6412fc7-fb12-4172-882c-28d22c61f39a name=/runtime.v1.RuntimeService/StopContainer
	Mar 04 11:51:54 addons-975865 conmon[5700]: conmon c0dcc09452d34191ddfe <ninfo>: container 5712 exited with status 137
	Mar 04 11:51:54 addons-975865 crio[959]: time="2024-03-04 11:51:54.606276859Z" level=info msg="Stopped container c0dcc09452d34191ddfe3a43a43ec858943cbf9b49f6b242ddc56ec3e7a0079b: ingress-nginx/ingress-nginx-controller-76dc478dd8-n2bqc/controller" id=e6412fc7-fb12-4172-882c-28d22c61f39a name=/runtime.v1.RuntimeService/StopContainer
	Mar 04 11:51:54 addons-975865 crio[959]: time="2024-03-04 11:51:54.606876933Z" level=info msg="Stopping pod sandbox: 669cc984cef0c7df5fe3de9ec3539f3b4daf0f6e713df68b652ebfd3fe303045" id=471f70c2-0546-42a2-9c8b-0f7bcbe193e3 name=/runtime.v1.RuntimeService/StopPodSandbox
	Mar 04 11:51:54 addons-975865 crio[959]: time="2024-03-04 11:51:54.609736041Z" level=info msg="Restoring iptables rules: *nat\n:KUBE-HOSTPORTS - [0:0]\n:KUBE-HP-W7MIZMZQTAA2XB2K - [0:0]\n:KUBE-HP-CFSPWLG3WOOABUY5 - [0:0]\n-X KUBE-HP-CFSPWLG3WOOABUY5\n-X KUBE-HP-W7MIZMZQTAA2XB2K\nCOMMIT\n"
	Mar 04 11:51:54 addons-975865 crio[959]: time="2024-03-04 11:51:54.611070521Z" level=info msg="Closing host port tcp:80"
	Mar 04 11:51:54 addons-975865 crio[959]: time="2024-03-04 11:51:54.611110541Z" level=info msg="Closing host port tcp:443"
	Mar 04 11:51:54 addons-975865 crio[959]: time="2024-03-04 11:51:54.612430895Z" level=info msg="Host port tcp:80 does not have an open socket"
	Mar 04 11:51:54 addons-975865 crio[959]: time="2024-03-04 11:51:54.612448341Z" level=info msg="Host port tcp:443 does not have an open socket"
	Mar 04 11:51:54 addons-975865 crio[959]: time="2024-03-04 11:51:54.612572358Z" level=info msg="Got pod network &{Name:ingress-nginx-controller-76dc478dd8-n2bqc Namespace:ingress-nginx ID:669cc984cef0c7df5fe3de9ec3539f3b4daf0f6e713df68b652ebfd3fe303045 UID:acd6110c-2a7c-441a-96a3-9d300a6f6970 NetNS:/var/run/netns/4f126902-9571-431c-b353-ed856e887964 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Mar 04 11:51:54 addons-975865 crio[959]: time="2024-03-04 11:51:54.612679751Z" level=info msg="Deleting pod ingress-nginx_ingress-nginx-controller-76dc478dd8-n2bqc from CNI network \"kindnet\" (type=ptp)"
	Mar 04 11:51:54 addons-975865 crio[959]: time="2024-03-04 11:51:54.663640573Z" level=info msg="Stopped pod sandbox: 669cc984cef0c7df5fe3de9ec3539f3b4daf0f6e713df68b652ebfd3fe303045" id=471f70c2-0546-42a2-9c8b-0f7bcbe193e3 name=/runtime.v1.RuntimeService/StopPodSandbox
	Mar 04 11:51:54 addons-975865 crio[959]: time="2024-03-04 11:51:54.948917769Z" level=info msg="Removing container: c0dcc09452d34191ddfe3a43a43ec858943cbf9b49f6b242ddc56ec3e7a0079b" id=b16d1b32-5c19-4d69-80c2-279600179a61 name=/runtime.v1.RuntimeService/RemoveContainer
	Mar 04 11:51:54 addons-975865 crio[959]: time="2024-03-04 11:51:54.962370027Z" level=info msg="Removed container c0dcc09452d34191ddfe3a43a43ec858943cbf9b49f6b242ddc56ec3e7a0079b: ingress-nginx/ingress-nginx-controller-76dc478dd8-n2bqc/controller" id=b16d1b32-5c19-4d69-80c2-279600179a61 name=/runtime.v1.RuntimeService/RemoveContainer
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                                                        CREATED             STATE               NAME                      ATTEMPT             POD ID              POD
	092a77ba1e070       gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7                      8 seconds ago       Running             hello-world-app           0                   92d3a13215c04       hello-world-app-5d77478584-r7hpv
	d74bc8cddb630       docker.io/library/nginx@sha256:6a2f8b28e45c4adea04ec207a251fd4a2df03ddc930f782af51e315ebc76e9a9                              2 minutes ago       Running             nginx                     0                   783918ddea330       nginx
	bd139d7eccc75       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:01b0de782aa30e7fc91ac5a91b5cc35e95e9679dee7ef07af06457b471f88f32                 2 minutes ago       Running             gcp-auth                  0                   c915444cdecbf       gcp-auth-5f6b4f85fd-nl88x
	f3c6d68889800       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:261843b59d96d7e8a91e89545c7f27a066b1ab5cddbea8236cf1695c31889023   3 minutes ago       Exited              patch                     0                   11d307550a9c1       ingress-nginx-admission-patch-6pkpn
	f84373bdcbea1       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:261843b59d96d7e8a91e89545c7f27a066b1ab5cddbea8236cf1695c31889023   3 minutes ago       Exited              create                    0                   78bfe07307f43       ingress-nginx-admission-create-dxvpr
	305ac960a46ba       docker.io/marcnuri/yakd@sha256:a3f540278e4c11373e15605311851dd9c64d208f4d63e727bccc0e39f9329310                              3 minutes ago       Running             yakd                      0                   ad8cc585d003b       yakd-dashboard-9947fc6bf-87nxj
	ec425e9be9916       ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc                                                             3 minutes ago       Running             coredns                   0                   fd204d3084b35       coredns-5dd5756b68-nhbdq
	ab441c3a89cf4       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                                             3 minutes ago       Running             storage-provisioner       0                   9afa5f9a56060       storage-provisioner
	290286ddcebc3       docker.io/kindest/kindnetd@sha256:61f9956af8019caf6dcc4d39b31857b868aaab80521432ddcc216b805c4f7988                           3 minutes ago       Running             kindnet-cni               0                   e5afa2d4a23e9       kindnet-tm2pm
	8a9996107fda7       83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e                                                             4 minutes ago       Running             kube-proxy                0                   7c8fcd8822a96       kube-proxy-t5cbf
	aee137a866e7b       d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591                                                             4 minutes ago       Running             kube-controller-manager   0                   3eaf6c3f0abe2       kube-controller-manager-addons-975865
	37a43e65f90fb       73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9                                                             4 minutes ago       Running             etcd                      0                   770a94f610d83       etcd-addons-975865
	e1ce9291c9551       7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257                                                             4 minutes ago       Running             kube-apiserver            0                   e6384a937d54c       kube-apiserver-addons-975865
	14ddd4820fa92       e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1                                                             4 minutes ago       Running             kube-scheduler            0                   e48c6db36e106       kube-scheduler-addons-975865
	
	
	==> coredns [ec425e9be9916c05a1de7912fd7c746a9694e7244b0103cbdd475908a65849e5] <==
	[INFO] 10.244.0.4:50796 - 39823 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000071095s
	[INFO] 10.244.0.4:43873 - 25214 "AAAA IN registry.kube-system.svc.cluster.local.us-east4-a.c.k8s-minikube.internal. udp 91 false 512" NXDOMAIN qr,rd,ra 91 0.003769153s
	[INFO] 10.244.0.4:43873 - 25468 "A IN registry.kube-system.svc.cluster.local.us-east4-a.c.k8s-minikube.internal. udp 91 false 512" NXDOMAIN qr,rd,ra 91 0.008668518s
	[INFO] 10.244.0.4:45693 - 18962 "AAAA IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 80 false 512" NXDOMAIN qr,rd,ra 80 0.003885128s
	[INFO] 10.244.0.4:45693 - 37905 "A IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 80 false 512" NXDOMAIN qr,rd,ra 80 0.005486817s
	[INFO] 10.244.0.4:32949 - 27058 "A IN registry.kube-system.svc.cluster.local.google.internal. udp 72 false 512" NXDOMAIN qr,rd,ra 72 0.004001824s
	[INFO] 10.244.0.4:32949 - 9661 "AAAA IN registry.kube-system.svc.cluster.local.google.internal. udp 72 false 512" NXDOMAIN qr,rd,ra 72 0.01066873s
	[INFO] 10.244.0.4:35994 - 4516 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000062904s
	[INFO] 10.244.0.4:35994 - 7335 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000097676s
	[INFO] 10.244.0.21:35611 - 60920 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000206403s
	[INFO] 10.244.0.21:45081 - 5443 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000089315s
	[INFO] 10.244.0.21:48064 - 10203 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000127637s
	[INFO] 10.244.0.21:44518 - 26130 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000126947s
	[INFO] 10.244.0.21:58287 - 25471 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000115928s
	[INFO] 10.244.0.21:38371 - 63807 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000157003s
	[INFO] 10.244.0.21:37584 - 43709 "AAAA IN storage.googleapis.com.us-east4-a.c.k8s-minikube.internal. udp 86 false 1232" NXDOMAIN qr,rd,ra 75 0.006444829s
	[INFO] 10.244.0.21:57259 - 2510 "A IN storage.googleapis.com.us-east4-a.c.k8s-minikube.internal. udp 86 false 1232" NXDOMAIN qr,rd,ra 75 0.006554905s
	[INFO] 10.244.0.21:48779 - 7389 "A IN storage.googleapis.com.c.k8s-minikube.internal. udp 75 false 1232" NXDOMAIN qr,rd,ra 64 0.004142706s
	[INFO] 10.244.0.21:43934 - 56662 "AAAA IN storage.googleapis.com.c.k8s-minikube.internal. udp 75 false 1232" NXDOMAIN qr,rd,ra 64 0.006060506s
	[INFO] 10.244.0.21:37085 - 29596 "AAAA IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 56 0.004443117s
	[INFO] 10.244.0.21:48908 - 65399 "A IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 56 0.004836443s
	[INFO] 10.244.0.21:47910 - 50711 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.000780284s
	[INFO] 10.244.0.21:46190 - 26335 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 344 0.000788127s
	[INFO] 10.244.0.24:32900 - 2 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000156945s
	[INFO] 10.244.0.24:55878 - 3 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000125869s
	
	
	==> describe nodes <==
	Name:               addons-975865
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=addons-975865
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=ab57ba9f65fd4cb3ac8815e4f9baeeca5604e645
	                    minikube.k8s.io/name=addons-975865
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2024_03_04T11_47_42_0700
	                    minikube.k8s.io/version=v1.32.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-975865
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 04 Mar 2024 11:47:38 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-975865
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 04 Mar 2024 11:51:56 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 04 Mar 2024 11:49:44 +0000   Mon, 04 Mar 2024 11:47:36 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 04 Mar 2024 11:49:44 +0000   Mon, 04 Mar 2024 11:47:36 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 04 Mar 2024 11:49:44 +0000   Mon, 04 Mar 2024 11:47:36 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 04 Mar 2024 11:49:44 +0000   Mon, 04 Mar 2024 11:48:04 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    addons-975865
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32859364Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32859364Ki
	  pods:               110
	System Info:
	  Machine ID:                 fe6bd5a5fbab4b57a48561ef52a9b9dc
	  System UUID:                40ad309a-363a-4c65-b404-a5a2b61a017a
	  Boot ID:                    8bd20ee9-487a-4290-b90e-1794c4ce93e6
	  Kernel Version:             5.15.0-1052-gcp
	  OS Image:                   Ubuntu 22.04.3 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.28.4
	  Kube-Proxy Version:         v1.28.4
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (12 in total)
	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-5d77478584-r7hpv         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10s
	  default                     nginx                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m29s
	  gcp-auth                    gcp-auth-5f6b4f85fd-nl88x                0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m51s
	  kube-system                 coredns-5dd5756b68-nhbdq                 100m (1%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (0%!)(MISSING)     4m4s
	  kube-system                 etcd-addons-975865                       100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         4m18s
	  kube-system                 kindnet-tm2pm                            100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      4m5s
	  kube-system                 kube-apiserver-addons-975865             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m17s
	  kube-system                 kube-controller-manager-addons-975865    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m17s
	  kube-system                 kube-proxy-t5cbf                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m5s
	  kube-system                 kube-scheduler-addons-975865             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m20s
	  kube-system                 storage-provisioner                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m58s
	  yakd-dashboard              yakd-dashboard-9947fc6bf-87nxj           0 (0%!)(MISSING)        0 (0%!)(MISSING)      128Mi (0%!)(MISSING)       256Mi (0%!)(MISSING)     3m57s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                850m (10%!)(MISSING)  100m (1%!)(MISSING)
	  memory             348Mi (1%!)(MISSING)  476Mi (1%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age    From             Message
	  ----    ------                   ----   ----             -------
	  Normal  Starting                 4m     kube-proxy       
	  Normal  Starting                 4m18s  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  4m18s  kubelet          Node addons-975865 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    4m18s  kubelet          Node addons-975865 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     4m18s  kubelet          Node addons-975865 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           4m5s   node-controller  Node addons-975865 event: Registered Node addons-975865 in Controller
	  Normal  NodeReady                3m55s  kubelet          Node addons-975865 status is now: NodeReady
	
	
	==> dmesg <==
	[Mar 4 11:49] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: 42 5a cb c7 17 b3 6e 3f ba 76 37 51 08 00
	[  +1.021881] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000012] ll header: 00000000: 42 5a cb c7 17 b3 6e 3f ba 76 37 51 08 00
	[  +2.011818] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000005] ll header: 00000000: 42 5a cb c7 17 b3 6e 3f ba 76 37 51 08 00
	[  +4.127609] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: 42 5a cb c7 17 b3 6e 3f ba 76 37 51 08 00
	[  +8.195190] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: 42 5a cb c7 17 b3 6e 3f ba 76 37 51 08 00
	[Mar 4 11:50] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: 42 5a cb c7 17 b3 6e 3f ba 76 37 51 08 00
	[ +33.276825] IPv4: martian source 10.244.0.20 from 127.0.0.1, on dev eth0
	[  +0.000007] ll header: 00000000: 42 5a cb c7 17 b3 6e 3f ba 76 37 51 08 00
	
	
	==> etcd [37a43e65f90fb73964292dc02401cf414b631c8de8a5a71b71f5fa36734e49da] <==
	{"level":"warn","ts":"2024-03-04T11:47:59.624875Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"222.444538ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/ranges/servicenodeports\" ","response":"range_response_count:1 size:118"}
	{"level":"info","ts":"2024-03-04T11:47:59.627645Z","caller":"traceutil/trace.go:171","msg":"trace[502199716] range","detail":"{range_begin:/registry/ranges/servicenodeports; range_end:; response_count:1; response_revision:397; }","duration":"225.22079ms","start":"2024-03-04T11:47:59.402408Z","end":"2024-03-04T11:47:59.627629Z","steps":["trace[502199716] 'agreement among raft nodes before linearized reading'  (duration: 222.407075ms)"],"step_count":1}
	{"level":"warn","ts":"2024-03-04T11:47:59.628352Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"110.226993ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/deployments/default/cloud-spanner-emulator\" ","response":"range_response_count:1 size:3145"}
	{"level":"info","ts":"2024-03-04T11:47:59.628442Z","caller":"traceutil/trace.go:171","msg":"trace[854904493] range","detail":"{range_begin:/registry/deployments/default/cloud-spanner-emulator; range_end:; response_count:1; response_revision:398; }","duration":"110.328799ms","start":"2024-03-04T11:47:59.518104Z","end":"2024-03-04T11:47:59.628433Z","steps":["trace[854904493] 'agreement among raft nodes before linearized reading'  (duration: 110.166649ms)"],"step_count":1}
	{"level":"warn","ts":"2024-03-04T11:48:00.108968Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"100.702749ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/\" range_end:\"/registry/apiextensions.k8s.io/customresourcedefinitions0\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2024-03-04T11:48:00.204771Z","caller":"traceutil/trace.go:171","msg":"trace[92070772] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/; range_end:/registry/apiextensions.k8s.io/customresourcedefinitions0; response_count:0; response_revision:423; }","duration":"196.501736ms","start":"2024-03-04T11:48:00.008238Z","end":"2024-03-04T11:48:00.20474Z","steps":["trace[92070772] 'agreement among raft nodes before linearized reading'  (duration: 100.653291ms)"],"step_count":1}
	{"level":"warn","ts":"2024-03-04T11:48:00.113795Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"105.513443ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/local-path-storage/local-path-provisioner-service-account\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2024-03-04T11:48:00.206695Z","caller":"traceutil/trace.go:171","msg":"trace[1892410909] range","detail":"{range_begin:/registry/serviceaccounts/local-path-storage/local-path-provisioner-service-account; range_end:; response_count:0; response_revision:423; }","duration":"198.417283ms","start":"2024-03-04T11:48:00.008262Z","end":"2024-03-04T11:48:00.206679Z","steps":["trace[1892410909] 'agreement among raft nodes before linearized reading'  (duration: 105.497307ms)"],"step_count":1}
	{"level":"info","ts":"2024-03-04T11:48:00.507242Z","caller":"traceutil/trace.go:171","msg":"trace[1234448652] transaction","detail":"{read_only:false; response_revision:440; number_of_response:1; }","duration":"100.66372ms","start":"2024-03-04T11:48:00.406556Z","end":"2024-03-04T11:48:00.507219Z","steps":["trace[1234448652] 'process raft request'  (duration: 13.965804ms)","trace[1234448652] 'compare'  (duration: 86.108153ms)"],"step_count":2}
	{"level":"info","ts":"2024-03-04T11:48:00.707993Z","caller":"traceutil/trace.go:171","msg":"trace[1250373175] transaction","detail":"{read_only:false; response_revision:444; number_of_response:1; }","duration":"104.727625ms","start":"2024-03-04T11:48:00.603231Z","end":"2024-03-04T11:48:00.707959Z","steps":["trace[1250373175] 'process raft request'  (duration: 104.329511ms)"],"step_count":1}
	{"level":"info","ts":"2024-03-04T11:48:01.026977Z","caller":"traceutil/trace.go:171","msg":"trace[1178411780] linearizableReadLoop","detail":"{readStateIndex:472; appliedIndex:466; }","duration":"116.921078ms","start":"2024-03-04T11:48:00.910042Z","end":"2024-03-04T11:48:01.026964Z","steps":["trace[1178411780] 'read index received'  (duration: 11.796319ms)","trace[1178411780] 'applied index is now lower than readState.Index'  (duration: 105.124308ms)"],"step_count":2}
	{"level":"info","ts":"2024-03-04T11:48:01.027215Z","caller":"traceutil/trace.go:171","msg":"trace[362995318] transaction","detail":"{read_only:false; response_revision:455; number_of_response:1; }","duration":"119.327754ms","start":"2024-03-04T11:48:00.907875Z","end":"2024-03-04T11:48:01.027203Z","steps":["trace[362995318] 'process raft request'  (duration: 98.201429ms)","trace[362995318] 'get key's previous created_revision and leaseID' {req_type:put; key:/registry/serviceaccounts/kube-system/resourcequota-controller; req_size:208; } (duration: 20.712214ms)"],"step_count":2}
	{"level":"info","ts":"2024-03-04T11:48:01.027355Z","caller":"traceutil/trace.go:171","msg":"trace[878140330] transaction","detail":"{read_only:false; response_revision:456; number_of_response:1; }","duration":"118.388185ms","start":"2024-03-04T11:48:00.908962Z","end":"2024-03-04T11:48:01.027351Z","steps":["trace[878140330] 'process raft request'  (duration: 117.938413ms)"],"step_count":1}
	{"level":"info","ts":"2024-03-04T11:48:01.02745Z","caller":"traceutil/trace.go:171","msg":"trace[1082130259] transaction","detail":"{read_only:false; response_revision:457; number_of_response:1; }","duration":"118.794947ms","start":"2024-03-04T11:48:00.908651Z","end":"2024-03-04T11:48:01.027446Z","steps":["trace[1082130259] 'process raft request'  (duration: 118.287593ms)"],"step_count":1}
	{"level":"warn","ts":"2024-03-04T11:48:01.02754Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"117.503821ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2024-03-04T11:48:01.027559Z","caller":"traceutil/trace.go:171","msg":"trace[445003174] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:457; }","duration":"117.532798ms","start":"2024-03-04T11:48:00.91002Z","end":"2024-03-04T11:48:01.027552Z","steps":["trace[445003174] 'agreement among raft nodes before linearized reading'  (duration: 117.480714ms)"],"step_count":1}
	{"level":"info","ts":"2024-03-04T11:48:01.1207Z","caller":"traceutil/trace.go:171","msg":"trace[918901170] transaction","detail":"{read_only:false; response_revision:458; number_of_response:1; }","duration":"114.86767ms","start":"2024-03-04T11:48:01.005813Z","end":"2024-03-04T11:48:01.120681Z","steps":["trace[918901170] 'process raft request'  (duration: 111.370271ms)"],"step_count":1}
	{"level":"warn","ts":"2024-03-04T11:48:01.123366Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"110.631391ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/deployments/local-path-storage/local-path-provisioner\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2024-03-04T11:48:01.123489Z","caller":"traceutil/trace.go:171","msg":"trace[486244616] range","detail":"{range_begin:/registry/deployments/local-path-storage/local-path-provisioner; range_end:; response_count:0; response_revision:458; }","duration":"113.244267ms","start":"2024-03-04T11:48:01.01023Z","end":"2024-03-04T11:48:01.123474Z","steps":["trace[486244616] 'agreement among raft nodes before linearized reading'  (duration: 110.46189ms)"],"step_count":1}
	{"level":"warn","ts":"2024-03-04T11:48:01.213044Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"100.267183ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2024-03-04T11:48:01.213228Z","caller":"traceutil/trace.go:171","msg":"trace[449365409] range","detail":"{range_begin:/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath; range_end:; response_count:0; response_revision:463; }","duration":"100.451937ms","start":"2024-03-04T11:48:01.112751Z","end":"2024-03-04T11:48:01.213203Z","steps":["trace[449365409] 'agreement among raft nodes before linearized reading'  (duration: 100.247374ms)"],"step_count":1}
	{"level":"warn","ts":"2024-03-04T11:48:01.614564Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"189.810497ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/configmaps/local-path-storage/local-path-config\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2024-03-04T11:48:01.615871Z","caller":"traceutil/trace.go:171","msg":"trace[554689994] range","detail":"{range_begin:/registry/configmaps/local-path-storage/local-path-config; range_end:; response_count:0; response_revision:488; }","duration":"191.121413ms","start":"2024-03-04T11:48:01.424728Z","end":"2024-03-04T11:48:01.61585Z","steps":["trace[554689994] 'agreement among raft nodes before linearized reading'  (duration: 96.106472ms)","trace[554689994] 'range keys from in-memory index tree'  (duration: 93.663675ms)"],"step_count":2}
	{"level":"warn","ts":"2024-03-04T11:48:01.615132Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"190.073513ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/kube-system\" ","response":"range_response_count:1 size:351"}
	{"level":"info","ts":"2024-03-04T11:48:01.616229Z","caller":"traceutil/trace.go:171","msg":"trace[841401540] range","detail":"{range_begin:/registry/namespaces/kube-system; range_end:; response_count:1; response_revision:489; }","duration":"191.174558ms","start":"2024-03-04T11:48:01.425043Z","end":"2024-03-04T11:48:01.616217Z","steps":["trace[841401540] 'agreement among raft nodes before linearized reading'  (duration: 190.006742ms)"],"step_count":1}
	
	
	==> gcp-auth [bd139d7eccc756f3182787ac4e4a0d21cb75d6b66108d01ef787a17e9a56a5c3] <==
	2024/03/04 11:49:14 GCP Auth Webhook started!
	2024/03/04 11:49:20 Ready to marshal response ...
	2024/03/04 11:49:20 Ready to write response ...
	2024/03/04 11:49:21 Ready to marshal response ...
	2024/03/04 11:49:21 Ready to write response ...
	2024/03/04 11:49:21 Ready to marshal response ...
	2024/03/04 11:49:21 Ready to write response ...
	2024/03/04 11:49:25 Ready to marshal response ...
	2024/03/04 11:49:25 Ready to write response ...
	2024/03/04 11:49:29 Ready to marshal response ...
	2024/03/04 11:49:29 Ready to write response ...
	2024/03/04 11:49:30 Ready to marshal response ...
	2024/03/04 11:49:30 Ready to write response ...
	2024/03/04 11:49:36 Ready to marshal response ...
	2024/03/04 11:49:36 Ready to write response ...
	2024/03/04 11:50:04 Ready to marshal response ...
	2024/03/04 11:50:04 Ready to write response ...
	2024/03/04 11:51:49 Ready to marshal response ...
	2024/03/04 11:51:49 Ready to write response ...
	
	
	==> kernel <==
	 11:51:59 up 11:34,  0 users,  load average: 0.29, 1.65, 1.77
	Linux addons-975865 5.15.0-1052-gcp #60~20.04.1-Ubuntu SMP Thu Feb 15 13:21:04 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.3 LTS"
	
	
	==> kindnet [290286ddcebc3552c8b82150f8568464609b6066a2389799cb2df56e4a8f7445] <==
	I0304 11:49:54.046629       1 main.go:227] handling current node
	I0304 11:50:04.050434       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:50:04.050467       1 main.go:227] handling current node
	I0304 11:50:14.062827       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:50:14.062851       1 main.go:227] handling current node
	I0304 11:50:24.074135       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:50:24.074160       1 main.go:227] handling current node
	I0304 11:50:34.078055       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:50:34.078080       1 main.go:227] handling current node
	I0304 11:50:44.090006       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:50:44.090030       1 main.go:227] handling current node
	I0304 11:50:54.094041       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:50:54.094064       1 main.go:227] handling current node
	I0304 11:51:04.097875       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:51:04.097897       1 main.go:227] handling current node
	I0304 11:51:14.101116       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:51:14.101144       1 main.go:227] handling current node
	I0304 11:51:24.105602       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:51:24.105627       1 main.go:227] handling current node
	I0304 11:51:34.117436       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:51:34.117462       1 main.go:227] handling current node
	I0304 11:51:44.129428       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:51:44.129452       1 main.go:227] handling current node
	I0304 11:51:54.133273       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:51:54.133297       1 main.go:227] handling current node
	
	
	==> kube-apiserver [e1ce9291c9551d537e0322399929aad9bcf8c4cbea0bddecf12315bedee5c63f] <==
	I0304 11:49:32.873852       1 handler.go:232] Adding GroupVersion gadget.kinvolk.io v1alpha1 to ResourceManager
	W0304 11:49:33.884158       1 cacher.go:171] Terminating all watchers from cacher traces.gadget.kinvolk.io
	E0304 11:49:45.963382       1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"local-path-provisioner-service-account\" not found]"
	I0304 11:49:47.539268       1 controller.go:624] quota admission added evaluator for: volumesnapshots.snapshot.storage.k8s.io
	I0304 11:50:19.014469       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0304 11:50:19.014525       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0304 11:50:19.020621       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0304 11:50:19.020788       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0304 11:50:19.027122       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0304 11:50:19.027256       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0304 11:50:19.027803       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0304 11:50:19.027846       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0304 11:50:19.036038       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0304 11:50:19.036092       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0304 11:50:19.102677       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0304 11:50:19.102847       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0304 11:50:19.119053       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0304 11:50:19.120432       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	I0304 11:50:19.120539       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1 to ResourceManager
	I0304 11:50:19.120589       1 handler.go:232] Adding GroupVersion snapshot.storage.k8s.io v1beta1 to ResourceManager
	E0304 11:50:19.205004       1 authentication.go:73] "Unable to authenticate the request" err="[invalid bearer token, serviceaccounts \"snapshot-controller\" not found]"
	W0304 11:50:20.028619       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotclasses.snapshot.storage.k8s.io
	W0304 11:50:20.120784       1 cacher.go:171] Terminating all watchers from cacher volumesnapshotcontents.snapshot.storage.k8s.io
	W0304 11:50:20.130273       1 cacher.go:171] Terminating all watchers from cacher volumesnapshots.snapshot.storage.k8s.io
	I0304 11:51:49.413303       1 alloc.go:330] "allocated clusterIPs" service="default/hello-world-app" clusterIPs={"IPv4":"10.102.10.232"}
	
	
	==> kube-controller-manager [aee137a866e7b5068ad152a72a43dba65d53df6dea4a74d3b998a58e03a1d017] <==
	E0304 11:51:00.269769       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0304 11:51:01.219907       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0304 11:51:01.219943       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0304 11:51:04.674500       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0304 11:51:04.674531       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0304 11:51:32.787911       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0304 11:51:32.787944       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	W0304 11:51:43.804693       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0304 11:51:43.804725       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0304 11:51:49.224191       1 event.go:307] "Event occurred" object="default/hello-world-app" fieldPath="" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set hello-world-app-5d77478584 to 1"
	I0304 11:51:49.233423       1 event.go:307] "Event occurred" object="default/hello-world-app-5d77478584" fieldPath="" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: hello-world-app-5d77478584-r7hpv"
	I0304 11:51:49.238216       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="14.231181ms"
	I0304 11:51:49.243228       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="4.958802ms"
	I0304 11:51:49.243331       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="66.006µs"
	I0304 11:51:49.243412       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="43.037µs"
	I0304 11:51:49.248658       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="54.659µs"
	W0304 11:51:50.900121       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0304 11:51:50.900152       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	I0304 11:51:50.954579       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="5.694245ms"
	I0304 11:51:50.954825       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/hello-world-app-5d77478584" duration="94.01µs"
	I0304 11:51:51.458575       1 job_controller.go:562] "enqueueing job" key="ingress-nginx/ingress-nginx-admission-create"
	I0304 11:51:51.459733       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-76dc478dd8" duration="7.061µs"
	I0304 11:51:51.462484       1 job_controller.go:562] "enqueueing job" key="ingress-nginx/ingress-nginx-admission-patch"
	W0304 11:51:58.213966       1 reflector.go:535] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	E0304 11:51:58.214005       1 reflector.go:147] vendor/k8s.io/client-go/metadata/metadatainformer/informer.go:106: Failed to watch *v1.PartialObjectMetadata: failed to list *v1.PartialObjectMetadata: the server could not find the requested resource
	
	
	==> kube-proxy [8a9996107fda7254c7e92a44159d2f25f966c65eacee8764573c09ddc214471b] <==
	I0304 11:47:56.512587       1 server_others.go:69] "Using iptables proxy"
	I0304 11:47:56.803862       1 node.go:141] Successfully retrieved node IP: 192.168.49.2
	I0304 11:47:59.209528       1 server.go:632] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0304 11:47:59.212390       1 server_others.go:152] "Using iptables Proxier"
	I0304 11:47:59.212515       1 server_others.go:421] "Detect-local-mode set to ClusterCIDR, but no cluster CIDR for family" ipFamily="IPv6"
	I0304 11:47:59.212565       1 server_others.go:438] "Defaulting to no-op detect-local"
	I0304 11:47:59.212627       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
	I0304 11:47:59.212907       1 server.go:846] "Version info" version="v1.28.4"
	I0304 11:47:59.213253       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0304 11:47:59.214234       1 config.go:188] "Starting service config controller"
	I0304 11:47:59.215437       1 shared_informer.go:311] Waiting for caches to sync for service config
	I0304 11:47:59.214744       1 config.go:97] "Starting endpoint slice config controller"
	I0304 11:47:59.215560       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
	I0304 11:47:59.215163       1 config.go:315] "Starting node config controller"
	I0304 11:47:59.215629       1 shared_informer.go:311] Waiting for caches to sync for node config
	I0304 11:47:59.321393       1 shared_informer.go:318] Caches are synced for service config
	I0304 11:47:59.321442       1 shared_informer.go:318] Caches are synced for endpoint slice config
	I0304 11:47:59.523058       1 shared_informer.go:318] Caches are synced for node config
	
	
	==> kube-scheduler [14ddd4820fa928efc9c0709541d7d4920e4ec4e0643dec69ca95c924d01edc9e] <==
	W0304 11:47:38.815912       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0304 11:47:38.815933       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W0304 11:47:38.816000       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0304 11:47:38.816010       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0304 11:47:38.816022       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0304 11:47:38.816024       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0304 11:47:38.816032       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0304 11:47:38.816060       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W0304 11:47:38.816097       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0304 11:47:38.816117       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0304 11:47:38.816117       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0304 11:47:38.816155       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W0304 11:47:38.816157       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0304 11:47:38.816178       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0304 11:47:38.816184       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0304 11:47:38.816198       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W0304 11:47:38.816350       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0304 11:47:38.816419       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	W0304 11:47:39.772539       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0304 11:47:39.772578       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	W0304 11:47:39.820552       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0304 11:47:39.820618       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0304 11:47:39.877747       1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0304 11:47:39.877787       1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0304 11:47:42.510708       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	
	==> kubelet <==
	Mar 04 11:51:49 addons-975865 kubelet[1558]: I0304 11:51:49.358959    1558 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/9427efbb-7342-4927-a31d-5a4fe362a26b-gcp-creds\") pod \"hello-world-app-5d77478584-r7hpv\" (UID: \"9427efbb-7342-4927-a31d-5a4fe362a26b\") " pod="default/hello-world-app-5d77478584-r7hpv"
	Mar 04 11:51:49 addons-975865 kubelet[1558]: I0304 11:51:49.359025    1558 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbv5v\" (UniqueName: \"kubernetes.io/projected/9427efbb-7342-4927-a31d-5a4fe362a26b-kube-api-access-nbv5v\") pod \"hello-world-app-5d77478584-r7hpv\" (UID: \"9427efbb-7342-4927-a31d-5a4fe362a26b\") " pod="default/hello-world-app-5d77478584-r7hpv"
	Mar 04 11:51:49 addons-975865 kubelet[1558]: W0304 11:51:49.578280    1558 manager.go:1159] Failed to process watch event {EventType:0 Name:/docker/89c01ac9a8151395a60453aa534f39efedae7b9a9a00081eb711e101e4ec0822/crio-92d3a13215c0490241aa221363d40e1a79e73b4c1e85f8e5e8734643bdc369dc WatchSource:0}: Error finding container 92d3a13215c0490241aa221363d40e1a79e73b4c1e85f8e5e8734643bdc369dc: Status 404 returned error can't find the container with id 92d3a13215c0490241aa221363d40e1a79e73b4c1e85f8e5e8734643bdc369dc
	Mar 04 11:51:50 addons-975865 kubelet[1558]: I0304 11:51:50.302531    1558 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88q9l\" (UniqueName: \"kubernetes.io/projected/5e9dec0c-a3a0-4515-9aa6-00d0505cccfc-kube-api-access-88q9l\") pod \"5e9dec0c-a3a0-4515-9aa6-00d0505cccfc\" (UID: \"5e9dec0c-a3a0-4515-9aa6-00d0505cccfc\") "
	Mar 04 11:51:50 addons-975865 kubelet[1558]: I0304 11:51:50.304918    1558 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e9dec0c-a3a0-4515-9aa6-00d0505cccfc-kube-api-access-88q9l" (OuterVolumeSpecName: "kube-api-access-88q9l") pod "5e9dec0c-a3a0-4515-9aa6-00d0505cccfc" (UID: "5e9dec0c-a3a0-4515-9aa6-00d0505cccfc"). InnerVolumeSpecName "kube-api-access-88q9l". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Mar 04 11:51:50 addons-975865 kubelet[1558]: I0304 11:51:50.403451    1558 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-88q9l\" (UniqueName: \"kubernetes.io/projected/5e9dec0c-a3a0-4515-9aa6-00d0505cccfc-kube-api-access-88q9l\") on node \"addons-975865\" DevicePath \"\""
	Mar 04 11:51:50 addons-975865 kubelet[1558]: I0304 11:51:50.935401    1558 scope.go:117] "RemoveContainer" containerID="3072dbc893d97a45df97f637d3329964d0f3c0d2bfd84d0abef6cd59b84b09a2"
	Mar 04 11:51:50 addons-975865 kubelet[1558]: I0304 11:51:50.949470    1558 pod_startup_latency_tracker.go:102] "Observed pod startup duration" pod="default/hello-world-app-5d77478584-r7hpv" podStartSLOduration=0.797633237 podCreationTimestamp="2024-03-04 11:51:49 +0000 UTC" firstStartedPulling="2024-03-04 11:51:49.581138395 +0000 UTC m=+247.836018641" lastFinishedPulling="2024-03-04 11:51:50.732920743 +0000 UTC m=+248.987800975" observedRunningTime="2024-03-04 11:51:50.948722269 +0000 UTC m=+249.203602520" watchObservedRunningTime="2024-03-04 11:51:50.949415571 +0000 UTC m=+249.204295821"
	Mar 04 11:51:50 addons-975865 kubelet[1558]: I0304 11:51:50.950732    1558 scope.go:117] "RemoveContainer" containerID="3072dbc893d97a45df97f637d3329964d0f3c0d2bfd84d0abef6cd59b84b09a2"
	Mar 04 11:51:50 addons-975865 kubelet[1558]: E0304 11:51:50.951208    1558 remote_runtime.go:432] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3072dbc893d97a45df97f637d3329964d0f3c0d2bfd84d0abef6cd59b84b09a2\": container with ID starting with 3072dbc893d97a45df97f637d3329964d0f3c0d2bfd84d0abef6cd59b84b09a2 not found: ID does not exist" containerID="3072dbc893d97a45df97f637d3329964d0f3c0d2bfd84d0abef6cd59b84b09a2"
	Mar 04 11:51:50 addons-975865 kubelet[1558]: I0304 11:51:50.951265    1558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3072dbc893d97a45df97f637d3329964d0f3c0d2bfd84d0abef6cd59b84b09a2"} err="failed to get container status \"3072dbc893d97a45df97f637d3329964d0f3c0d2bfd84d0abef6cd59b84b09a2\": rpc error: code = NotFound desc = could not find container \"3072dbc893d97a45df97f637d3329964d0f3c0d2bfd84d0abef6cd59b84b09a2\": container with ID starting with 3072dbc893d97a45df97f637d3329964d0f3c0d2bfd84d0abef6cd59b84b09a2 not found: ID does not exist"
	Mar 04 11:51:51 addons-975865 kubelet[1558]: I0304 11:51:51.831485    1558 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0748d0f9-9e3e-468a-873a-0d1823c972bc" path="/var/lib/kubelet/pods/0748d0f9-9e3e-468a-873a-0d1823c972bc/volumes"
	Mar 04 11:51:51 addons-975865 kubelet[1558]: I0304 11:51:51.831972    1558 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="40e62d56-30e4-44d1-b19e-0793b9584f62" path="/var/lib/kubelet/pods/40e62d56-30e4-44d1-b19e-0793b9584f62/volumes"
	Mar 04 11:51:51 addons-975865 kubelet[1558]: I0304 11:51:51.832344    1558 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5e9dec0c-a3a0-4515-9aa6-00d0505cccfc" path="/var/lib/kubelet/pods/5e9dec0c-a3a0-4515-9aa6-00d0505cccfc/volumes"
	Mar 04 11:51:54 addons-975865 kubelet[1558]: I0304 11:51:54.728266    1558 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/acd6110c-2a7c-441a-96a3-9d300a6f6970-webhook-cert\") pod \"acd6110c-2a7c-441a-96a3-9d300a6f6970\" (UID: \"acd6110c-2a7c-441a-96a3-9d300a6f6970\") "
	Mar 04 11:51:54 addons-975865 kubelet[1558]: I0304 11:51:54.728318    1558 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5j9v\" (UniqueName: \"kubernetes.io/projected/acd6110c-2a7c-441a-96a3-9d300a6f6970-kube-api-access-n5j9v\") pod \"acd6110c-2a7c-441a-96a3-9d300a6f6970\" (UID: \"acd6110c-2a7c-441a-96a3-9d300a6f6970\") "
	Mar 04 11:51:54 addons-975865 kubelet[1558]: I0304 11:51:54.730179    1558 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acd6110c-2a7c-441a-96a3-9d300a6f6970-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "acd6110c-2a7c-441a-96a3-9d300a6f6970" (UID: "acd6110c-2a7c-441a-96a3-9d300a6f6970"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Mar 04 11:51:54 addons-975865 kubelet[1558]: I0304 11:51:54.730289    1558 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acd6110c-2a7c-441a-96a3-9d300a6f6970-kube-api-access-n5j9v" (OuterVolumeSpecName: "kube-api-access-n5j9v") pod "acd6110c-2a7c-441a-96a3-9d300a6f6970" (UID: "acd6110c-2a7c-441a-96a3-9d300a6f6970"). InnerVolumeSpecName "kube-api-access-n5j9v". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Mar 04 11:51:54 addons-975865 kubelet[1558]: I0304 11:51:54.829073    1558 reconciler_common.go:300] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/acd6110c-2a7c-441a-96a3-9d300a6f6970-webhook-cert\") on node \"addons-975865\" DevicePath \"\""
	Mar 04 11:51:54 addons-975865 kubelet[1558]: I0304 11:51:54.829130    1558 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-n5j9v\" (UniqueName: \"kubernetes.io/projected/acd6110c-2a7c-441a-96a3-9d300a6f6970-kube-api-access-n5j9v\") on node \"addons-975865\" DevicePath \"\""
	Mar 04 11:51:54 addons-975865 kubelet[1558]: I0304 11:51:54.947855    1558 scope.go:117] "RemoveContainer" containerID="c0dcc09452d34191ddfe3a43a43ec858943cbf9b49f6b242ddc56ec3e7a0079b"
	Mar 04 11:51:54 addons-975865 kubelet[1558]: I0304 11:51:54.962615    1558 scope.go:117] "RemoveContainer" containerID="c0dcc09452d34191ddfe3a43a43ec858943cbf9b49f6b242ddc56ec3e7a0079b"
	Mar 04 11:51:54 addons-975865 kubelet[1558]: E0304 11:51:54.962985    1558 remote_runtime.go:432] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0dcc09452d34191ddfe3a43a43ec858943cbf9b49f6b242ddc56ec3e7a0079b\": container with ID starting with c0dcc09452d34191ddfe3a43a43ec858943cbf9b49f6b242ddc56ec3e7a0079b not found: ID does not exist" containerID="c0dcc09452d34191ddfe3a43a43ec858943cbf9b49f6b242ddc56ec3e7a0079b"
	Mar 04 11:51:54 addons-975865 kubelet[1558]: I0304 11:51:54.963040    1558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0dcc09452d34191ddfe3a43a43ec858943cbf9b49f6b242ddc56ec3e7a0079b"} err="failed to get container status \"c0dcc09452d34191ddfe3a43a43ec858943cbf9b49f6b242ddc56ec3e7a0079b\": rpc error: code = NotFound desc = could not find container \"c0dcc09452d34191ddfe3a43a43ec858943cbf9b49f6b242ddc56ec3e7a0079b\": container with ID starting with c0dcc09452d34191ddfe3a43a43ec858943cbf9b49f6b242ddc56ec3e7a0079b not found: ID does not exist"
	Mar 04 11:51:55 addons-975865 kubelet[1558]: I0304 11:51:55.831228    1558 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="acd6110c-2a7c-441a-96a3-9d300a6f6970" path="/var/lib/kubelet/pods/acd6110c-2a7c-441a-96a3-9d300a6f6970/volumes"
	
	
	==> storage-provisioner [ab441c3a89cf4277af6d68ab05c84601f4d7329f9a5e71a956ae43037dd8ed5f] <==
	I0304 11:48:08.207370       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0304 11:48:08.219149       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0304 11:48:08.219202       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0304 11:48:08.230460       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0304 11:48:08.230670       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-975865_801b5a50-8a27-4dc3-9875-8fa0026169bb!
	I0304 11:48:08.231719       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"7b196ec1-25b9-4762-8775-b0932dc3577b", APIVersion:"v1", ResourceVersion:"844", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-975865_801b5a50-8a27-4dc3-9875-8fa0026169bb became leader
	I0304 11:48:08.402350       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-975865_801b5a50-8a27-4dc3-9875-8fa0026169bb!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p addons-975865 -n addons-975865
helpers_test.go:261: (dbg) Run:  kubectl --context addons-975865 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestAddons/parallel/Ingress FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestAddons/parallel/Ingress (150.66s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (2.8s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:824: (dbg) Run:  out/minikube-linux-amd64 addons enable headlamp -p addons-975865 --alsologtostderr -v=1
addons_test.go:824: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable headlamp -p addons-975865 --alsologtostderr -v=1: exit status 11 (295.826956ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 11:49:28.393869  414887 out.go:291] Setting OutFile to fd 1 ...
	I0304 11:49:28.394005  414887 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 11:49:28.394015  414887 out.go:304] Setting ErrFile to fd 2...
	I0304 11:49:28.394020  414887 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 11:49:28.394274  414887 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18284-396872/.minikube/bin
	I0304 11:49:28.394530  414887 mustload.go:65] Loading cluster: addons-975865
	I0304 11:49:28.394872  414887 config.go:182] Loaded profile config "addons-975865": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
	I0304 11:49:28.394894  414887 addons.go:597] checking whether the cluster is paused
	I0304 11:49:28.394979  414887 config.go:182] Loaded profile config "addons-975865": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
	I0304 11:49:28.394991  414887 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:49:28.395376  414887 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:49:28.414279  414887 ssh_runner.go:195] Run: systemctl --version
	I0304 11:49:28.414338  414887 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:49:28.435923  414887 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:49:28.518485  414887 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0304 11:49:28.518572  414887 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0304 11:49:28.556910  414887 cri.go:89] found id: "4ff508c8a8ff046f50279f5460a453bb4a3e9f67c3276a28200c29b10e2d876d"
	I0304 11:49:28.556944  414887 cri.go:89] found id: "3adfd504a781dff006bce5aa7fb610298e55aa0d963d5bbb1dda3d61b950bf53"
	I0304 11:49:28.556947  414887 cri.go:89] found id: "e410af8388d7b641fb0c3edd6aea65a02f5eff48f41a855ba04c2c79dc887d3c"
	I0304 11:49:28.556950  414887 cri.go:89] found id: "79e2b128ea828304f8b8150b4224e5f983f7aafd72ebdade9bb2fce3deeae7f6"
	I0304 11:49:28.556953  414887 cri.go:89] found id: "f5a61bc6f00e28d2fbd3650f0386c4b9ff51a515def78eb863f0bee6517866fa"
	I0304 11:49:28.556957  414887 cri.go:89] found id: "1454d4d8ebfe4a4180314cd52853a5e163304054d5522bc6796939a66a6fe36d"
	I0304 11:49:28.556960  414887 cri.go:89] found id: "7128e1cc59e9c940b35d172eac573f03bd2c67c39b7a156c7235a6e9ba467219"
	I0304 11:49:28.556962  414887 cri.go:89] found id: "6892c252ec0fed99964259967ea10a0d8ca8e03d36de5566d3b218fa37cc62e6"
	I0304 11:49:28.556964  414887 cri.go:89] found id: "76a66d6787fb1782cfc112eca09180bd6e640c954d95a8a7f2da6766015c44ff"
	I0304 11:49:28.556976  414887 cri.go:89] found id: "195bf410fc37fd94b3ebd374fc680f3de89e2824c2a191d4d1b1b77d0574ca05"
	I0304 11:49:28.556980  414887 cri.go:89] found id: "39af1283f5b868ffe89f7c56989063c73dfe578e2c61ffb061397046e94254a4"
	I0304 11:49:28.556982  414887 cri.go:89] found id: "3072dbc893d97a45df97f637d3329964d0f3c0d2bfd84d0abef6cd59b84b09a2"
	I0304 11:49:28.556985  414887 cri.go:89] found id: "28026efcbba8c4bb3c8fd1bbb9516c76c7aa849685cd4e79963aae91db46b3fa"
	I0304 11:49:28.556988  414887 cri.go:89] found id: "f1554dfb6758d09a3da25367cbdb55969eddab94b8f86875539f364adc451778"
	I0304 11:49:28.556993  414887 cri.go:89] found id: "ec425e9be9916c05a1de7912fd7c746a9694e7244b0103cbdd475908a65849e5"
	I0304 11:49:28.556996  414887 cri.go:89] found id: "ab441c3a89cf4277af6d68ab05c84601f4d7329f9a5e71a956ae43037dd8ed5f"
	I0304 11:49:28.556999  414887 cri.go:89] found id: "290286ddcebc3552c8b82150f8568464609b6066a2389799cb2df56e4a8f7445"
	I0304 11:49:28.557003  414887 cri.go:89] found id: "8a9996107fda7254c7e92a44159d2f25f966c65eacee8764573c09ddc214471b"
	I0304 11:49:28.557005  414887 cri.go:89] found id: "aee137a866e7b5068ad152a72a43dba65d53df6dea4a74d3b998a58e03a1d017"
	I0304 11:49:28.557008  414887 cri.go:89] found id: "37a43e65f90fb73964292dc02401cf414b631c8de8a5a71b71f5fa36734e49da"
	I0304 11:49:28.557013  414887 cri.go:89] found id: "e1ce9291c9551d537e0322399929aad9bcf8c4cbea0bddecf12315bedee5c63f"
	I0304 11:49:28.557016  414887 cri.go:89] found id: "14ddd4820fa928efc9c0709541d7d4920e4ec4e0643dec69ca95c924d01edc9e"
	I0304 11:49:28.557019  414887 cri.go:89] found id: ""
	I0304 11:49:28.557066  414887 ssh_runner.go:195] Run: sudo runc list -f json
	I0304 11:49:28.614549  414887 out.go:177] 
	W0304 11:49:28.615838  414887 out.go:239] X Exiting due to MK_ADDON_ENABLE_PAUSED: enabled failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
	stdout:
	
	stderr:
	time="2024-03-04T11:49:28Z" level=error msg="stat /run/runc/76a66d6787fb1782cfc112eca09180bd6e640c954d95a8a7f2da6766015c44ff: no such file or directory"
	
	X Exiting due to MK_ADDON_ENABLE_PAUSED: enabled failed: check paused: list paused: runc: sudo runc list -f json: Process exited with status 1
	stdout:
	
	stderr:
	time="2024-03-04T11:49:28Z" level=error msg="stat /run/runc/76a66d6787fb1782cfc112eca09180bd6e640c954d95a8a7f2da6766015c44ff: no such file or directory"
	
	W0304 11:49:28.615861  414887 out.go:239] * 
	* 
	W0304 11:49:28.622327  414887 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_addons_af3b8a9ce4f102efc219f1404c9eed7a69cbf2d5_1.log                  │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_addons_af3b8a9ce4f102efc219f1404c9eed7a69cbf2d5_1.log                  │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯
	I0304 11:49:28.624296  414887 out.go:177] 

                                                
                                                
** /stderr **
addons_test.go:826: failed to enable headlamp addon: args: "out/minikube-linux-amd64 addons enable headlamp -p addons-975865 --alsologtostderr -v=1": exit status 11
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestAddons/parallel/Headlamp]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect addons-975865
helpers_test.go:235: (dbg) docker inspect addons-975865:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "89c01ac9a8151395a60453aa534f39efedae7b9a9a00081eb711e101e4ec0822",
	        "Created": "2024-03-04T11:47:28.217220092Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 405771,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2024-03-04T11:47:28.4851528Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:a5b872dc86053f77fb58d93168e89c4b0fa5961a7ed628d630f6cd6decd7bca0",
	        "ResolvConfPath": "/var/lib/docker/containers/89c01ac9a8151395a60453aa534f39efedae7b9a9a00081eb711e101e4ec0822/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/89c01ac9a8151395a60453aa534f39efedae7b9a9a00081eb711e101e4ec0822/hostname",
	        "HostsPath": "/var/lib/docker/containers/89c01ac9a8151395a60453aa534f39efedae7b9a9a00081eb711e101e4ec0822/hosts",
	        "LogPath": "/var/lib/docker/containers/89c01ac9a8151395a60453aa534f39efedae7b9a9a00081eb711e101e4ec0822/89c01ac9a8151395a60453aa534f39efedae7b9a9a00081eb711e101e4ec0822-json.log",
	        "Name": "/addons-975865",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "addons-975865:/var",
	                "/lib/modules:/lib/modules:ro"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "addons-975865",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4194304000,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8388608000,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/253033a75c16ac5a48ed46bd3191215abb9e05a7e4bde3c4b78dd1c214dc30ad-init/diff:/var/lib/docker/overlay2/6777c34f254c285e28a6f05fba96b29f9919e3bc636ac1ce063284fa05399be2/diff",
	                "MergedDir": "/var/lib/docker/overlay2/253033a75c16ac5a48ed46bd3191215abb9e05a7e4bde3c4b78dd1c214dc30ad/merged",
	                "UpperDir": "/var/lib/docker/overlay2/253033a75c16ac5a48ed46bd3191215abb9e05a7e4bde3c4b78dd1c214dc30ad/diff",
	                "WorkDir": "/var/lib/docker/overlay2/253033a75c16ac5a48ed46bd3191215abb9e05a7e4bde3c4b78dd1c214dc30ad/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "volume",
	                "Name": "addons-975865",
	                "Source": "/var/lib/docker/volumes/addons-975865/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            },
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            }
	        ],
	        "Config": {
	            "Hostname": "addons-975865",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "addons-975865",
	                "name.minikube.sigs.k8s.io": "addons-975865",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "3c90a56b0ec89e5133468e4c04a5bb975d9d3e0a7654dd94bcba3071c4f43d24",
	            "SandboxKey": "/var/run/docker/netns/3c90a56b0ec8",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32772"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32771"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32768"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32770"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32769"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "addons-975865": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "89c01ac9a815",
	                        "addons-975865"
	                    ],
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "NetworkID": "f4830c9d5cd160b632f2898af432c4b95a45a24a8479cf1921e5a84d1f69222d",
	                    "EndpointID": "ccb85eaef81a21887717b52abb827d886ff825808f8574ddf6039376acf21f0b",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DriverOpts": null,
	                    "DNSNames": [
	                        "addons-975865",
	                        "89c01ac9a815"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p addons-975865 -n addons-975865
helpers_test.go:244: <<< TestAddons/parallel/Headlamp FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestAddons/parallel/Headlamp]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p addons-975865 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p addons-975865 logs -n 25: (1.608152462s)
helpers_test.go:252: TestAddons/parallel/Headlamp logs: 
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| Command |                 Args                 |        Profile         |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only              | download-only-451004   | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC |                     |
	|         | -p download-only-451004              |                        |         |         |                     |                     |
	|         | --force --alsologtostderr            |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0         |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	| delete  | --all                                | minikube               | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC | 04 Mar 24 11:46 UTC |
	| delete  | -p download-only-451004              | download-only-451004   | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC | 04 Mar 24 11:46 UTC |
	| start   | -o=json --download-only              | download-only-239468   | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC |                     |
	|         | -p download-only-239468              |                        |         |         |                     |                     |
	|         | --force --alsologtostderr            |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.28.4         |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	| delete  | --all                                | minikube               | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC | 04 Mar 24 11:46 UTC |
	| delete  | -p download-only-239468              | download-only-239468   | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC | 04 Mar 24 11:46 UTC |
	| start   | -o=json --download-only              | download-only-675340   | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC |                     |
	|         | -p download-only-675340              |                        |         |         |                     |                     |
	|         | --force --alsologtostderr            |                        |         |         |                     |                     |
	|         | --kubernetes-version=v1.29.0-rc.2    |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	| delete  | --all                                | minikube               | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC | 04 Mar 24 11:47 UTC |
	| delete  | -p download-only-675340              | download-only-675340   | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC | 04 Mar 24 11:47 UTC |
	| delete  | -p download-only-451004              | download-only-451004   | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC | 04 Mar 24 11:47 UTC |
	| delete  | -p download-only-239468              | download-only-239468   | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC | 04 Mar 24 11:47 UTC |
	| delete  | -p download-only-675340              | download-only-675340   | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC | 04 Mar 24 11:47 UTC |
	| start   | --download-only -p                   | download-docker-291405 | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC |                     |
	|         | download-docker-291405               |                        |         |         |                     |                     |
	|         | --alsologtostderr                    |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	| delete  | -p download-docker-291405            | download-docker-291405 | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC | 04 Mar 24 11:47 UTC |
	| start   | --download-only -p                   | binary-mirror-624411   | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC |                     |
	|         | binary-mirror-624411                 |                        |         |         |                     |                     |
	|         | --alsologtostderr                    |                        |         |         |                     |                     |
	|         | --binary-mirror                      |                        |         |         |                     |                     |
	|         | http://127.0.0.1:34831               |                        |         |         |                     |                     |
	|         | --driver=docker                      |                        |         |         |                     |                     |
	|         | --container-runtime=crio             |                        |         |         |                     |                     |
	| delete  | -p binary-mirror-624411              | binary-mirror-624411   | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC | 04 Mar 24 11:47 UTC |
	| addons  | enable dashboard -p                  | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC |                     |
	|         | addons-975865                        |                        |         |         |                     |                     |
	| addons  | disable dashboard -p                 | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC |                     |
	|         | addons-975865                        |                        |         |         |                     |                     |
	| start   | -p addons-975865 --wait=true         | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:47 UTC | 04 Mar 24 11:49 UTC |
	|         | --memory=4000 --alsologtostderr      |                        |         |         |                     |                     |
	|         | --addons=registry                    |                        |         |         |                     |                     |
	|         | --addons=metrics-server              |                        |         |         |                     |                     |
	|         | --addons=volumesnapshots             |                        |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver         |                        |         |         |                     |                     |
	|         | --addons=gcp-auth                    |                        |         |         |                     |                     |
	|         | --addons=cloud-spanner               |                        |         |         |                     |                     |
	|         | --addons=inspektor-gadget            |                        |         |         |                     |                     |
	|         | --addons=storage-provisioner-rancher |                        |         |         |                     |                     |
	|         | --addons=nvidia-device-plugin        |                        |         |         |                     |                     |
	|         | --addons=yakd --driver=docker        |                        |         |         |                     |                     |
	|         |  --container-runtime=crio            |                        |         |         |                     |                     |
	|         | --addons=ingress                     |                        |         |         |                     |                     |
	|         | --addons=ingress-dns                 |                        |         |         |                     |                     |
	|         | --addons=helm-tiller                 |                        |         |         |                     |                     |
	| addons  | disable nvidia-device-plugin         | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:49 UTC | 04 Mar 24 11:49 UTC |
	|         | -p addons-975865                     |                        |         |         |                     |                     |
	| addons  | addons-975865 addons disable         | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:49 UTC | 04 Mar 24 11:49 UTC |
	|         | helm-tiller --alsologtostderr        |                        |         |         |                     |                     |
	|         | -v=1                                 |                        |         |         |                     |                     |
	| addons  | addons-975865 addons                 | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:49 UTC | 04 Mar 24 11:49 UTC |
	|         | disable metrics-server               |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1               |                        |         |         |                     |                     |
	| ip      | addons-975865 ip                     | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:49 UTC | 04 Mar 24 11:49 UTC |
	| addons  | addons-975865 addons disable         | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:49 UTC | 04 Mar 24 11:49 UTC |
	|         | registry --alsologtostderr           |                        |         |         |                     |                     |
	|         | -v=1                                 |                        |         |         |                     |                     |
	| addons  | enable headlamp                      | addons-975865          | jenkins | v1.32.0 | 04 Mar 24 11:49 UTC |                     |
	|         | -p addons-975865                     |                        |         |         |                     |                     |
	|         | --alsologtostderr -v=1               |                        |         |         |                     |                     |
	|---------|--------------------------------------|------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/04 11:47:06
	Running on machine: ubuntu-20-agent-13
	Binary: Built with gc go1.22.0 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0304 11:47:06.988340  405110 out.go:291] Setting OutFile to fd 1 ...
	I0304 11:47:06.988575  405110 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 11:47:06.988584  405110 out.go:304] Setting ErrFile to fd 2...
	I0304 11:47:06.988588  405110 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 11:47:06.988779  405110 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18284-396872/.minikube/bin
	I0304 11:47:06.989396  405110 out.go:298] Setting JSON to false
	I0304 11:47:06.990274  405110 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":41376,"bootTime":1709511451,"procs":174,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1052-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0304 11:47:06.990339  405110 start.go:139] virtualization: kvm guest
	I0304 11:47:06.992610  405110 out.go:177] * [addons-975865] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
	I0304 11:47:06.994053  405110 out.go:177]   - MINIKUBE_LOCATION=18284
	I0304 11:47:06.994057  405110 notify.go:220] Checking for updates...
	I0304 11:47:06.995393  405110 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 11:47:06.996959  405110 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/18284-396872/kubeconfig
	I0304 11:47:06.998325  405110 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/18284-396872/.minikube
	I0304 11:47:06.999572  405110 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0304 11:47:07.000930  405110 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 11:47:07.002283  405110 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 11:47:07.023655  405110 docker.go:122] docker version: linux-25.0.3:Docker Engine - Community
	I0304 11:47:07.023761  405110 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0304 11:47:07.072632  405110 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:50 SystemTime:2024-03-04 11:47:07.064043148 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1052-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-13 Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerEr
rors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.6] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0304 11:47:07.072739  405110 docker.go:295] overlay module found
	I0304 11:47:07.074605  405110 out.go:177] * Using the docker driver based on user configuration
	I0304 11:47:07.076060  405110 start.go:299] selected driver: docker
	I0304 11:47:07.076079  405110 start.go:903] validating driver "docker" against <nil>
	I0304 11:47:07.076091  405110 start.go:914] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 11:47:07.076850  405110 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0304 11:47:07.126412  405110 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:50 SystemTime:2024-03-04 11:47:07.118238899 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1052-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-13 Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerEr
rors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.6] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0304 11:47:07.126647  405110 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I0304 11:47:07.126916  405110 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 11:47:07.128687  405110 out.go:177] * Using Docker driver with root privileges
	I0304 11:47:07.130257  405110 cni.go:84] Creating CNI manager for ""
	I0304 11:47:07.130279  405110 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0304 11:47:07.130292  405110 start_flags.go:318] Found "CNI" CNI - setting NetworkPlugin=cni
	I0304 11:47:07.130308  405110 start_flags.go:323] config:
	{Name:addons-975865 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:addons-975865 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRI
Socket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 11:47:07.131882  405110 out.go:177] * Starting control plane node addons-975865 in cluster addons-975865
	I0304 11:47:07.133092  405110 cache.go:121] Beginning downloading kic base image for docker with crio
	I0304 11:47:07.134373  405110 out.go:177] * Pulling base image v0.0.42-1708944392-18244 ...
	I0304 11:47:07.135430  405110 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
	I0304 11:47:07.135458  405110 preload.go:148] Found local preload: /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4
	I0304 11:47:07.135470  405110 cache.go:56] Caching tarball of preloaded images
	I0304 11:47:07.135540  405110 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon
	I0304 11:47:07.135577  405110 preload.go:174] Found /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
	I0304 11:47:07.135593  405110 cache.go:59] Finished verifying existence of preloaded tar for  v1.28.4 on crio
	I0304 11:47:07.135923  405110 profile.go:148] Saving config to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/config.json ...
	I0304 11:47:07.135949  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/config.json: {Name:mk3f00c0f4322abdd4f1128affae9fcc3b49acd7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:07.150541  405110 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 to local cache
	I0304 11:47:07.150672  405110 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local cache directory
	I0304 11:47:07.150690  405110 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local cache directory, skipping pull
	I0304 11:47:07.150694  405110 image.go:105] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 exists in cache, skipping pull
	I0304 11:47:07.150702  405110 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 as a tarball
	I0304 11:47:07.150707  405110 cache.go:162] Loading gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 from local cache
	I0304 11:47:19.683893  405110 cache.go:164] successfully loaded and using gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 from cached tarball
	I0304 11:47:19.683949  405110 cache.go:194] Successfully downloaded all kic artifacts
	I0304 11:47:19.683989  405110 start.go:365] acquiring machines lock for addons-975865: {Name:mk7f1f17845ce0ed3897db6ffbca47361b4bc960 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 11:47:19.684099  405110 start.go:369] acquired machines lock for "addons-975865" in 88.884µs
	I0304 11:47:19.684125  405110 start.go:93] Provisioning new machine with config: &{Name:addons-975865 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:addons-975865 Namespace:default APIServerName:minikubeCA A
PIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disabl
eMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0304 11:47:19.684231  405110 start.go:125] createHost starting for "" (driver="docker")
	I0304 11:47:19.745217  405110 out.go:204] * Creating docker container (CPUs=2, Memory=4000MB) ...
	I0304 11:47:19.745586  405110 start.go:159] libmachine.API.Create for "addons-975865" (driver="docker")
	I0304 11:47:19.745627  405110 client.go:168] LocalClient.Create starting
	I0304 11:47:19.745827  405110 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem
	I0304 11:47:20.206770  405110 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/cert.pem
	I0304 11:47:20.316630  405110 cli_runner.go:164] Run: docker network inspect addons-975865 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0304 11:47:20.332800  405110 cli_runner.go:211] docker network inspect addons-975865 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0304 11:47:20.332892  405110 network_create.go:281] running [docker network inspect addons-975865] to gather additional debugging logs...
	I0304 11:47:20.332919  405110 cli_runner.go:164] Run: docker network inspect addons-975865
	W0304 11:47:20.347994  405110 cli_runner.go:211] docker network inspect addons-975865 returned with exit code 1
	I0304 11:47:20.348033  405110 network_create.go:284] error running [docker network inspect addons-975865]: docker network inspect addons-975865: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network addons-975865 not found
	I0304 11:47:20.348061  405110 network_create.go:286] output of [docker network inspect addons-975865]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network addons-975865 not found
	
	** /stderr **
	I0304 11:47:20.348230  405110 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0304 11:47:20.363345  405110 network.go:207] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00314ee60}
	I0304 11:47:20.363400  405110 network_create.go:124] attempt to create docker network addons-975865 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0304 11:47:20.363452  405110 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=addons-975865 addons-975865
	I0304 11:47:20.671371  405110 network_create.go:108] docker network addons-975865 192.168.49.0/24 created
	I0304 11:47:20.671406  405110 kic.go:121] calculated static IP "192.168.49.2" for the "addons-975865" container
	I0304 11:47:20.671459  405110 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0304 11:47:20.686372  405110 cli_runner.go:164] Run: docker volume create addons-975865 --label name.minikube.sigs.k8s.io=addons-975865 --label created_by.minikube.sigs.k8s.io=true
	I0304 11:47:20.798695  405110 oci.go:103] Successfully created a docker volume addons-975865
	I0304 11:47:20.798777  405110 cli_runner.go:164] Run: docker run --rm --name addons-975865-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-975865 --entrypoint /usr/bin/test -v addons-975865:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -d /var/lib
	I0304 11:47:23.071096  405110 cli_runner.go:217] Completed: docker run --rm --name addons-975865-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-975865 --entrypoint /usr/bin/test -v addons-975865:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -d /var/lib: (2.272273091s)
	I0304 11:47:23.071126  405110 oci.go:107] Successfully prepared a docker volume addons-975865
	I0304 11:47:23.071153  405110 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
	I0304 11:47:23.071174  405110 kic.go:194] Starting extracting preloaded images to volume ...
	I0304 11:47:23.071242  405110 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v addons-975865:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -I lz4 -xf /preloaded.tar -C /extractDir
	I0304 11:47:28.151505  405110 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v addons-975865:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -I lz4 -xf /preloaded.tar -C /extractDir: (5.080223086s)
	I0304 11:47:28.151540  405110 kic.go:203] duration metric: took 5.080361 seconds to extract preloaded images to volume
	W0304 11:47:28.151672  405110 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0304 11:47:28.151774  405110 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0304 11:47:28.203351  405110 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname addons-975865 --name addons-975865 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=addons-975865 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=addons-975865 --network addons-975865 --ip 192.168.49.2 --volume addons-975865:/var --security-opt apparmor=unconfined --memory=4000mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08
	I0304 11:47:28.491998  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Running}}
	I0304 11:47:28.508553  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:28.525427  405110 cli_runner.go:164] Run: docker exec addons-975865 stat /var/lib/dpkg/alternatives/iptables
	I0304 11:47:28.564349  405110 oci.go:144] the created container "addons-975865" has a running status.
	I0304 11:47:28.564390  405110 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa...
	I0304 11:47:28.934240  405110 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0304 11:47:28.957820  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:28.974277  405110 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0304 11:47:28.974300  405110 kic_runner.go:114] Args: [docker exec --privileged addons-975865 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0304 11:47:29.011820  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:29.027682  405110 machine.go:88] provisioning docker machine ...
	I0304 11:47:29.027721  405110 ubuntu.go:169] provisioning hostname "addons-975865"
	I0304 11:47:29.027781  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:29.046147  405110 main.go:141] libmachine: Using SSH client type: native
	I0304 11:47:29.046353  405110 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil>  [] 0s} 127.0.0.1 32772 <nil> <nil>}
	I0304 11:47:29.046367  405110 main.go:141] libmachine: About to run SSH command:
	sudo hostname addons-975865 && echo "addons-975865" | sudo tee /etc/hostname
	I0304 11:47:29.186222  405110 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-975865
	
	I0304 11:47:29.186320  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:29.204008  405110 main.go:141] libmachine: Using SSH client type: native
	I0304 11:47:29.204191  405110 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil>  [] 0s} 127.0.0.1 32772 <nil> <nil>}
	I0304 11:47:29.204209  405110 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\saddons-975865' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-975865/g' /etc/hosts;
				else 
					echo '127.0.1.1 addons-975865' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0304 11:47:29.317859  405110 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0304 11:47:29.317900  405110 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18284-396872/.minikube CaCertPath:/home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18284-396872/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18284-396872/.minikube}
	I0304 11:47:29.317924  405110 ubuntu.go:177] setting up certificates
	I0304 11:47:29.317937  405110 provision.go:83] configureAuth start
	I0304 11:47:29.318005  405110 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-975865
	I0304 11:47:29.333780  405110 provision.go:138] copyHostCerts
	I0304 11:47:29.333858  405110 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18284-396872/.minikube/key.pem (1679 bytes)
	I0304 11:47:29.333989  405110 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18284-396872/.minikube/ca.pem (1082 bytes)
	I0304 11:47:29.334064  405110 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18284-396872/.minikube/cert.pem (1123 bytes)
	I0304 11:47:29.334140  405110 provision.go:112] generating server cert: /home/jenkins/minikube-integration/18284-396872/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca-key.pem org=jenkins.addons-975865 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube addons-975865]
	I0304 11:47:29.602955  405110 provision.go:172] copyRemoteCerts
	I0304 11:47:29.603015  405110 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0304 11:47:29.603055  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:29.619060  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:29.702061  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0304 11:47:29.722869  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/machines/server.pem --> /etc/docker/server.pem (1216 bytes)
	I0304 11:47:29.743224  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0304 11:47:29.763673  405110 provision.go:86] duration metric: configureAuth took 445.718609ms
	I0304 11:47:29.763704  405110 ubuntu.go:193] setting minikube options for container-runtime
	I0304 11:47:29.763893  405110 config.go:182] Loaded profile config "addons-975865": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
	I0304 11:47:29.764001  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:29.779723  405110 main.go:141] libmachine: Using SSH client type: native
	I0304 11:47:29.779897  405110 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil>  [] 0s} 127.0.0.1 32772 <nil> <nil>}
	I0304 11:47:29.779913  405110 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0304 11:47:29.976164  405110 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0304 11:47:29.976197  405110 machine.go:91] provisioned docker machine in 948.490773ms
	I0304 11:47:29.976210  405110 client.go:171] LocalClient.Create took 10.230574681s
	I0304 11:47:29.976226  405110 start.go:167] duration metric: libmachine.API.Create for "addons-975865" took 10.230643781s
	I0304 11:47:29.976236  405110 start.go:300] post-start starting for "addons-975865" (driver="docker")
	I0304 11:47:29.976249  405110 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0304 11:47:29.976370  405110 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0304 11:47:29.976441  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:29.992480  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:30.078920  405110 ssh_runner.go:195] Run: cat /etc/os-release
	I0304 11:47:30.081992  405110 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0304 11:47:30.082022  405110 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0304 11:47:30.082032  405110 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0304 11:47:30.082038  405110 info.go:137] Remote host: Ubuntu 22.04.3 LTS
	I0304 11:47:30.082056  405110 filesync.go:126] Scanning /home/jenkins/minikube-integration/18284-396872/.minikube/addons for local assets ...
	I0304 11:47:30.082148  405110 filesync.go:126] Scanning /home/jenkins/minikube-integration/18284-396872/.minikube/files for local assets ...
	I0304 11:47:30.082176  405110 start.go:303] post-start completed in 105.934632ms
	I0304 11:47:30.082524  405110 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-975865
	I0304 11:47:30.099512  405110 profile.go:148] Saving config to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/config.json ...
	I0304 11:47:30.099743  405110 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0304 11:47:30.099789  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:30.115041  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:30.194622  405110 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0304 11:47:30.198654  405110 start.go:128] duration metric: createHost completed in 10.51440593s
	I0304 11:47:30.198680  405110 start.go:83] releasing machines lock for "addons-975865", held for 10.514568384s
	I0304 11:47:30.198750  405110 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" addons-975865
	I0304 11:47:30.214400  405110 ssh_runner.go:195] Run: cat /version.json
	I0304 11:47:30.214418  405110 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0304 11:47:30.214454  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:30.214474  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:30.231675  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:30.232848  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:30.380067  405110 ssh_runner.go:195] Run: systemctl --version
	I0304 11:47:30.383975  405110 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0304 11:47:30.519789  405110 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0304 11:47:30.523956  405110 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0304 11:47:30.541013  405110 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0304 11:47:30.541095  405110 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0304 11:47:30.565879  405110 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0304 11:47:30.565900  405110 start.go:475] detecting cgroup driver to use...
	I0304 11:47:30.565928  405110 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0304 11:47:30.565965  405110 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0304 11:47:30.578810  405110 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0304 11:47:30.588322  405110 docker.go:217] disabling cri-docker service (if available) ...
	I0304 11:47:30.588366  405110 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0304 11:47:30.600375  405110 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0304 11:47:30.612196  405110 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0304 11:47:30.682747  405110 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0304 11:47:30.754382  405110 docker.go:233] disabling docker service ...
	I0304 11:47:30.754441  405110 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0304 11:47:30.772169  405110 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0304 11:47:30.781654  405110 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0304 11:47:30.854489  405110 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0304 11:47:30.932383  405110 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0304 11:47:30.941914  405110 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0304 11:47:30.955467  405110 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...
	I0304 11:47:30.955517  405110 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0304 11:47:30.963851  405110 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
	I0304 11:47:30.963899  405110 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0304 11:47:30.971987  405110 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0304 11:47:30.980115  405110 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0304 11:47:30.988025  405110 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0304 11:47:30.995412  405110 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0304 11:47:31.002322  405110 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0304 11:47:31.009087  405110 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0304 11:47:31.078241  405110 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0304 11:47:31.197604  405110 start.go:522] Will wait 60s for socket path /var/run/crio/crio.sock
	I0304 11:47:31.197690  405110 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0304 11:47:31.201014  405110 start.go:543] Will wait 60s for crictl version
	I0304 11:47:31.201057  405110 ssh_runner.go:195] Run: which crictl
	I0304 11:47:31.204108  405110 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0304 11:47:31.236308  405110 start.go:559] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0304 11:47:31.236384  405110 ssh_runner.go:195] Run: crio --version
	I0304 11:47:31.269672  405110 ssh_runner.go:195] Run: crio --version
	I0304 11:47:31.304683  405110 out.go:177] * Preparing Kubernetes v1.28.4 on CRI-O 1.24.6 ...
	I0304 11:47:31.306027  405110 cli_runner.go:164] Run: docker network inspect addons-975865 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0304 11:47:31.321137  405110 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0304 11:47:31.324468  405110 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0304 11:47:31.334168  405110 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime crio
	I0304 11:47:31.334228  405110 ssh_runner.go:195] Run: sudo crictl images --output json
	I0304 11:47:31.391168  405110 crio.go:496] all images are preloaded for cri-o runtime.
	I0304 11:47:31.391191  405110 crio.go:415] Images already preloaded, skipping extraction
	I0304 11:47:31.391234  405110 ssh_runner.go:195] Run: sudo crictl images --output json
	I0304 11:47:31.421901  405110 crio.go:496] all images are preloaded for cri-o runtime.
	I0304 11:47:31.421923  405110 cache_images.go:84] Images are preloaded, skipping loading
	I0304 11:47:31.422010  405110 ssh_runner.go:195] Run: crio config
	I0304 11:47:31.463157  405110 cni.go:84] Creating CNI manager for ""
	I0304 11:47:31.463185  405110 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0304 11:47:31.463208  405110 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0304 11:47:31.463234  405110 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.28.4 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-975865 NodeName:addons-975865 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kuberne
tes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}
	I0304 11:47:31.463410  405110 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: unix:///var/run/crio/crio.sock
	  name: "addons-975865"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta3
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.28.4
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0304 11:47:31.463527  405110 kubeadm.go:976] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.28.4/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=addons-975865 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.28.4 ClusterName:addons-975865 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0304 11:47:31.463594  405110 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.28.4
	I0304 11:47:31.471473  405110 binaries.go:44] Found k8s binaries, skipping transfer
	I0304 11:47:31.471538  405110 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0304 11:47:31.479093  405110 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (423 bytes)
	I0304 11:47:31.494299  405110 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)
	I0304 11:47:31.509807  405110 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2094 bytes)
	I0304 11:47:31.524998  405110 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0304 11:47:31.527811  405110 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0304 11:47:31.536844  405110 certs.go:56] Setting up /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865 for IP: 192.168.49.2
	I0304 11:47:31.536872  405110 certs.go:190] acquiring lock for shared ca certs: {Name:mk5c6efb4e5160f77d4a7ed847715b71b13576b2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.536991  405110 certs.go:204] generating minikubeCA CA: /home/jenkins/minikube-integration/18284-396872/.minikube/ca.key
	I0304 11:47:31.597291  405110 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt ...
	I0304 11:47:31.597321  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt: {Name:mk527fa21905de3da04822f225503376de5b070d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.597510  405110 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18284-396872/.minikube/ca.key ...
	I0304 11:47:31.597528  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/ca.key: {Name:mk5fbb52f995b3dbbf13bfa4c1fa9a85f66dcb7f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.597729  405110 certs.go:204] generating proxyClientCA CA: /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.key
	I0304 11:47:31.658282  405110 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.crt ...
	I0304 11:47:31.658304  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.crt: {Name:mk8e4209d54d9fb7d1f32971d3ce2d86f3ddce91 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.658455  405110 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.key ...
	I0304 11:47:31.658469  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.key: {Name:mkf1cf515da76cd9f08b577f56a6ca1bd1e26bf3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.658599  405110 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.key
	I0304 11:47:31.658614  405110 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt with IP's: []
	I0304 11:47:31.760787  405110 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt ...
	I0304 11:47:31.760823  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: {Name:mk65d9066c469fe1cb3e07d25448787a1c5eca6c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.761011  405110 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.key ...
	I0304 11:47:31.761026  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.key: {Name:mk84a514d2f88045a2a84ab0ed23693ef3afcc9e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.761121  405110 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.key.dd3b5fb2
	I0304 11:47:31.761155  405110 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0304 11:47:31.822978  405110 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.crt.dd3b5fb2 ...
	I0304 11:47:31.823015  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.crt.dd3b5fb2: {Name:mk331bbfc5b6c9bb8e7ea6172cc5f1f858dba99b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.823199  405110 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.key.dd3b5fb2 ...
	I0304 11:47:31.823218  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.key.dd3b5fb2: {Name:mk928d79f10799cd15090509253ef8044bf21d4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.823317  405110 certs.go:337] copying /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.crt
	I0304 11:47:31.823422  405110 certs.go:341] copying /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.key
	I0304 11:47:31.823490  405110 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/proxy-client.key
	I0304 11:47:31.823515  405110 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/proxy-client.crt with IP's: []
	I0304 11:47:31.915630  405110 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/proxy-client.crt ...
	I0304 11:47:31.915666  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/proxy-client.crt: {Name:mk7be1ebdf5ddc3631b099ebd985181c7ebf4caa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.915859  405110 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/proxy-client.key ...
	I0304 11:47:31.915881  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/proxy-client.key: {Name:mkc64f62a316b99be4af0764f2f356e184d1e530 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:31.916080  405110 certs.go:437] found cert: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca-key.pem (1679 bytes)
	I0304 11:47:31.916138  405110 certs.go:437] found cert: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem (1082 bytes)
	I0304 11:47:31.916179  405110 certs.go:437] found cert: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/home/jenkins/minikube-integration/18284-396872/.minikube/certs/cert.pem (1123 bytes)
	I0304 11:47:31.916214  405110 certs.go:437] found cert: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/home/jenkins/minikube-integration/18284-396872/.minikube/certs/key.pem (1679 bytes)
	I0304 11:47:31.916879  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0304 11:47:31.938658  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)
	I0304 11:47:31.959370  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0304 11:47:31.980046  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0304 11:47:32.000742  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0304 11:47:32.021193  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0304 11:47:32.041572  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0304 11:47:32.062065  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0304 11:47:32.081921  405110 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0304 11:47:32.101972  405110 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0304 11:47:32.116887  405110 ssh_runner.go:195] Run: openssl version
	I0304 11:47:32.121702  405110 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0304 11:47:32.129881  405110 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0304 11:47:32.132877  405110 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Mar  4 11:47 /usr/share/ca-certificates/minikubeCA.pem
	I0304 11:47:32.132926  405110 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0304 11:47:32.138960  405110 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0304 11:47:32.146910  405110 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0304 11:47:32.149810  405110 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I0304 11:47:32.149877  405110 kubeadm.go:404] StartCluster: {Name:addons-975865 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:addons-975865 Namespace:default APIServerName:minikubeCA APIServerNames:[] APISe
rverIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:f
alse CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 11:47:32.149976  405110 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0304 11:47:32.150029  405110 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0304 11:47:32.182720  405110 cri.go:89] found id: ""
	I0304 11:47:32.182798  405110 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0304 11:47:32.190727  405110 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0304 11:47:32.198830  405110 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I0304 11:47:32.198889  405110 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0304 11:47:32.206183  405110 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0304 11:47:32.206227  405110 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.28.4:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0304 11:47:32.284013  405110 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1052-gcp\n", err: exit status 1
	I0304 11:47:32.345992  405110 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0304 11:47:41.966037  405110 kubeadm.go:322] [init] Using Kubernetes version: v1.28.4
	I0304 11:47:41.966159  405110 kubeadm.go:322] [preflight] Running pre-flight checks
	I0304 11:47:41.966310  405110 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I0304 11:47:41.966408  405110 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1052-gcp
	I0304 11:47:41.966443  405110 kubeadm.go:322] OS: Linux
	I0304 11:47:41.966502  405110 kubeadm.go:322] CGROUPS_CPU: enabled
	I0304 11:47:41.966557  405110 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I0304 11:47:41.966602  405110 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I0304 11:47:41.966642  405110 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I0304 11:47:41.966717  405110 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I0304 11:47:41.966801  405110 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I0304 11:47:41.966854  405110 kubeadm.go:322] CGROUPS_PIDS: enabled
	I0304 11:47:41.966923  405110 kubeadm.go:322] CGROUPS_HUGETLB: enabled
	I0304 11:47:41.966980  405110 kubeadm.go:322] CGROUPS_BLKIO: enabled
	I0304 11:47:41.967045  405110 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0304 11:47:41.967123  405110 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0304 11:47:41.967201  405110 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0304 11:47:41.967271  405110 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0304 11:47:41.968950  405110 out.go:204]   - Generating certificates and keys ...
	I0304 11:47:41.969036  405110 kubeadm.go:322] [certs] Using existing ca certificate authority
	I0304 11:47:41.969111  405110 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I0304 11:47:41.969174  405110 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0304 11:47:41.969233  405110 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I0304 11:47:41.969301  405110 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I0304 11:47:41.969345  405110 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I0304 11:47:41.969390  405110 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I0304 11:47:41.969496  405110 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [addons-975865 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0304 11:47:41.969544  405110 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I0304 11:47:41.969639  405110 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [addons-975865 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0304 11:47:41.969695  405110 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0304 11:47:41.969752  405110 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I0304 11:47:41.969788  405110 kubeadm.go:322] [certs] Generating "sa" key and public key
	I0304 11:47:41.969833  405110 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0304 11:47:41.969876  405110 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0304 11:47:41.969937  405110 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0304 11:47:41.970014  405110 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0304 11:47:41.970081  405110 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0304 11:47:41.970181  405110 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0304 11:47:41.970280  405110 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0304 11:47:41.971813  405110 out.go:204]   - Booting up control plane ...
	I0304 11:47:41.971887  405110 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0304 11:47:41.971954  405110 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0304 11:47:41.972011  405110 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0304 11:47:41.972095  405110 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0304 11:47:41.972187  405110 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0304 11:47:41.972232  405110 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I0304 11:47:41.972397  405110 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0304 11:47:41.972502  405110 kubeadm.go:322] [apiclient] All control plane components are healthy after 5.502163 seconds
	I0304 11:47:41.972651  405110 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0304 11:47:41.972824  405110 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster
	I0304 11:47:41.972914  405110 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I0304 11:47:41.973179  405110 kubeadm.go:322] [mark-control-plane] Marking the node addons-975865 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]
	I0304 11:47:41.973237  405110 kubeadm.go:322] [bootstrap-token] Using token: 9z6uuf.lw2hqqhls9qyf1u8
	I0304 11:47:41.974622  405110 out.go:204]   - Configuring RBAC rules ...
	I0304 11:47:41.974710  405110 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0304 11:47:41.974780  405110 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0304 11:47:41.974930  405110 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0304 11:47:41.975098  405110 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0304 11:47:41.975237  405110 kubeadm.go:322] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0304 11:47:41.975334  405110 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0304 11:47:41.975433  405110 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0304 11:47:41.975486  405110 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I0304 11:47:41.975525  405110 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I0304 11:47:41.975531  405110 kubeadm.go:322] 
	I0304 11:47:41.975582  405110 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I0304 11:47:41.975588  405110 kubeadm.go:322] 
	I0304 11:47:41.975655  405110 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I0304 11:47:41.975661  405110 kubeadm.go:322] 
	I0304 11:47:41.975681  405110 kubeadm.go:322]   mkdir -p $HOME/.kube
	I0304 11:47:41.975730  405110 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0304 11:47:41.975772  405110 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0304 11:47:41.975778  405110 kubeadm.go:322] 
	I0304 11:47:41.975826  405110 kubeadm.go:322] Alternatively, if you are the root user, you can run:
	I0304 11:47:41.975832  405110 kubeadm.go:322] 
	I0304 11:47:41.975870  405110 kubeadm.go:322]   export KUBECONFIG=/etc/kubernetes/admin.conf
	I0304 11:47:41.975876  405110 kubeadm.go:322] 
	I0304 11:47:41.975918  405110 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I0304 11:47:41.975979  405110 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0304 11:47:41.976036  405110 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0304 11:47:41.976042  405110 kubeadm.go:322] 
	I0304 11:47:41.976109  405110 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I0304 11:47:41.976175  405110 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I0304 11:47:41.976181  405110 kubeadm.go:322] 
	I0304 11:47:41.976281  405110 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token 9z6uuf.lw2hqqhls9qyf1u8 \
	I0304 11:47:41.976424  405110 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:a5b052ccc96434307975887cf00b655123d510584cfc7a3a600211bdeb8da90e \
	I0304 11:47:41.976444  405110 kubeadm.go:322] 	--control-plane 
	I0304 11:47:41.976450  405110 kubeadm.go:322] 
	I0304 11:47:41.976539  405110 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I0304 11:47:41.976551  405110 kubeadm.go:322] 
	I0304 11:47:41.976674  405110 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 9z6uuf.lw2hqqhls9qyf1u8 \
	I0304 11:47:41.976838  405110 kubeadm.go:322] 	--discovery-token-ca-cert-hash sha256:a5b052ccc96434307975887cf00b655123d510584cfc7a3a600211bdeb8da90e 
	I0304 11:47:41.976854  405110 cni.go:84] Creating CNI manager for ""
	I0304 11:47:41.976863  405110 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0304 11:47:41.978365  405110 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0304 11:47:41.979627  405110 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0304 11:47:41.983316  405110 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.28.4/kubectl ...
	I0304 11:47:41.983332  405110 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
	I0304 11:47:41.999731  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0304 11:47:42.613252  405110 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0304 11:47:42.613333  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:42.613406  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl label nodes minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=ab57ba9f65fd4cb3ac8815e4f9baeeca5604e645 minikube.k8s.io/name=addons-975865 minikube.k8s.io/updated_at=2024_03_04T11_47_42_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:42.706801  405110 ops.go:34] apiserver oom_adj: -16
	I0304 11:47:42.706922  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:43.207481  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:43.707234  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:44.207413  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:44.707078  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:45.207254  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:45.707689  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:46.207992  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:46.706974  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:47.207968  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:47.707011  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:48.207106  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:48.707212  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:49.207344  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:49.707634  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:50.207937  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:50.707407  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:51.207356  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:51.707359  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:52.207880  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:52.707241  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:53.207309  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:53.707385  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:54.207974  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:54.707244  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:55.206966  405110 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.28.4/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:47:55.272533  405110 kubeadm.go:1088] duration metric: took 12.659252926s to wait for elevateKubeSystemPrivileges.
	I0304 11:47:55.272576  405110 kubeadm.go:406] StartCluster complete in 23.122706356s
	I0304 11:47:55.272600  405110 settings.go:142] acquiring lock: {Name:mkdbf9b8466495a7e4be006d870bd7dffc473c0c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:55.272737  405110 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/18284-396872/kubeconfig
	I0304 11:47:55.273282  405110 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/kubeconfig: {Name:mkcbf3bf1380cc7c2802e86e24097181dc1a959a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:55.273534  405110 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0304 11:47:55.273659  405110 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:true inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volumesnapshots:true yakd:true]
	I0304 11:47:55.273755  405110 config.go:182] Loaded profile config "addons-975865": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
	I0304 11:47:55.273798  405110 addons.go:69] Setting ingress-dns=true in profile "addons-975865"
	I0304 11:47:55.273810  405110 addons.go:69] Setting inspektor-gadget=true in profile "addons-975865"
	I0304 11:47:55.273816  405110 addons.go:234] Setting addon ingress-dns=true in "addons-975865"
	I0304 11:47:55.273822  405110 addons.go:234] Setting addon inspektor-gadget=true in "addons-975865"
	I0304 11:47:55.273876  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.273881  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.274014  405110 addons.go:69] Setting metrics-server=true in profile "addons-975865"
	I0304 11:47:55.274027  405110 addons.go:234] Setting addon metrics-server=true in "addons-975865"
	I0304 11:47:55.274055  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.274241  405110 addons.go:69] Setting gcp-auth=true in profile "addons-975865"
	I0304 11:47:55.274281  405110 mustload.go:65] Loading cluster: addons-975865
	I0304 11:47:55.274288  405110 addons.go:69] Setting ingress=true in profile "addons-975865"
	I0304 11:47:55.274318  405110 addons.go:234] Setting addon ingress=true in "addons-975865"
	I0304 11:47:55.274374  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.274442  405110 config.go:182] Loaded profile config "addons-975865": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
	I0304 11:47:55.274453  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.274466  405110 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-975865"
	I0304 11:47:55.274480  405110 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-975865"
	I0304 11:47:55.274493  405110 addons.go:69] Setting helm-tiller=true in profile "addons-975865"
	I0304 11:47:55.274512  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.274514  405110 addons.go:234] Setting addon helm-tiller=true in "addons-975865"
	I0304 11:47:55.274558  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.274683  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.274828  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.273796  405110 addons.go:69] Setting yakd=true in profile "addons-975865"
	I0304 11:47:55.274897  405110 addons.go:234] Setting addon yakd=true in "addons-975865"
	I0304 11:47:55.274906  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.274937  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.274961  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.274980  405110 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-975865"
	I0304 11:47:55.275009  405110 addons.go:69] Setting storage-provisioner=true in profile "addons-975865"
	I0304 11:47:55.275037  405110 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-975865"
	I0304 11:47:55.275065  405110 addons.go:234] Setting addon storage-provisioner=true in "addons-975865"
	I0304 11:47:55.275075  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.275289  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.275795  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.276059  405110 addons.go:69] Setting default-storageclass=true in profile "addons-975865"
	I0304 11:47:55.276085  405110 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-975865"
	I0304 11:47:55.276393  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.276492  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.276576  405110 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-975865"
	I0304 11:47:55.276597  405110 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-975865"
	I0304 11:47:55.276867  405110 addons.go:69] Setting cloud-spanner=true in profile "addons-975865"
	I0304 11:47:55.276980  405110 addons.go:234] Setting addon cloud-spanner=true in "addons-975865"
	I0304 11:47:55.277144  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.277262  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.277713  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.278160  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.276856  405110 addons.go:69] Setting registry=true in profile "addons-975865"
	I0304 11:47:55.278789  405110 addons.go:234] Setting addon registry=true in "addons-975865"
	I0304 11:47:55.278863  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.279420  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.274454  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.280086  405110 addons.go:69] Setting volumesnapshots=true in profile "addons-975865"
	I0304 11:47:55.280109  405110 addons.go:234] Setting addon volumesnapshots=true in "addons-975865"
	I0304 11:47:55.280154  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.276868  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.304651  405110 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.10.0
	I0304 11:47:55.306081  405110 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0
	I0304 11:47:55.307578  405110 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0
	I0304 11:47:55.306801  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.309616  405110 addons.go:426] installing /etc/kubernetes/addons/ingress-deploy.yaml
	I0304 11:47:55.309672  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)
	I0304 11:47:55.309733  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.321039  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.326382  405110 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0304 11:47:55.329563  405110 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0304 11:47:55.329586  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0304 11:47:55.329655  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.333270  405110 out.go:177]   - Using image ghcr.io/helm/tiller:v2.17.0
	I0304 11:47:55.335547  405110 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-dp.yaml
	I0304 11:47:55.335569  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-dp.yaml (2422 bytes)
	I0304 11:47:55.335631  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.341208  405110 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.25.1
	I0304 11:47:55.344584  405110 addons.go:426] installing /etc/kubernetes/addons/ig-namespace.yaml
	I0304 11:47:55.344611  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)
	I0304 11:47:55.344669  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.344593  405110 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2
	I0304 11:47:55.346693  405110 addons.go:426] installing /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0304 11:47:55.344523  405110 addons.go:234] Setting addon default-storageclass=true in "addons-975865"
	I0304 11:47:55.346831  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.347783  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)
	I0304 11:47:55.347867  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.349458  405110 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.14
	I0304 11:47:55.351360  405110 addons.go:426] installing /etc/kubernetes/addons/deployment.yaml
	I0304 11:47:55.351380  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)
	I0304 11:47:55.351432  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.350402  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.362211  405110 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.14.4
	I0304 11:47:55.361028  405110 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-975865"
	I0304 11:47:55.365379  405110 addons.go:426] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0304 11:47:55.365582  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)
	I0304 11:47:55.365651  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.365862  405110 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0
	I0304 11:47:55.365955  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:47:55.367390  405110 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0
	I0304 11:47:55.367949  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:47:55.371218  405110 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0
	I0304 11:47:55.371300  405110 out.go:177]   - Using image docker.io/registry:2.8.3
	I0304 11:47:55.377300  405110 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.0
	I0304 11:47:55.375702  405110 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0
	I0304 11:47:55.378700  405110 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml
	I0304 11:47:55.380283  405110 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.5
	I0304 11:47:55.380302  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)
	I0304 11:47:55.382054  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.382286  405110 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0
	I0304 11:47:55.385428  405110 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0
	I0304 11:47:55.387459  405110 addons.go:426] installing /etc/kubernetes/addons/registry-rc.yaml
	I0304 11:47:55.387477  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)
	I0304 11:47:55.387536  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.387244  405110 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0
	I0304 11:47:55.389322  405110 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0
	I0304 11:47:55.391035  405110 addons.go:426] installing /etc/kubernetes/addons/rbac-external-attacher.yaml
	I0304 11:47:55.391061  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)
	I0304 11:47:55.391121  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.397320  405110 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0
	I0304 11:47:55.407110  405110 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml
	I0304 11:47:55.407140  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)
	I0304 11:47:55.407355  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.405496  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.420247  405110 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
	I0304 11:47:55.420275  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0304 11:47:55.420334  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.427170  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.427410  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.430009  405110 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22
	I0304 11:47:55.428286  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.431947  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.436090  405110 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.4
	I0304 11:47:55.437756  405110 out.go:177]   - Using image docker.io/busybox:stable
	I0304 11:47:55.439375  405110 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0304 11:47:55.439395  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)
	I0304 11:47:55.437575  405110 addons.go:426] installing /etc/kubernetes/addons/yakd-ns.yaml
	I0304 11:47:55.439458  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.439458  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)
	I0304 11:47:55.439523  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:47:55.454632  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.455209  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.464417  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.470329  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.470580  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.475842  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.476459  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.479181  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:47:55.491511  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	W0304 11:47:55.504806  405110 sshutil.go:64] dial failure (will retry): ssh: handshake failed: EOF
	I0304 11:47:55.504850  405110 retry.go:31] will retry after 287.041267ms: ssh: handshake failed: EOF
	I0304 11:47:55.522306  405110 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0304 11:47:55.725420  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/deployment.yaml
	I0304 11:47:55.810498  405110 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-rbac.yaml
	I0304 11:47:55.810537  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-rbac.yaml (1188 bytes)
	I0304 11:47:55.812209  405110 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-975865" context rescaled to 1 replicas
	I0304 11:47:55.812261  405110 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0304 11:47:55.814630  405110 out.go:177] * Verifying Kubernetes components...
	I0304 11:47:55.816175  405110 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0304 11:47:55.820838  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml
	I0304 11:47:55.925351  405110 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-svc.yaml
	I0304 11:47:55.925440  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-svc.yaml (951 bytes)
	I0304 11:47:56.017365  405110 addons.go:426] installing /etc/kubernetes/addons/yakd-sa.yaml
	I0304 11:47:56.017397  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)
	I0304 11:47:56.019889  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml
	I0304 11:47:56.026528  405110 addons.go:426] installing /etc/kubernetes/addons/registry-svc.yaml
	I0304 11:47:56.026573  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)
	I0304 11:47:56.105226  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml
	I0304 11:47:56.111104  405110 addons.go:426] installing /etc/kubernetes/addons/rbac-hostpath.yaml
	I0304 11:47:56.111135  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)
	I0304 11:47:56.117256  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0304 11:47:56.119611  405110 addons.go:426] installing /etc/kubernetes/addons/ig-serviceaccount.yaml
	I0304 11:47:56.119639  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)
	I0304 11:47:56.127848  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0304 11:47:56.203310  405110 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml
	I0304 11:47:56.203349  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)
	I0304 11:47:56.204375  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml
	I0304 11:47:56.210718  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml
	I0304 11:47:56.314431  405110 addons.go:426] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml
	I0304 11:47:56.314465  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)
	I0304 11:47:56.403543  405110 addons.go:426] installing /etc/kubernetes/addons/registry-proxy.yaml
	I0304 11:47:56.403637  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)
	I0304 11:47:56.404101  405110 addons.go:426] installing /etc/kubernetes/addons/yakd-crb.yaml
	I0304 11:47:56.404170  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)
	I0304 11:47:56.415492  405110 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml
	I0304 11:47:56.415565  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)
	I0304 11:47:56.608965  405110 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml
	I0304 11:47:56.609058  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)
	I0304 11:47:56.629352  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml
	I0304 11:47:56.703926  405110 addons.go:426] installing /etc/kubernetes/addons/yakd-svc.yaml
	I0304 11:47:56.703956  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)
	I0304 11:47:56.703926  405110 addons.go:426] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml
	I0304 11:47:56.704033  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)
	I0304 11:47:56.704928  405110 addons.go:426] installing /etc/kubernetes/addons/ig-role.yaml
	I0304 11:47:56.704995  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)
	I0304 11:47:56.812511  405110 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml
	I0304 11:47:56.812538  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)
	I0304 11:47:57.206715  405110 addons.go:426] installing /etc/kubernetes/addons/yakd-dp.yaml
	I0304 11:47:57.206739  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)
	I0304 11:47:57.207641  405110 addons.go:426] installing /etc/kubernetes/addons/ig-rolebinding.yaml
	I0304 11:47:57.207663  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)
	I0304 11:47:57.222874  405110 addons.go:426] installing /etc/kubernetes/addons/rbac-external-resizer.yaml
	I0304 11:47:57.222907  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)
	I0304 11:47:57.223342  405110 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml
	I0304 11:47:57.223367  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)
	I0304 11:47:57.324883  405110 addons.go:426] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml
	I0304 11:47:57.324914  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)
	I0304 11:47:57.513557  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml
	I0304 11:47:57.514712  405110 addons.go:426] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0304 11:47:57.514745  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)
	I0304 11:47:57.516860  405110 addons.go:426] installing /etc/kubernetes/addons/ig-clusterrole.yaml
	I0304 11:47:57.516879  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)
	I0304 11:47:57.524118  405110 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml
	I0304 11:47:57.524199  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)
	I0304 11:47:57.607452  405110 addons.go:426] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml
	I0304 11:47:57.607488  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)
	I0304 11:47:58.113675  405110 addons.go:426] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml
	I0304 11:47:58.113753  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)
	I0304 11:47:58.205094  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0304 11:47:58.304896  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml
	I0304 11:47:58.403572  405110 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml
	I0304 11:47:58.403606  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)
	I0304 11:47:58.421447  405110 addons.go:426] installing /etc/kubernetes/addons/ig-crd.yaml
	I0304 11:47:58.421489  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)
	I0304 11:47:58.511690  405110 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.28.4/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (2.989336999s)
	I0304 11:47:58.511727  405110 start.go:929] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0304 11:47:58.803084  405110 addons.go:426] installing /etc/kubernetes/addons/ig-daemonset.yaml
	I0304 11:47:58.803201  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)
	I0304 11:47:59.124670  405110 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml
	I0304 11:47:59.124700  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)
	I0304 11:47:59.402812  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml
	I0304 11:47:59.718742  405110 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml
	I0304 11:47:59.718778  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)
	I0304 11:48:00.008104  405110 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml
	I0304 11:48:00.008133  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)
	I0304 11:48:00.015923  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (4.290456592s)
	I0304 11:48:00.016034  405110 ssh_runner.go:235] Completed: sudo systemctl is-active --quiet service kubelet: (4.199830442s)
	I0304 11:48:00.017172  405110 node_ready.go:35] waiting up to 6m0s for node "addons-975865" to be "Ready" ...
	I0304 11:48:00.317374  405110 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0304 11:48:00.317414  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)
	I0304 11:48:00.619185  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml
	I0304 11:48:00.804153  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (4.983272137s)
	I0304 11:48:01.820126  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (5.80018686s)
	I0304 11:48:02.127201  405110 node_ready.go:58] node "addons-975865" has status "Ready":"False"
	I0304 11:48:02.212347  405110 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)
	I0304 11:48:02.212508  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:48:02.236308  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:48:02.629096  405110 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)
	I0304 11:48:02.723856  405110 addons.go:234] Setting addon gcp-auth=true in "addons-975865"
	I0304 11:48:02.724004  405110 host.go:66] Checking if "addons-975865" exists ...
	I0304 11:48:02.724666  405110 cli_runner.go:164] Run: docker container inspect addons-975865 --format={{.State.Status}}
	I0304 11:48:02.743706  405110 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json
	I0304 11:48:02.743771  405110 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" addons-975865
	I0304 11:48:02.759810  405110 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32772 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/addons-975865/id_rsa Username:docker}
	I0304 11:48:03.508513  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (7.403242839s)
	I0304 11:48:03.508546  405110 addons.go:470] Verifying addon ingress=true in "addons-975865"
	I0304 11:48:03.510212  405110 out.go:177] * Verifying ingress addon...
	I0304 11:48:03.508610  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (7.391310849s)
	I0304 11:48:03.508689  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.380812558s)
	I0304 11:48:03.508751  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml: (7.304340821s)
	I0304 11:48:03.508790  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (7.298038509s)
	I0304 11:48:03.508829  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (6.879445016s)
	I0304 11:48:03.508904  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (5.995308057s)
	I0304 11:48:03.509017  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (5.303829168s)
	I0304 11:48:03.509069  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (5.204144338s)
	I0304 11:48:03.509144  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (4.106203977s)
	I0304 11:48:03.511812  405110 addons.go:470] Verifying addon registry=true in "addons-975865"
	W0304 11:48:03.511866  405110 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0304 11:48:03.511882  405110 addons.go:470] Verifying addon metrics-server=true in "addons-975865"
	I0304 11:48:03.513414  405110 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:
	
		minikube -p addons-975865 service yakd-dashboard -n yakd-dashboard
	
	I0304 11:48:03.511902  405110 retry.go:31] will retry after 341.058837ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1
	stdout:
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created
	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created
	serviceaccount/snapshot-controller created
	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created
	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created
	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created
	deployment.apps/snapshot-controller created
	
	stderr:
	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"
	ensure CRDs are installed first
	I0304 11:48:03.512590  405110 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...
	I0304 11:48:03.514872  405110 out.go:177] * Verifying registry addon...
	I0304 11:48:03.517997  405110 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...
	I0304 11:48:03.522021  405110 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=registry
	I0304 11:48:03.522042  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:03.522400  405110 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx
	I0304 11:48:03.522416  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:03.855745  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml
	I0304 11:48:04.024480  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:04.024856  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:04.232752  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (3.613447156s)
	I0304 11:48:04.232793  405110 addons.go:470] Verifying addon csi-hostpath-driver=true in "addons-975865"
	I0304 11:48:04.235002  405110 out.go:177] * Verifying csi-hostpath-driver addon...
	I0304 11:48:04.232998  405110 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (1.489263585s)
	I0304 11:48:04.304448  405110 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0
	I0304 11:48:04.306137  405110 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.1
	I0304 11:48:04.307029  405110 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...
	I0304 11:48:04.307660  405110 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-ns.yaml
	I0304 11:48:04.307847  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)
	I0304 11:48:04.313235  405110 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0304 11:48:04.313307  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:04.503133  405110 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-service.yaml
	I0304 11:48:04.503244  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)
	I0304 11:48:04.609687  405110 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0304 11:48:04.609779  405110 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)
	I0304 11:48:04.613770  405110 node_ready.go:49] node "addons-975865" has status "Ready":"True"
	I0304 11:48:04.613850  405110 node_ready.go:38] duration metric: took 4.596651625s waiting for node "addons-975865" to be "Ready" ...
	I0304 11:48:04.613879  405110 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0304 11:48:04.709040  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:04.710935  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:04.730637  405110 pod_ready.go:78] waiting up to 6m0s for pod "coredns-5dd5756b68-nhbdq" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:04.816240  405110 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml
	I0304 11:48:04.917170  405110 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver
	I0304 11:48:04.917220  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:05.105249  405110 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry
	I0304 11:48:05.105288  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:05.105338  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:05.318699  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:05.525835  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:05.526087  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:05.814289  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:06.104964  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:06.106280  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:06.413756  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:06.520882  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:06.605595  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:06.811900  405110 pod_ready.go:102] pod "coredns-5dd5756b68-nhbdq" in "kube-system" namespace has status "Ready":"False"
	I0304 11:48:06.819792  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:07.022941  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:07.026020  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:07.317068  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:07.527633  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:07.618930  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:07.814075  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:08.020478  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:08.030236  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:08.216232  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (4.360410356s)
	I0304 11:48:08.315149  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:08.427413  405110 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.28.4/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (3.61105968s)
	I0304 11:48:08.429686  405110 addons.go:470] Verifying addon gcp-auth=true in "addons-975865"
	I0304 11:48:08.431198  405110 out.go:177] * Verifying gcp-auth addon...
	I0304 11:48:08.433785  405110 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...
	I0304 11:48:08.505192  405110 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth
	I0304 11:48:08.505216  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:08.523326  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:08.526097  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:08.813598  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:08.937331  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:09.019608  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:09.023062  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:09.236861  405110 pod_ready.go:92] pod "coredns-5dd5756b68-nhbdq" in "kube-system" namespace has status "Ready":"True"
	I0304 11:48:09.236884  405110 pod_ready.go:81] duration metric: took 4.50621803s waiting for pod "coredns-5dd5756b68-nhbdq" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.236903  405110 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-975865" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.241503  405110 pod_ready.go:92] pod "etcd-addons-975865" in "kube-system" namespace has status "Ready":"True"
	I0304 11:48:09.241523  405110 pod_ready.go:81] duration metric: took 4.613448ms waiting for pod "etcd-addons-975865" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.241533  405110 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-975865" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.245932  405110 pod_ready.go:92] pod "kube-apiserver-addons-975865" in "kube-system" namespace has status "Ready":"True"
	I0304 11:48:09.245959  405110 pod_ready.go:81] duration metric: took 4.4156ms waiting for pod "kube-apiserver-addons-975865" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.245971  405110 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-975865" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.250790  405110 pod_ready.go:92] pod "kube-controller-manager-addons-975865" in "kube-system" namespace has status "Ready":"True"
	I0304 11:48:09.250808  405110 pod_ready.go:81] duration metric: took 4.829598ms waiting for pod "kube-controller-manager-addons-975865" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.250819  405110 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-t5cbf" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.255576  405110 pod_ready.go:92] pod "kube-proxy-t5cbf" in "kube-system" namespace has status "Ready":"True"
	I0304 11:48:09.255597  405110 pod_ready.go:81] duration metric: took 4.769898ms waiting for pod "kube-proxy-t5cbf" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.255607  405110 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-975865" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.313693  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:09.437102  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:09.519493  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:09.522948  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:09.635755  405110 pod_ready.go:92] pod "kube-scheduler-addons-975865" in "kube-system" namespace has status "Ready":"True"
	I0304 11:48:09.635794  405110 pod_ready.go:81] duration metric: took 380.177675ms waiting for pod "kube-scheduler-addons-975865" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.635809  405110 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:09.813829  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:09.938167  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:10.020052  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:10.023060  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:10.313055  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:10.436946  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:10.519273  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:10.522455  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:10.812327  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:10.937372  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:11.018924  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:11.021766  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:11.315026  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:11.438154  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:11.519873  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:11.523891  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:11.642864  405110 pod_ready.go:102] pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace has status "Ready":"False"
	I0304 11:48:11.814254  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:11.937904  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:12.020179  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:12.023059  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:12.314878  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:12.438443  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:12.519165  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:12.523935  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:12.813356  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:12.937479  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:13.019074  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:13.021969  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:13.314082  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:13.437426  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:13.519387  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:13.522630  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:13.813731  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:13.937978  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:14.019919  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:14.022825  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:14.141925  405110 pod_ready.go:102] pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace has status "Ready":"False"
	I0304 11:48:14.313684  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:14.437717  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:14.519214  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:14.522620  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:14.813452  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:14.937958  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:15.020152  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:15.025376  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:15.313692  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:15.506062  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:15.520156  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:15.523341  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:15.814401  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:15.938553  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:16.019766  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:16.023069  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:16.142308  405110 pod_ready.go:102] pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace has status "Ready":"False"
	I0304 11:48:16.314484  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:16.437925  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:16.520059  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:16.523466  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:16.813857  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:16.937544  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:17.020235  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:17.022494  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:17.312780  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:17.437186  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:17.519156  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:17.522558  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:17.814888  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:17.938211  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:18.020036  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:18.023252  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:18.313786  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:18.437457  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:18.519132  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:18.604265  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:18.647386  405110 pod_ready.go:102] pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace has status "Ready":"False"
	I0304 11:48:18.813464  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:18.937588  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:19.019361  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:19.021876  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:19.313809  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:19.438553  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:19.519730  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:19.523350  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:19.813142  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:19.937743  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:20.019676  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:20.022571  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:20.312809  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:20.437088  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:20.519544  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:20.522149  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:20.813947  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:21.005387  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:21.020541  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:21.025143  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:21.209279  405110 pod_ready.go:102] pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace has status "Ready":"False"
	I0304 11:48:21.323768  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:21.438221  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:21.522699  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:21.526741  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:21.814013  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:22.008636  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:22.019976  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:22.023244  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:22.314267  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:22.437434  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:22.519358  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:22.524044  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:22.816792  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:22.938482  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:23.019711  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:23.023012  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:23.313242  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:23.437503  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:23.519372  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:23.522178  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:23.642158  405110 pod_ready.go:102] pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace has status "Ready":"False"
	I0304 11:48:23.814388  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:23.937552  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:24.019797  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:24.022271  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:24.314512  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:24.437503  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:24.519656  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:24.522452  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:24.813383  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:24.937562  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:25.019618  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:25.022091  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:25.314060  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:25.504674  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:25.522682  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:25.526622  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:25.642716  405110 pod_ready.go:102] pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace has status "Ready":"False"
	I0304 11:48:25.814404  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:25.938355  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:26.018873  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:26.023244  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:26.313637  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:26.437772  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:26.519627  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:26.523688  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:26.813264  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:26.938300  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:27.019996  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:27.022950  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:27.314344  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:27.437523  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:27.519819  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:27.522488  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:27.642766  405110 pod_ready.go:102] pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace has status "Ready":"False"
	I0304 11:48:27.814590  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:27.937293  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:28.018545  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:28.022302  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:28.312738  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:28.436848  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:28.519924  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:28.523700  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:28.709268  405110 pod_ready.go:92] pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace has status "Ready":"True"
	I0304 11:48:28.709349  405110 pod_ready.go:81] duration metric: took 19.073531586s waiting for pod "metrics-server-69cf46c98-b8n47" in "kube-system" namespace to be "Ready" ...
	I0304 11:48:28.709384  405110 pod_ready.go:38] duration metric: took 24.09543076s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0304 11:48:28.709427  405110 api_server.go:52] waiting for apiserver process to appear ...
	I0304 11:48:28.709504  405110 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0304 11:48:28.724587  405110 api_server.go:72] duration metric: took 32.912275823s to wait for apiserver process to appear ...
	I0304 11:48:28.724621  405110 api_server.go:88] waiting for apiserver healthz status ...
	I0304 11:48:28.724653  405110 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0304 11:48:28.729243  405110 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0304 11:48:28.730519  405110 api_server.go:141] control plane version: v1.28.4
	I0304 11:48:28.730548  405110 api_server.go:131] duration metric: took 5.918615ms to wait for apiserver health ...
	I0304 11:48:28.730560  405110 system_pods.go:43] waiting for kube-system pods to appear ...
	I0304 11:48:28.740660  405110 system_pods.go:59] 19 kube-system pods found
	I0304 11:48:28.740692  405110 system_pods.go:61] "coredns-5dd5756b68-nhbdq" [b09b4830-c38e-427e-9dd1-9754c212be10] Running
	I0304 11:48:28.740701  405110 system_pods.go:61] "csi-hostpath-attacher-0" [7e7f11f4-0b99-4ea3-99d2-a6249ef62a0a] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0304 11:48:28.740710  405110 system_pods.go:61] "csi-hostpath-resizer-0" [eb3b9680-f9a1-4562-b314-2ce09e7af0d3] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0304 11:48:28.740717  405110 system_pods.go:61] "csi-hostpathplugin-2w6kz" [d5584c82-412c-4c84-9350-1969e595731e] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0304 11:48:28.740721  405110 system_pods.go:61] "etcd-addons-975865" [cf48172d-da33-4575-867c-83faec826304] Running
	I0304 11:48:28.740724  405110 system_pods.go:61] "kindnet-tm2pm" [79d918c2-77d7-4651-b44a-0e371f3d551e] Running
	I0304 11:48:28.740728  405110 system_pods.go:61] "kube-apiserver-addons-975865" [9abd61a8-f937-46ce-af14-d169011623b1] Running
	I0304 11:48:28.740731  405110 system_pods.go:61] "kube-controller-manager-addons-975865" [06c59838-f212-4a65-ab8b-a059b58cf341] Running
	I0304 11:48:28.740736  405110 system_pods.go:61] "kube-ingress-dns-minikube" [5e9dec0c-a3a0-4515-9aa6-00d0505cccfc] Running
	I0304 11:48:28.740741  405110 system_pods.go:61] "kube-proxy-t5cbf" [16f8a838-cc14-401b-9589-c35dab3319f0] Running
	I0304 11:48:28.740745  405110 system_pods.go:61] "kube-scheduler-addons-975865" [60d23df3-9dc4-4378-8602-fb53244ee1e9] Running
	I0304 11:48:28.740755  405110 system_pods.go:61] "metrics-server-69cf46c98-b8n47" [cc50fbf1-ba8e-4734-b9e3-0ae2668c0265] Running
	I0304 11:48:28.740761  405110 system_pods.go:61] "nvidia-device-plugin-daemonset-blxlb" [7420b97c-e9cb-4738-b13a-1fc100a3bf50] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
	I0304 11:48:28.740766  405110 system_pods.go:61] "registry-proxy-rvr4d" [b5a1edef-e542-4acc-8e53-db66447354b3] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0304 11:48:28.740774  405110 system_pods.go:61] "registry-zl52r" [eeab5c60-f96a-488e-b668-8316e0664295] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0304 11:48:28.740777  405110 system_pods.go:61] "snapshot-controller-58dbcc7b99-ffxvv" [efa84fb0-21a4-4bed-a8fd-f4574cab3dce] Running
	I0304 11:48:28.740784  405110 system_pods.go:61] "snapshot-controller-58dbcc7b99-rlpjq" [a96ec197-1feb-43ce-a850-fb10b3f9e5e2] Running
	I0304 11:48:28.740788  405110 system_pods.go:61] "storage-provisioner" [29c40fc3-2ff5-46e5-b897-57b1cad1ad0c] Running
	I0304 11:48:28.740793  405110 system_pods.go:61] "tiller-deploy-7b677967b9-rq8jg" [448a96d7-e9e5-4ea5-8c75-5eecbbb2cb1f] Pending / Ready:ContainersNotReady (containers with unready status: [tiller]) / ContainersReady:ContainersNotReady (containers with unready status: [tiller])
	I0304 11:48:28.740805  405110 system_pods.go:74] duration metric: took 10.238573ms to wait for pod list to return data ...
	I0304 11:48:28.740815  405110 default_sa.go:34] waiting for default service account to be created ...
	I0304 11:48:28.805050  405110 default_sa.go:45] found service account: "default"
	I0304 11:48:28.805081  405110 default_sa.go:55] duration metric: took 64.256627ms for default service account to be created ...
	I0304 11:48:28.805095  405110 system_pods.go:116] waiting for k8s-apps to be running ...
	I0304 11:48:28.817438  405110 system_pods.go:86] 19 kube-system pods found
	I0304 11:48:28.817474  405110 system_pods.go:89] "coredns-5dd5756b68-nhbdq" [b09b4830-c38e-427e-9dd1-9754c212be10] Running
	I0304 11:48:28.817521  405110 system_pods.go:89] "csi-hostpath-attacher-0" [7e7f11f4-0b99-4ea3-99d2-a6249ef62a0a] Pending / Ready:ContainersNotReady (containers with unready status: [csi-attacher]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-attacher])
	I0304 11:48:28.817535  405110 system_pods.go:89] "csi-hostpath-resizer-0" [eb3b9680-f9a1-4562-b314-2ce09e7af0d3] Pending / Ready:ContainersNotReady (containers with unready status: [csi-resizer]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-resizer])
	I0304 11:48:28.817549  405110 system_pods.go:89] "csi-hostpathplugin-2w6kz" [d5584c82-412c-4c84-9350-1969e595731e] Pending / Ready:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter]) / ContainersReady:ContainersNotReady (containers with unready status: [csi-external-health-monitor-controller node-driver-registrar hostpath liveness-probe csi-provisioner csi-snapshotter])
	I0304 11:48:28.817560  405110 system_pods.go:89] "etcd-addons-975865" [cf48172d-da33-4575-867c-83faec826304] Running
	I0304 11:48:28.817568  405110 system_pods.go:89] "kindnet-tm2pm" [79d918c2-77d7-4651-b44a-0e371f3d551e] Running
	I0304 11:48:28.817596  405110 system_pods.go:89] "kube-apiserver-addons-975865" [9abd61a8-f937-46ce-af14-d169011623b1] Running
	I0304 11:48:28.817606  405110 system_pods.go:89] "kube-controller-manager-addons-975865" [06c59838-f212-4a65-ab8b-a059b58cf341] Running
	I0304 11:48:28.817621  405110 system_pods.go:89] "kube-ingress-dns-minikube" [5e9dec0c-a3a0-4515-9aa6-00d0505cccfc] Running
	I0304 11:48:28.817631  405110 system_pods.go:89] "kube-proxy-t5cbf" [16f8a838-cc14-401b-9589-c35dab3319f0] Running
	I0304 11:48:28.817640  405110 system_pods.go:89] "kube-scheduler-addons-975865" [60d23df3-9dc4-4378-8602-fb53244ee1e9] Running
	I0304 11:48:28.817649  405110 system_pods.go:89] "metrics-server-69cf46c98-b8n47" [cc50fbf1-ba8e-4734-b9e3-0ae2668c0265] Running
	I0304 11:48:28.817674  405110 system_pods.go:89] "nvidia-device-plugin-daemonset-blxlb" [7420b97c-e9cb-4738-b13a-1fc100a3bf50] Pending / Ready:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr]) / ContainersReady:ContainersNotReady (containers with unready status: [nvidia-device-plugin-ctr])
	I0304 11:48:28.817686  405110 system_pods.go:89] "registry-proxy-rvr4d" [b5a1edef-e542-4acc-8e53-db66447354b3] Pending / Ready:ContainersNotReady (containers with unready status: [registry-proxy]) / ContainersReady:ContainersNotReady (containers with unready status: [registry-proxy])
	I0304 11:48:28.817708  405110 system_pods.go:89] "registry-zl52r" [eeab5c60-f96a-488e-b668-8316e0664295] Pending / Ready:ContainersNotReady (containers with unready status: [registry]) / ContainersReady:ContainersNotReady (containers with unready status: [registry])
	I0304 11:48:28.817718  405110 system_pods.go:89] "snapshot-controller-58dbcc7b99-ffxvv" [efa84fb0-21a4-4bed-a8fd-f4574cab3dce] Running
	I0304 11:48:28.817724  405110 system_pods.go:89] "snapshot-controller-58dbcc7b99-rlpjq" [a96ec197-1feb-43ce-a850-fb10b3f9e5e2] Running
	I0304 11:48:28.817733  405110 system_pods.go:89] "storage-provisioner" [29c40fc3-2ff5-46e5-b897-57b1cad1ad0c] Running
	I0304 11:48:28.817768  405110 system_pods.go:89] "tiller-deploy-7b677967b9-rq8jg" [448a96d7-e9e5-4ea5-8c75-5eecbbb2cb1f] Pending / Ready:ContainersNotReady (containers with unready status: [tiller]) / ContainersReady:ContainersNotReady (containers with unready status: [tiller])
	I0304 11:48:28.817787  405110 system_pods.go:126] duration metric: took 12.677861ms to wait for k8s-apps to be running ...
	I0304 11:48:28.817801  405110 system_svc.go:44] waiting for kubelet service to be running ....
	I0304 11:48:28.817873  405110 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0304 11:48:28.819607  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:28.835359  405110 system_svc.go:56] duration metric: took 17.548062ms WaitForService to wait for kubelet.
	I0304 11:48:28.835388  405110 kubeadm.go:581] duration metric: took 33.023084821s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0304 11:48:28.835413  405110 node_conditions.go:102] verifying NodePressure condition ...
	I0304 11:48:28.905537  405110 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0304 11:48:28.905623  405110 node_conditions.go:123] node cpu capacity is 8
	I0304 11:48:28.905657  405110 node_conditions.go:105] duration metric: took 70.234142ms to run NodePressure ...
	I0304 11:48:28.905694  405110 start.go:228] waiting for startup goroutines ...
	I0304 11:48:28.937975  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:29.020570  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:29.023976  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:29.313663  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:29.437146  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:29.519422  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:29.522381  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:29.813758  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:29.937659  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:30.019758  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:30.022535  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:30.313979  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:30.438439  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:30.521941  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:30.523992  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:30.813793  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:30.937731  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:31.019321  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:31.021902  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:31.312402  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:31.437615  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:31.519203  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:31.521811  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:31.813281  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:31.937890  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:32.020208  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:32.023337  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:32.313489  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:32.437756  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:32.519719  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:32.522505  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:32.816244  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:32.937601  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:33.019251  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:33.021900  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:33.314207  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:33.438258  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:33.520549  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:33.524197  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:33.815071  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:34.006480  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:34.019863  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:34.023572  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:34.316579  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:34.506983  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:34.523386  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:34.524215  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:34.814584  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:34.938422  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:35.020338  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:35.023579  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:35.314533  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:35.438028  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:35.520861  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:35.523443  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:35.813505  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:35.938098  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:36.020135  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:36.023460  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:36.314688  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:36.438517  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:36.523284  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:36.523425  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:36.813690  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:36.937969  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:37.019325  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:37.022519  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:37.316394  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:37.438157  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:37.520337  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:37.521979  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:37.814299  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:37.937410  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:38.019579  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:38.022074  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:38.313024  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:38.437818  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:38.519193  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:38.522147  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:38.812595  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:38.937867  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:39.019692  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:39.022163  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:39.313729  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:39.438090  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:39.519740  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:39.522501  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:39.813260  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:39.937836  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:40.020151  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:40.022910  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:40.313898  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:40.438374  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:40.519568  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:40.521953  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:40.813661  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:40.937281  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:41.019714  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:41.022174  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:41.313251  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:41.437992  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:41.520024  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:41.522749  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:41.814063  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:41.937729  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:42.020198  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:42.026882  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:42.314410  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:42.437393  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:42.518583  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:42.523243  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:42.813025  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:42.938587  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:43.019504  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:43.022134  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]
	I0304 11:48:43.312912  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:43.436925  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:43.568143  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:43.569257  405110 kapi.go:107] duration metric: took 40.051255907s to wait for kubernetes.io/minikube-addons=registry ...
	I0304 11:48:43.814087  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:43.937042  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:44.119443  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:44.313615  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:44.438262  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:44.518838  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:44.813304  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:44.938292  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:45.019270  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:45.313814  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:45.438293  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:45.519294  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:45.814061  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:45.937581  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:46.019187  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:46.312969  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:46.436663  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:46.519709  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:46.814585  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:47.005291  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:47.020519  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:47.313418  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:47.506866  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:47.524558  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:47.822785  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:48.009425  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:48.020216  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:48.321278  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:48.506573  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:48.519814  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:48.813806  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:48.937581  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:49.019416  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:49.313433  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:49.497274  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:49.519742  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:49.813635  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:49.937517  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:50.020430  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:50.313109  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:50.437573  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:50.520134  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:50.813751  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:50.937349  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:51.019193  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:51.314159  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:51.437306  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:51.518845  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:51.813356  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:51.937354  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:52.019847  405110 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]
	I0304 11:48:52.313378  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:52.437428  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:52.518910  405110 kapi.go:107] duration metric: took 49.006313841s to wait for app.kubernetes.io/name=ingress-nginx ...
	I0304 11:48:52.813255  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:52.937481  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:53.316860  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:53.437419  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:53.813919  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:53.944247  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:54.315898  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:54.438243  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:54.813496  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:54.937934  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:55.313662  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:55.438777  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:55.814459  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:55.937826  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:56.312588  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:56.437727  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:56.813771  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:56.937570  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:57.313248  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]
	I0304 11:48:57.437667  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:57.813620  405110 kapi.go:107] duration metric: took 53.506588988s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...
	I0304 11:48:57.938000  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:58.437283  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:58.937290  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:59.437665  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:48:59.938431  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:00.437921  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:00.937366  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:01.437726  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:01.937009  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:02.437562  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:02.937766  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:03.437165  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:03.937238  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:04.437286  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:04.937855  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:05.437256  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:05.937501  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:06.437697  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:06.938514  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:07.437148  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:07.937457  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:08.437806  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:08.937532  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:09.438001  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:09.936960  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:10.437342  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:10.937701  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:11.436913  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:11.936894  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:12.437401  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:12.937819  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:13.438497  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:13.938095  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:14.437063  405110 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]
	I0304 11:49:14.937403  405110 kapi.go:107] duration metric: took 1m6.503612883s to wait for kubernetes.io/minikube-addons=gcp-auth ...
	I0304 11:49:14.939245  405110 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-975865 cluster.
	I0304 11:49:14.940691  405110 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.
	I0304 11:49:14.942077  405110 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.
	I0304 11:49:14.943660  405110 out.go:177] * Enabled addons: cloud-spanner, ingress-dns, storage-provisioner-rancher, inspektor-gadget, nvidia-device-plugin, storage-provisioner, helm-tiller, metrics-server, yakd, default-storageclass, volumesnapshots, registry, ingress, csi-hostpath-driver, gcp-auth
	I0304 11:49:14.944981  405110 addons.go:505] enable addons completed in 1m19.671322257s: enabled=[cloud-spanner ingress-dns storage-provisioner-rancher inspektor-gadget nvidia-device-plugin storage-provisioner helm-tiller metrics-server yakd default-storageclass volumesnapshots registry ingress csi-hostpath-driver gcp-auth]
	I0304 11:49:14.945027  405110 start.go:233] waiting for cluster config update ...
	I0304 11:49:14.945049  405110 start.go:242] writing updated cluster config ...
	I0304 11:49:14.945297  405110 ssh_runner.go:195] Run: rm -f paused
	I0304 11:49:15.004852  405110 start.go:601] kubectl: 1.29.2, cluster: 1.28.4 (minor skew: 1)
	I0304 11:49:15.006925  405110 out.go:177] * Done! kubectl is now configured to use "addons-975865" cluster and "default" namespace by default
	
	
	==> CRI-O <==
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.433601998Z" level=info msg="Stopped container 6892c252ec0fed99964259967ea10a0d8ca8e03d36de5566d3b218fa37cc62e6: kube-system/registry-proxy-rvr4d/registry-proxy" id=54bcc395-9a3b-4976-922b-8fd0699e8a66 name=/runtime.v1.RuntimeService/StopContainer
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.434206732Z" level=info msg="Stopping pod sandbox: 5c1cd48e802bcbada01f282ec8e70571b76022e8d798f8d59a6f34b41d538eca" id=cef19e3d-3b6f-4061-bee4-e6275d7628cc name=/runtime.v1.RuntimeService/StopPodSandbox
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.437987085Z" level=info msg="Restoring iptables rules: *nat\n:KUBE-HOSTPORTS - [0:0]\n:KUBE-HP-W7MIZMZQTAA2XB2K - [0:0]\n:KUBE-HP-Y547LVMXY5QLV2VJ - [0:0]\n:KUBE-HP-CFSPWLG3WOOABUY5 - [0:0]\n-A KUBE-HOSTPORTS -p tcp -m comment --comment \"k8s_ingress-nginx-controller-76dc478dd8-n2bqc_ingress-nginx_acd6110c-2a7c-441a-96a3-9d300a6f6970_0_ hostport 443\" -m tcp --dport 443 -j KUBE-HP-W7MIZMZQTAA2XB2K\n-A KUBE-HOSTPORTS -p tcp -m comment --comment \"k8s_ingress-nginx-controller-76dc478dd8-n2bqc_ingress-nginx_acd6110c-2a7c-441a-96a3-9d300a6f6970_0_ hostport 80\" -m tcp --dport 80 -j KUBE-HP-CFSPWLG3WOOABUY5\n-A KUBE-HP-CFSPWLG3WOOABUY5 -s 10.244.0.20/32 -m comment --comment \"k8s_ingress-nginx-controller-76dc478dd8-n2bqc_ingress-nginx_acd6110c-2a7c-441a-96a3-9d300a6f6970_0_ hostport 80\" -j KUBE-MARK-MASQ\n-A KUBE-HP-CFSPWLG3WOOABUY5 -p tcp -m comment --comment \"k8s_ingress-nginx-controller-76dc478dd8-n2bqc_ingress-nginx_acd6110c-2a7c-441a
-96a3-9d300a6f6970_0_ hostport 80\" -m tcp -j DNAT --to-destination 10.244.0.20:80\n-A KUBE-HP-W7MIZMZQTAA2XB2K -s 10.244.0.20/32 -m comment --comment \"k8s_ingress-nginx-controller-76dc478dd8-n2bqc_ingress-nginx_acd6110c-2a7c-441a-96a3-9d300a6f6970_0_ hostport 443\" -j KUBE-MARK-MASQ\n-A KUBE-HP-W7MIZMZQTAA2XB2K -p tcp -m comment --comment \"k8s_ingress-nginx-controller-76dc478dd8-n2bqc_ingress-nginx_acd6110c-2a7c-441a-96a3-9d300a6f6970_0_ hostport 443\" -m tcp -j DNAT --to-destination 10.244.0.20:443\n-X KUBE-HP-Y547LVMXY5QLV2VJ\nCOMMIT\n"
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.440359862Z" level=info msg="Closing host port tcp:5000"
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.441954751Z" level=info msg="Host port tcp:5000 does not have an open socket"
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.442161825Z" level=info msg="Got pod network &{Name:registry-proxy-rvr4d Namespace:kube-system ID:5c1cd48e802bcbada01f282ec8e70571b76022e8d798f8d59a6f34b41d538eca UID:b5a1edef-e542-4acc-8e53-db66447354b3 NetNS:/var/run/netns/a176ba75-1895-4f1f-9fc0-83c8c1cf9361 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.442288804Z" level=info msg="Deleting pod kube-system_registry-proxy-rvr4d from CNI network \"kindnet\" (type=ptp)"
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.455734860Z" level=info msg="Stopped container 39af1283f5b868ffe89f7c56989063c73dfe578e2c61ffb061397046e94254a4: kube-system/metrics-server-69cf46c98-b8n47/metrics-server" id=83dc1127-6cdc-4c5b-96cd-74ff61ce74be name=/runtime.v1.RuntimeService/StopContainer
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.456232648Z" level=info msg="Stopping pod sandbox: ff718ee4a331957be8db112076bb10c89ad911113ebe38ad5d22227f18e9c72c" id=a009bb16-1ce5-4b99-89a6-35d3c0c76bef name=/runtime.v1.RuntimeService/StopPodSandbox
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.456427947Z" level=info msg="Got pod network &{Name:metrics-server-69cf46c98-b8n47 Namespace:kube-system ID:ff718ee4a331957be8db112076bb10c89ad911113ebe38ad5d22227f18e9c72c UID:cc50fbf1-ba8e-4734-b9e3-0ae2668c0265 NetNS:/var/run/netns/b9d38260-b9e2-496e-9dd5-04d70e368dff Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.456542885Z" level=info msg="Deleting pod kube-system_metrics-server-69cf46c98-b8n47 from CNI network \"kindnet\" (type=ptp)"
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.511629254Z" level=info msg="Stopped pod sandbox: ff718ee4a331957be8db112076bb10c89ad911113ebe38ad5d22227f18e9c72c" id=a009bb16-1ce5-4b99-89a6-35d3c0c76bef name=/runtime.v1.RuntimeService/StopPodSandbox
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.512151119Z" level=info msg="Stopped pod sandbox: 5c1cd48e802bcbada01f282ec8e70571b76022e8d798f8d59a6f34b41d538eca" id=cef19e3d-3b6f-4061-bee4-e6275d7628cc name=/runtime.v1.RuntimeService/StopPodSandbox
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.563316200Z" level=info msg="Removing container: 76a66d6787fb1782cfc112eca09180bd6e640c954d95a8a7f2da6766015c44ff" id=35df9c02-0b9f-4fe1-bf3e-35e6951b7521 name=/runtime.v1.RuntimeService/RemoveContainer
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.567108331Z" level=info msg="Stopping pod sandbox: 64b28131a4590e6be72872299be641b31a942b6773a0fc55e365b06ab797c595" id=82c5ab13-1c02-4db6-9022-a2c1c121fb8c name=/runtime.v1.RuntimeService/StopPodSandbox
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.567418535Z" level=info msg="Got pod network &{Name:test-local-path Namespace:default ID:64b28131a4590e6be72872299be641b31a942b6773a0fc55e365b06ab797c595 UID:4540583d-c966-44cd-ab06-dd11a0e3f62f NetNS:/var/run/netns/0dc492dd-6cfd-42c9-b50f-7cd460605708 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.567598188Z" level=info msg="Deleting pod default_test-local-path from CNI network \"kindnet\" (type=ptp)"
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.606903245Z" level=info msg="Removed container 76a66d6787fb1782cfc112eca09180bd6e640c954d95a8a7f2da6766015c44ff: kube-system/registry-zl52r/registry" id=35df9c02-0b9f-4fe1-bf3e-35e6951b7521 name=/runtime.v1.RuntimeService/RemoveContainer
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.608736969Z" level=info msg="Removing container: 6892c252ec0fed99964259967ea10a0d8ca8e03d36de5566d3b218fa37cc62e6" id=ed397a9a-a8c6-448e-b414-c6b604f04ed0 name=/runtime.v1.RuntimeService/RemoveContainer
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.633694080Z" level=info msg="Removed container 6892c252ec0fed99964259967ea10a0d8ca8e03d36de5566d3b218fa37cc62e6: kube-system/registry-proxy-rvr4d/registry-proxy" id=ed397a9a-a8c6-448e-b414-c6b604f04ed0 name=/runtime.v1.RuntimeService/RemoveContainer
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.635928395Z" level=info msg="Removing container: 39af1283f5b868ffe89f7c56989063c73dfe578e2c61ffb061397046e94254a4" id=bc053e74-52b8-415f-8d9a-f53dd5c795f6 name=/runtime.v1.RuntimeService/RemoveContainer
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.653218905Z" level=info msg="Removed container 39af1283f5b868ffe89f7c56989063c73dfe578e2c61ffb061397046e94254a4: kube-system/metrics-server-69cf46c98-b8n47/metrics-server" id=bc053e74-52b8-415f-8d9a-f53dd5c795f6 name=/runtime.v1.RuntimeService/RemoveContainer
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.654940133Z" level=info msg="Removing container: 369571d8c39d9a0c3f70ee3f053b6eaa713b30661b736775a91cede7ee250a8a" id=d6ad0af1-31fb-467f-9c14-073eeef28f39 name=/runtime.v1.RuntimeService/RemoveContainer
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.655662338Z" level=info msg="Stopped pod sandbox: 64b28131a4590e6be72872299be641b31a942b6773a0fc55e365b06ab797c595" id=82c5ab13-1c02-4db6-9022-a2c1c121fb8c name=/runtime.v1.RuntimeService/StopPodSandbox
	Mar 04 11:49:28 addons-975865 crio[959]: time="2024-03-04 11:49:28.669633054Z" level=info msg="Removed container 369571d8c39d9a0c3f70ee3f053b6eaa713b30661b736775a91cede7ee250a8a: default/registry-test/registry-test" id=d6ad0af1-31fb-467f-9c14-073eeef28f39 name=/runtime.v1.RuntimeService/RemoveContainer
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                                                                        CREATED              STATE               NAME                                     ATTEMPT             POD ID              POD
	adc2851db924c       docker.io/library/busybox@sha256:538721340ded10875f4710cad688c70e5d0ecb4dcd5e7d0c161f301f36f79414                                            2 seconds ago        Exited              busybox                                  0                   64b28131a4590       test-local-path
	d41ecb01245d1       docker.io/library/busybox@sha256:023917ec6a886d0e8e15f28fb543515a5fcd8d938edb091e8147db4efed388ee                                            7 seconds ago        Exited              helper-pod                               0                   4165811cd1279       helper-pod-create-pvc-b19b11ba-71fe-4d1c-b122-7cb5d5ad1463
	bd139d7eccc75       gcr.io/k8s-minikube/gcp-auth-webhook@sha256:01b0de782aa30e7fc91ac5a91b5cc35e95e9679dee7ef07af06457b471f88f32                                 15 seconds ago       Running             gcp-auth                                 0                   c915444cdecbf       gcp-auth-5f6b4f85fd-nl88x
	c269a53e6ef5a       ghcr.io/inspektor-gadget/inspektor-gadget@sha256:b2172c0331da19fc6b7c6076309cc78e3b7e2a3d220a6ea966a6b74b4fb471df                            21 seconds ago       Exited              gadget                                   2                   e1a3f7a80555c       gadget-6bsld
	4ff508c8a8ff0       registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f                          32 seconds ago       Running             csi-snapshotter                          0                   6ce70bc8349be       csi-hostpathplugin-2w6kz
	3adfd504a781d       registry.k8s.io/sig-storage/csi-provisioner@sha256:1bc653d13b27b8eefbba0799bdb5711819f8b987eaa6eb6750e8ef001958d5a7                          33 seconds ago       Running             csi-provisioner                          0                   6ce70bc8349be       csi-hostpathplugin-2w6kz
	e410af8388d7b       registry.k8s.io/sig-storage/livenessprobe@sha256:42bc492c3c65078b1ccda5dbc416abf0cefdba3e6317416cbc43344cf0ed09b6                            35 seconds ago       Running             liveness-probe                           0                   6ce70bc8349be       csi-hostpathplugin-2w6kz
	79e2b128ea828       registry.k8s.io/sig-storage/hostpathplugin@sha256:6fdad87766e53edf987545067e69a0dffb8485cccc546be4efbaa14c9b22ea11                           35 seconds ago       Running             hostpath                                 0                   6ce70bc8349be       csi-hostpathplugin-2w6kz
	f5a61bc6f00e2       registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:7caa903cf3f8d1d70c3b7bb3e23223685b05e4f342665877eabe84ae38b92ecc                37 seconds ago       Running             node-driver-registrar                    0                   6ce70bc8349be       csi-hostpathplugin-2w6kz
	c0dcc09452d34       registry.k8s.io/ingress-nginx/controller@sha256:42b3f0e5d0846876b1791cd3afeb5f1cbbe4259d6f35651dcc1b5c980925379c                             38 seconds ago       Running             controller                               0                   669cc984cef0c       ingress-nginx-controller-76dc478dd8-n2bqc
	29ab18ac9c056       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:261843b59d96d7e8a91e89545c7f27a066b1ab5cddbea8236cf1695c31889023                   43 seconds ago       Exited              patch                                    0                   aaf2623cf2427       gcp-auth-certs-patch-sgz29
	406995f00c620       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:261843b59d96d7e8a91e89545c7f27a066b1ab5cddbea8236cf1695c31889023                   43 seconds ago       Exited              create                                   0                   e4bc7154b04a1       gcp-auth-certs-create-wd9ct
	1454d4d8ebfe4       registry.k8s.io/sig-storage/csi-resizer@sha256:0629447f7946e53df3ad775c5595888de1dae5a23bcaae8f68fdab0395af61a8                              44 seconds ago       Running             csi-resizer                              0                   19b5922328a4e       csi-hostpath-resizer-0
	7128e1cc59e9c       registry.k8s.io/sig-storage/csi-attacher@sha256:66e4ecfa0ec50a88f9cd145e006805816f57040f40662d4cb9e31d10519d9bf0                             45 seconds ago       Running             csi-attacher                             0                   2134381821d1e       csi-hostpath-attacher-0
	6775a3a8c65c7       docker.io/rancher/local-path-provisioner@sha256:73f712e7af12b06720c35ce75217f904f00e4bd96de79f8db1cf160112e667ef                             50 seconds ago       Running             local-path-provisioner                   0                   278b2fdf50393       local-path-provisioner-78b46b4d5c-jlvwv
	f3c6d68889800       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:261843b59d96d7e8a91e89545c7f27a066b1ab5cddbea8236cf1695c31889023                   59 seconds ago       Exited              patch                                    0                   11d307550a9c1       ingress-nginx-admission-patch-6pkpn
	195bf410fc37f       registry.k8s.io/sig-storage/csi-external-health-monitor-controller@sha256:317f43813e4e2c3e81823ff16041c8e0714fb80e6d040c6e6c799967ba27d864   About a minute ago   Running             csi-external-health-monitor-controller   0                   6ce70bc8349be       csi-hostpathplugin-2w6kz
	3072dbc893d97       gcr.io/k8s-minikube/minikube-ingress-dns@sha256:4abe27f9fc03fedab1d655e2020e6b165faf3bf6de1088ce6cf215a75b78f05f                             About a minute ago   Running             minikube-ingress-dns                     0                   f59194352660e       kube-ingress-dns-minikube
	f84373bdcbea1       registry.k8s.io/ingress-nginx/kube-webhook-certgen@sha256:261843b59d96d7e8a91e89545c7f27a066b1ab5cddbea8236cf1695c31889023                   About a minute ago   Exited              create                                   0                   78bfe07307f43       ingress-nginx-admission-create-dxvpr
	28026efcbba8c       registry.k8s.io/sig-storage/snapshot-controller@sha256:4ef48aa1f079b2b6f11d06ee8be30a7f7332fc5ff1e4b20c6b6af68d76925922                      About a minute ago   Running             volume-snapshot-controller               0                   37f8cf83f1cf8       snapshot-controller-58dbcc7b99-rlpjq
	f1554dfb6758d       registry.k8s.io/sig-storage/snapshot-controller@sha256:4ef48aa1f079b2b6f11d06ee8be30a7f7332fc5ff1e4b20c6b6af68d76925922                      About a minute ago   Running             volume-snapshot-controller               0                   33229cec966fa       snapshot-controller-58dbcc7b99-ffxvv
	73f7d5a9bbb22       gcr.io/cloud-spanner-emulator/emulator@sha256:41d5dccfcf13817a2348beba0ca7c650ffdd795f7fcbe975b7822c9eed262e15                               About a minute ago   Running             cloud-spanner-emulator                   0                   7c42f283d4e39       cloud-spanner-emulator-6548d5df46-4c4pp
	305ac960a46ba       docker.io/marcnuri/yakd@sha256:a3f540278e4c11373e15605311851dd9c64d208f4d63e727bccc0e39f9329310                                              About a minute ago   Running             yakd                                     0                   ad8cc585d003b       yakd-dashboard-9947fc6bf-87nxj
	ec425e9be9916       ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc                                                                             About a minute ago   Running             coredns                                  0                   fd204d3084b35       coredns-5dd5756b68-nhbdq
	ab441c3a89cf4       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                                                             About a minute ago   Running             storage-provisioner                      0                   9afa5f9a56060       storage-provisioner
	290286ddcebc3       docker.io/kindest/kindnetd@sha256:61f9956af8019caf6dcc4d39b31857b868aaab80521432ddcc216b805c4f7988                                           About a minute ago   Running             kindnet-cni                              0                   e5afa2d4a23e9       kindnet-tm2pm
	8a9996107fda7       83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e                                                                             About a minute ago   Running             kube-proxy                               0                   7c8fcd8822a96       kube-proxy-t5cbf
	aee137a866e7b       d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591                                                                             About a minute ago   Running             kube-controller-manager                  0                   3eaf6c3f0abe2       kube-controller-manager-addons-975865
	37a43e65f90fb       73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9                                                                             About a minute ago   Running             etcd                                     0                   770a94f610d83       etcd-addons-975865
	e1ce9291c9551       7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257                                                                             About a minute ago   Running             kube-apiserver                           0                   e6384a937d54c       kube-apiserver-addons-975865
	14ddd4820fa92       e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1                                                                             About a minute ago   Running             kube-scheduler                           0                   e48c6db36e106       kube-scheduler-addons-975865
	
	
	==> coredns [ec425e9be9916c05a1de7912fd7c746a9694e7244b0103cbdd475908a65849e5] <==
	[INFO] 10.244.0.4:50796 - 39823 "A IN registry.kube-system.svc.cluster.local.cluster.local. udp 70 false 512" NXDOMAIN qr,aa,rd 163 0.000071095s
	[INFO] 10.244.0.4:43873 - 25214 "AAAA IN registry.kube-system.svc.cluster.local.us-east4-a.c.k8s-minikube.internal. udp 91 false 512" NXDOMAIN qr,rd,ra 91 0.003769153s
	[INFO] 10.244.0.4:43873 - 25468 "A IN registry.kube-system.svc.cluster.local.us-east4-a.c.k8s-minikube.internal. udp 91 false 512" NXDOMAIN qr,rd,ra 91 0.008668518s
	[INFO] 10.244.0.4:45693 - 18962 "AAAA IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 80 false 512" NXDOMAIN qr,rd,ra 80 0.003885128s
	[INFO] 10.244.0.4:45693 - 37905 "A IN registry.kube-system.svc.cluster.local.c.k8s-minikube.internal. udp 80 false 512" NXDOMAIN qr,rd,ra 80 0.005486817s
	[INFO] 10.244.0.4:32949 - 27058 "A IN registry.kube-system.svc.cluster.local.google.internal. udp 72 false 512" NXDOMAIN qr,rd,ra 72 0.004001824s
	[INFO] 10.244.0.4:32949 - 9661 "AAAA IN registry.kube-system.svc.cluster.local.google.internal. udp 72 false 512" NXDOMAIN qr,rd,ra 72 0.01066873s
	[INFO] 10.244.0.4:35994 - 4516 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000062904s
	[INFO] 10.244.0.4:35994 - 7335 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000097676s
	[INFO] 10.244.0.21:35611 - 60920 "A IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000206403s
	[INFO] 10.244.0.21:45081 - 5443 "AAAA IN storage.googleapis.com.gcp-auth.svc.cluster.local. udp 78 false 1232" NXDOMAIN qr,aa,rd 160 0.000089315s
	[INFO] 10.244.0.21:48064 - 10203 "A IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000127637s
	[INFO] 10.244.0.21:44518 - 26130 "AAAA IN storage.googleapis.com.svc.cluster.local. udp 69 false 1232" NXDOMAIN qr,aa,rd 151 0.000126947s
	[INFO] 10.244.0.21:58287 - 25471 "A IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000115928s
	[INFO] 10.244.0.21:38371 - 63807 "AAAA IN storage.googleapis.com.cluster.local. udp 65 false 1232" NXDOMAIN qr,aa,rd 147 0.000157003s
	[INFO] 10.244.0.21:37584 - 43709 "AAAA IN storage.googleapis.com.us-east4-a.c.k8s-minikube.internal. udp 86 false 1232" NXDOMAIN qr,rd,ra 75 0.006444829s
	[INFO] 10.244.0.21:57259 - 2510 "A IN storage.googleapis.com.us-east4-a.c.k8s-minikube.internal. udp 86 false 1232" NXDOMAIN qr,rd,ra 75 0.006554905s
	[INFO] 10.244.0.21:48779 - 7389 "A IN storage.googleapis.com.c.k8s-minikube.internal. udp 75 false 1232" NXDOMAIN qr,rd,ra 64 0.004142706s
	[INFO] 10.244.0.21:43934 - 56662 "AAAA IN storage.googleapis.com.c.k8s-minikube.internal. udp 75 false 1232" NXDOMAIN qr,rd,ra 64 0.006060506s
	[INFO] 10.244.0.21:37085 - 29596 "AAAA IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 56 0.004443117s
	[INFO] 10.244.0.21:48908 - 65399 "A IN storage.googleapis.com.google.internal. udp 67 false 1232" NXDOMAIN qr,rd,ra 56 0.004836443s
	[INFO] 10.244.0.21:47910 - 50711 "AAAA IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 240 0.000780284s
	[INFO] 10.244.0.21:46190 - 26335 "A IN storage.googleapis.com. udp 51 false 1232" NOERROR qr,rd,ra 344 0.000788127s
	[INFO] 10.244.0.24:32900 - 2 "AAAA IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 149 0.000156945s
	[INFO] 10.244.0.24:55878 - 3 "A IN registry.kube-system.svc.cluster.local. udp 56 false 512" NOERROR qr,aa,rd 110 0.000125869s
	
	
	==> describe nodes <==
	Name:               addons-975865
	Roles:              control-plane
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=addons-975865
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=ab57ba9f65fd4cb3ac8815e4f9baeeca5604e645
	                    minikube.k8s.io/name=addons-975865
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2024_03_04T11_47_42_0700
	                    minikube.k8s.io/version=v1.32.0
	                    node-role.kubernetes.io/control-plane=
	                    node.kubernetes.io/exclude-from-external-load-balancers=
	                    topology.hostpath.csi/node=addons-975865
	Annotations:        csi.volume.kubernetes.io/nodeid: {"hostpath.csi.k8s.io":"addons-975865"}
	                    kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 04 Mar 2024 11:47:38 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  addons-975865
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 04 Mar 2024 11:49:24 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 04 Mar 2024 11:49:13 +0000   Mon, 04 Mar 2024 11:47:36 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 04 Mar 2024 11:49:13 +0000   Mon, 04 Mar 2024 11:47:36 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 04 Mar 2024 11:49:13 +0000   Mon, 04 Mar 2024 11:47:36 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 04 Mar 2024 11:49:13 +0000   Mon, 04 Mar 2024 11:48:04 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    addons-975865
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32859364Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32859364Ki
	  pods:               110
	System Info:
	  Machine ID:                 fe6bd5a5fbab4b57a48561ef52a9b9dc
	  System UUID:                40ad309a-363a-4c65-b404-a5a2b61a017a
	  Boot ID:                    8bd20ee9-487a-4290-b90e-1794c4ce93e6
	  Kernel Version:             5.15.0-1052-gcp
	  OS Image:                   Ubuntu 22.04.3 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.28.4
	  Kube-Proxy Version:         v1.28.4
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (20 in total)
	  Namespace                   Name                                         CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age
	  ---------                   ----                                         ------------  ----------  ---------------  -------------  ---
	  default                     cloud-spanner-emulator-6548d5df46-4c4pp      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         91s
	  gadget                      gadget-6bsld                                 0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         88s
	  gcp-auth                    gcp-auth-5f6b4f85fd-nl88x                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         82s
	  ingress-nginx               ingress-nginx-controller-76dc478dd8-n2bqc    100m (1%!)(MISSING)     0 (0%!)(MISSING)      90Mi (0%!)(MISSING)        0 (0%!)(MISSING)         87s
	  kube-system                 coredns-5dd5756b68-nhbdq                     100m (1%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (0%!)(MISSING)     95s
	  kube-system                 csi-hostpath-attacher-0                      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         86s
	  kube-system                 csi-hostpath-resizer-0                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         86s
	  kube-system                 csi-hostpathplugin-2w6kz                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         86s
	  kube-system                 etcd-addons-975865                           100m (1%!)(MISSING)     0 (0%!)(MISSING)      100Mi (0%!)(MISSING)       0 (0%!)(MISSING)         109s
	  kube-system                 kindnet-tm2pm                                100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      96s
	  kube-system                 kube-apiserver-addons-975865                 250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         108s
	  kube-system                 kube-controller-manager-addons-975865        200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         108s
	  kube-system                 kube-ingress-dns-minikube                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         90s
	  kube-system                 kube-proxy-t5cbf                             0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         96s
	  kube-system                 kube-scheduler-addons-975865                 100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         111s
	  kube-system                 snapshot-controller-58dbcc7b99-ffxvv         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         88s
	  kube-system                 snapshot-controller-58dbcc7b99-rlpjq         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         88s
	  kube-system                 storage-provisioner                          0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         89s
	  local-path-storage          local-path-provisioner-78b46b4d5c-jlvwv      0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         89s
	  yakd-dashboard              yakd-dashboard-9947fc6bf-87nxj               0 (0%!)(MISSING)        0 (0%!)(MISSING)      128Mi (0%!)(MISSING)       256Mi (0%!)(MISSING)     88s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                950m (11%!)(MISSING)  100m (1%!)(MISSING)
	  memory             438Mi (1%!)(MISSING)  476Mi (1%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age   From             Message
	  ----    ------                   ----  ----             -------
	  Normal  Starting                 90s   kube-proxy       
	  Normal  Starting                 109s  kubelet          Starting kubelet.
	  Normal  NodeHasSufficientMemory  109s  kubelet          Node addons-975865 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    109s  kubelet          Node addons-975865 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     109s  kubelet          Node addons-975865 status is now: NodeHasSufficientPID
	  Normal  RegisteredNode           96s   node-controller  Node addons-975865 event: Registered Node addons-975865 in Controller
	  Normal  NodeReady                86s   kubelet          Node addons-975865 status is now: NodeReady
	
	
	==> dmesg <==
	
	
	==> etcd [37a43e65f90fb73964292dc02401cf414b631c8de8a5a71b71f5fa36734e49da] <==
	{"level":"warn","ts":"2024-03-04T11:47:59.624875Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"222.444538ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/ranges/servicenodeports\" ","response":"range_response_count:1 size:118"}
	{"level":"info","ts":"2024-03-04T11:47:59.627645Z","caller":"traceutil/trace.go:171","msg":"trace[502199716] range","detail":"{range_begin:/registry/ranges/servicenodeports; range_end:; response_count:1; response_revision:397; }","duration":"225.22079ms","start":"2024-03-04T11:47:59.402408Z","end":"2024-03-04T11:47:59.627629Z","steps":["trace[502199716] 'agreement among raft nodes before linearized reading'  (duration: 222.407075ms)"],"step_count":1}
	{"level":"warn","ts":"2024-03-04T11:47:59.628352Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"110.226993ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/deployments/default/cloud-spanner-emulator\" ","response":"range_response_count:1 size:3145"}
	{"level":"info","ts":"2024-03-04T11:47:59.628442Z","caller":"traceutil/trace.go:171","msg":"trace[854904493] range","detail":"{range_begin:/registry/deployments/default/cloud-spanner-emulator; range_end:; response_count:1; response_revision:398; }","duration":"110.328799ms","start":"2024-03-04T11:47:59.518104Z","end":"2024-03-04T11:47:59.628433Z","steps":["trace[854904493] 'agreement among raft nodes before linearized reading'  (duration: 110.166649ms)"],"step_count":1}
	{"level":"warn","ts":"2024-03-04T11:48:00.108968Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"100.702749ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/apiextensions.k8s.io/customresourcedefinitions/\" range_end:\"/registry/apiextensions.k8s.io/customresourcedefinitions0\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2024-03-04T11:48:00.204771Z","caller":"traceutil/trace.go:171","msg":"trace[92070772] range","detail":"{range_begin:/registry/apiextensions.k8s.io/customresourcedefinitions/; range_end:/registry/apiextensions.k8s.io/customresourcedefinitions0; response_count:0; response_revision:423; }","duration":"196.501736ms","start":"2024-03-04T11:48:00.008238Z","end":"2024-03-04T11:48:00.20474Z","steps":["trace[92070772] 'agreement among raft nodes before linearized reading'  (duration: 100.653291ms)"],"step_count":1}
	{"level":"warn","ts":"2024-03-04T11:48:00.113795Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"105.513443ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/serviceaccounts/local-path-storage/local-path-provisioner-service-account\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2024-03-04T11:48:00.206695Z","caller":"traceutil/trace.go:171","msg":"trace[1892410909] range","detail":"{range_begin:/registry/serviceaccounts/local-path-storage/local-path-provisioner-service-account; range_end:; response_count:0; response_revision:423; }","duration":"198.417283ms","start":"2024-03-04T11:48:00.008262Z","end":"2024-03-04T11:48:00.206679Z","steps":["trace[1892410909] 'agreement among raft nodes before linearized reading'  (duration: 105.497307ms)"],"step_count":1}
	{"level":"info","ts":"2024-03-04T11:48:00.507242Z","caller":"traceutil/trace.go:171","msg":"trace[1234448652] transaction","detail":"{read_only:false; response_revision:440; number_of_response:1; }","duration":"100.66372ms","start":"2024-03-04T11:48:00.406556Z","end":"2024-03-04T11:48:00.507219Z","steps":["trace[1234448652] 'process raft request'  (duration: 13.965804ms)","trace[1234448652] 'compare'  (duration: 86.108153ms)"],"step_count":2}
	{"level":"info","ts":"2024-03-04T11:48:00.707993Z","caller":"traceutil/trace.go:171","msg":"trace[1250373175] transaction","detail":"{read_only:false; response_revision:444; number_of_response:1; }","duration":"104.727625ms","start":"2024-03-04T11:48:00.603231Z","end":"2024-03-04T11:48:00.707959Z","steps":["trace[1250373175] 'process raft request'  (duration: 104.329511ms)"],"step_count":1}
	{"level":"info","ts":"2024-03-04T11:48:01.026977Z","caller":"traceutil/trace.go:171","msg":"trace[1178411780] linearizableReadLoop","detail":"{readStateIndex:472; appliedIndex:466; }","duration":"116.921078ms","start":"2024-03-04T11:48:00.910042Z","end":"2024-03-04T11:48:01.026964Z","steps":["trace[1178411780] 'read index received'  (duration: 11.796319ms)","trace[1178411780] 'applied index is now lower than readState.Index'  (duration: 105.124308ms)"],"step_count":2}
	{"level":"info","ts":"2024-03-04T11:48:01.027215Z","caller":"traceutil/trace.go:171","msg":"trace[362995318] transaction","detail":"{read_only:false; response_revision:455; number_of_response:1; }","duration":"119.327754ms","start":"2024-03-04T11:48:00.907875Z","end":"2024-03-04T11:48:01.027203Z","steps":["trace[362995318] 'process raft request'  (duration: 98.201429ms)","trace[362995318] 'get key's previous created_revision and leaseID' {req_type:put; key:/registry/serviceaccounts/kube-system/resourcequota-controller; req_size:208; } (duration: 20.712214ms)"],"step_count":2}
	{"level":"info","ts":"2024-03-04T11:48:01.027355Z","caller":"traceutil/trace.go:171","msg":"trace[878140330] transaction","detail":"{read_only:false; response_revision:456; number_of_response:1; }","duration":"118.388185ms","start":"2024-03-04T11:48:00.908962Z","end":"2024-03-04T11:48:01.027351Z","steps":["trace[878140330] 'process raft request'  (duration: 117.938413ms)"],"step_count":1}
	{"level":"info","ts":"2024-03-04T11:48:01.02745Z","caller":"traceutil/trace.go:171","msg":"trace[1082130259] transaction","detail":"{read_only:false; response_revision:457; number_of_response:1; }","duration":"118.794947ms","start":"2024-03-04T11:48:00.908651Z","end":"2024-03-04T11:48:01.027446Z","steps":["trace[1082130259] 'process raft request'  (duration: 118.287593ms)"],"step_count":1}
	{"level":"warn","ts":"2024-03-04T11:48:01.02754Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"117.503821ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/health\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2024-03-04T11:48:01.027559Z","caller":"traceutil/trace.go:171","msg":"trace[445003174] range","detail":"{range_begin:/registry/health; range_end:; response_count:0; response_revision:457; }","duration":"117.532798ms","start":"2024-03-04T11:48:00.91002Z","end":"2024-03-04T11:48:01.027552Z","steps":["trace[445003174] 'agreement among raft nodes before linearized reading'  (duration: 117.480714ms)"],"step_count":1}
	{"level":"info","ts":"2024-03-04T11:48:01.1207Z","caller":"traceutil/trace.go:171","msg":"trace[918901170] transaction","detail":"{read_only:false; response_revision:458; number_of_response:1; }","duration":"114.86767ms","start":"2024-03-04T11:48:01.005813Z","end":"2024-03-04T11:48:01.120681Z","steps":["trace[918901170] 'process raft request'  (duration: 111.370271ms)"],"step_count":1}
	{"level":"warn","ts":"2024-03-04T11:48:01.123366Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"110.631391ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/deployments/local-path-storage/local-path-provisioner\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2024-03-04T11:48:01.123489Z","caller":"traceutil/trace.go:171","msg":"trace[486244616] range","detail":"{range_begin:/registry/deployments/local-path-storage/local-path-provisioner; range_end:; response_count:0; response_revision:458; }","duration":"113.244267ms","start":"2024-03-04T11:48:01.01023Z","end":"2024-03-04T11:48:01.123474Z","steps":["trace[486244616] 'agreement among raft nodes before linearized reading'  (duration: 110.46189ms)"],"step_count":1}
	{"level":"warn","ts":"2024-03-04T11:48:01.213044Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"100.267183ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2024-03-04T11:48:01.213228Z","caller":"traceutil/trace.go:171","msg":"trace[449365409] range","detail":"{range_begin:/registry/services/endpoints/kube-system/k8s.io-minikube-hostpath; range_end:; response_count:0; response_revision:463; }","duration":"100.451937ms","start":"2024-03-04T11:48:01.112751Z","end":"2024-03-04T11:48:01.213203Z","steps":["trace[449365409] 'agreement among raft nodes before linearized reading'  (duration: 100.247374ms)"],"step_count":1}
	{"level":"warn","ts":"2024-03-04T11:48:01.614564Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"189.810497ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/configmaps/local-path-storage/local-path-config\" ","response":"range_response_count:0 size:5"}
	{"level":"info","ts":"2024-03-04T11:48:01.615871Z","caller":"traceutil/trace.go:171","msg":"trace[554689994] range","detail":"{range_begin:/registry/configmaps/local-path-storage/local-path-config; range_end:; response_count:0; response_revision:488; }","duration":"191.121413ms","start":"2024-03-04T11:48:01.424728Z","end":"2024-03-04T11:48:01.61585Z","steps":["trace[554689994] 'agreement among raft nodes before linearized reading'  (duration: 96.106472ms)","trace[554689994] 'range keys from in-memory index tree'  (duration: 93.663675ms)"],"step_count":2}
	{"level":"warn","ts":"2024-03-04T11:48:01.615132Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"190.073513ms","expected-duration":"100ms","prefix":"read-only range ","request":"key:\"/registry/namespaces/kube-system\" ","response":"range_response_count:1 size:351"}
	{"level":"info","ts":"2024-03-04T11:48:01.616229Z","caller":"traceutil/trace.go:171","msg":"trace[841401540] range","detail":"{range_begin:/registry/namespaces/kube-system; range_end:; response_count:1; response_revision:489; }","duration":"191.174558ms","start":"2024-03-04T11:48:01.425043Z","end":"2024-03-04T11:48:01.616217Z","steps":["trace[841401540] 'agreement among raft nodes before linearized reading'  (duration: 190.006742ms)"],"step_count":1}
	
	
	==> gcp-auth [bd139d7eccc756f3182787ac4e4a0d21cb75d6b66108d01ef787a17e9a56a5c3] <==
	2024/03/04 11:49:14 GCP Auth Webhook started!
	2024/03/04 11:49:20 Ready to marshal response ...
	2024/03/04 11:49:20 Ready to write response ...
	2024/03/04 11:49:21 Ready to marshal response ...
	2024/03/04 11:49:21 Ready to write response ...
	2024/03/04 11:49:21 Ready to marshal response ...
	2024/03/04 11:49:21 Ready to write response ...
	2024/03/04 11:49:25 Ready to marshal response ...
	2024/03/04 11:49:25 Ready to write response ...
	2024/03/04 11:49:29 Ready to marshal response ...
	2024/03/04 11:49:29 Ready to write response ...
	
	
	==> kernel <==
	 11:49:30 up 11:31,  0 users,  load average: 1.86, 2.49, 2.02
	Linux addons-975865 5.15.0-1052-gcp #60~20.04.1-Ubuntu SMP Thu Feb 15 13:21:04 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.3 LTS"
	
	
	==> kindnet [290286ddcebc3552c8b82150f8568464609b6066a2389799cb2df56e4a8f7445] <==
	I0304 11:48:03.408590       1 main.go:102] connected to apiserver: https://10.96.0.1:443
	I0304 11:48:03.408670       1 main.go:107] hostIP = 192.168.49.2
	podIP = 192.168.49.2
	I0304 11:48:03.408878       1 main.go:116] setting mtu 1500 for CNI 
	I0304 11:48:03.408904       1 main.go:146] kindnetd IP family: "ipv4"
	I0304 11:48:03.408919       1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]
	I0304 11:48:03.714055       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:48:03.714089       1 main.go:227] handling current node
	I0304 11:48:13.817433       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:48:13.817462       1 main.go:227] handling current node
	I0304 11:48:23.829948       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:48:23.829983       1 main.go:227] handling current node
	I0304 11:48:33.907276       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:48:33.907548       1 main.go:227] handling current node
	I0304 11:48:43.919554       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:48:43.919580       1 main.go:227] handling current node
	I0304 11:48:53.926914       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:48:53.927027       1 main.go:227] handling current node
	I0304 11:49:03.930923       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:49:03.930954       1 main.go:227] handling current node
	I0304 11:49:13.935034       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:49:13.935058       1 main.go:227] handling current node
	I0304 11:49:24.028602       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:49:24.028641       1 main.go:227] handling current node
	
	
	==> kube-apiserver [e1ce9291c9551d537e0322399929aad9bcf8c4cbea0bddecf12315bedee5c63f] <==
	E0304 11:48:03.815061       1 controller.go:102] loading OpenAPI spec for "v1beta1.metrics.k8s.io" failed with: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0304 11:48:03.816446       1 controller.go:109] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Rate Limited Requeue.
	I0304 11:48:03.926008       1 alloc.go:330] "allocated clusterIPs" service="kube-system/csi-hostpath-attacher" clusterIPs={"IPv4":"10.100.64.184"}
	I0304 11:48:03.937958       1 controller.go:624] quota admission added evaluator for: statefulsets.apps
	I0304 11:48:04.123782       1 alloc.go:330] "allocated clusterIPs" service="kube-system/csi-hostpath-resizer" clusterIPs={"IPv4":"10.104.8.119"}
	W0304 11:48:04.213241       1 aggregator.go:166] failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0304 11:48:05.903228       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	I0304 11:48:05.906301       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	W0304 11:48:06.125117       1 aggregator.go:166] failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	I0304 11:48:07.921862       1 alloc.go:330] "allocated clusterIPs" service="gcp-auth/gcp-auth" clusterIPs={"IPv4":"10.110.66.7"}
	E0304 11:48:28.273362       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.99.105.186:443/apis/metrics.k8s.io/v1beta1: Get "https://10.99.105.186:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.99.105.186:443: connect: connection refused
	W0304 11:48:28.273521       1 handler_proxy.go:93] no RequestInfo found in the context
	E0304 11:48:28.273582       1 controller.go:146] Error updating APIService "v1beta1.metrics.k8s.io" with err: failed to download v1beta1.metrics.k8s.io: failed to retrieve openAPI spec, http error: ResponseCode: 503, Body: service unavailable
	, Header: map[Content-Type:[text/plain; charset=utf-8] X-Content-Type-Options:[nosniff]]
	E0304 11:48:28.273940       1 available_controller.go:460] v1beta1.metrics.k8s.io failed with: failing or missing response from https://10.99.105.186:443/apis/metrics.k8s.io/v1beta1: Get "https://10.99.105.186:443/apis/metrics.k8s.io/v1beta1": dial tcp 10.99.105.186:443: connect: connection refused
	I0304 11:48:28.275236       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	I0304 11:48:28.307416       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	I0304 11:48:38.575763       1 handler.go:232] Adding GroupVersion metrics.k8s.io v1beta1 to ResourceManager
	E0304 11:49:22.048107       1 upgradeaware.go:425] Error proxying data from client to backend: read tcp 192.168.49.2:8443->10.244.0.22:55138: read: connection reset by peer
	E0304 11:49:27.604340       1 watch.go:287] unable to encode watch object *v1.WatchEvent: http2: stream closed (&streaming.encoderWithAllocator{writer:responsewriter.outerWithCloseNotifyAndFlush{UserProvidedDecorator:(*metrics.ResponseWriterDelegator)(0xc00f73e870), InnerCloseNotifierFlusher:struct { httpsnoop.Unwrapper; http.ResponseWriter; http.Flusher; http.CloseNotifier; http.Pusher }{Unwrapper:(*httpsnoop.rw)(0xc00f902960), ResponseWriter:(*httpsnoop.rw)(0xc00f902960), Flusher:(*httpsnoop.rw)(0xc00f902960), CloseNotifier:(*httpsnoop.rw)(0xc00f902960), Pusher:(*httpsnoop.rw)(0xc00f902960)}}, encoder:(*versioning.codec)(0xc00efdb9a0), memAllocator:(*runtime.Allocator)(0xc008f04810)})
	I0304 11:49:29.281359       1 controller.go:129] OpenAPI AggregationController: action for item v1beta1.metrics.k8s.io: Nothing (removed from the queue).
	I0304 11:49:30.136225       1 controller.go:624] quota admission added evaluator for: ingresses.networking.k8s.io
	
	
	==> kube-controller-manager [aee137a866e7b5068ad152a72a43dba65d53df6dea4a74d3b998a58e03a1d017] <==
	I0304 11:48:48.610858       1 job_controller.go:562] "enqueueing job" key="gcp-auth/gcp-auth-certs-create"
	I0304 11:48:48.620066       1 job_controller.go:562] "enqueueing job" key="gcp-auth/gcp-auth-certs-create"
	I0304 11:48:48.625739       1 job_controller.go:562] "enqueueing job" key="gcp-auth/gcp-auth-certs-create"
	I0304 11:48:48.625761       1 event.go:307] "Event occurred" object="gcp-auth/gcp-auth-certs-create" fieldPath="" kind="Job" apiVersion="batch/v1" type="Normal" reason="Completed" message="Job completed"
	I0304 11:48:48.702611       1 job_controller.go:562] "enqueueing job" key="gcp-auth/gcp-auth-certs-patch"
	I0304 11:48:48.709835       1 job_controller.go:562] "enqueueing job" key="gcp-auth/gcp-auth-certs-patch"
	I0304 11:48:48.715352       1 job_controller.go:562] "enqueueing job" key="gcp-auth/gcp-auth-certs-patch"
	I0304 11:48:48.715410       1 event.go:307] "Event occurred" object="gcp-auth/gcp-auth-certs-patch" fieldPath="" kind="Job" apiVersion="batch/v1" type="Normal" reason="Completed" message="Job completed"
	I0304 11:48:52.437433       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-76dc478dd8" duration="95.805µs"
	I0304 11:49:01.163304       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-76dc478dd8" duration="96.481149ms"
	I0304 11:49:01.163536       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="ingress-nginx/ingress-nginx-controller-76dc478dd8" duration="100.86µs"
	I0304 11:49:14.524833       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="gcp-auth/gcp-auth-5f6b4f85fd" duration="5.93445ms"
	I0304 11:49:14.524929       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="gcp-auth/gcp-auth-5f6b4f85fd" duration="52.642µs"
	I0304 11:49:18.013629       1 job_controller.go:562] "enqueueing job" key="gcp-auth/gcp-auth-certs-create"
	I0304 11:49:18.015290       1 job_controller.go:562] "enqueueing job" key="gcp-auth/gcp-auth-certs-patch"
	I0304 11:49:18.036485       1 job_controller.go:562] "enqueueing job" key="gcp-auth/gcp-auth-certs-create"
	I0304 11:49:18.037744       1 job_controller.go:562] "enqueueing job" key="gcp-auth/gcp-auth-certs-patch"
	I0304 11:49:21.170267       1 event.go:307] "Event occurred" object="default/test-pvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="WaitForFirstConsumer" message="waiting for first consumer to be created before binding"
	I0304 11:49:21.322457       1 event.go:307] "Event occurred" object="default/test-pvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered."
	I0304 11:49:21.323048       1 event.go:307] "Event occurred" object="default/test-pvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered."
	I0304 11:49:24.225603       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/tiller-deploy-7b677967b9" duration="6.415µs"
	I0304 11:49:24.366938       1 event.go:307] "Event occurred" object="default/test-pvc" fieldPath="" kind="PersistentVolumeClaim" apiVersion="v1" type="Normal" reason="ExternalProvisioning" message="Waiting for a volume to be created either by the external provisioner 'rancher.io/local-path' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered."
	I0304 11:49:27.203517       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="kube-system/metrics-server-69cf46c98" duration="13.672µs"
	I0304 11:49:28.230533       1 replica_set.go:676] "Finished syncing" kind="ReplicationController" key="kube-system/registry" duration="14.429µs"
	I0304 11:49:29.805570       1 replica_set.go:676] "Finished syncing" kind="ReplicaSet" key="default/cloud-spanner-emulator-6548d5df46" duration="6.581µs"
	
	
	==> kube-proxy [8a9996107fda7254c7e92a44159d2f25f966c65eacee8764573c09ddc214471b] <==
	I0304 11:47:56.512587       1 server_others.go:69] "Using iptables proxy"
	I0304 11:47:56.803862       1 node.go:141] Successfully retrieved node IP: 192.168.49.2
	I0304 11:47:59.209528       1 server.go:632] "kube-proxy running in dual-stack mode" primary ipFamily="IPv4"
	I0304 11:47:59.212390       1 server_others.go:152] "Using iptables Proxier"
	I0304 11:47:59.212515       1 server_others.go:421] "Detect-local-mode set to ClusterCIDR, but no cluster CIDR for family" ipFamily="IPv6"
	I0304 11:47:59.212565       1 server_others.go:438] "Defaulting to no-op detect-local"
	I0304 11:47:59.212627       1 proxier.go:251] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"
	I0304 11:47:59.212907       1 server.go:846] "Version info" version="v1.28.4"
	I0304 11:47:59.213253       1 server.go:848] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
	I0304 11:47:59.214234       1 config.go:188] "Starting service config controller"
	I0304 11:47:59.215437       1 shared_informer.go:311] Waiting for caches to sync for service config
	I0304 11:47:59.214744       1 config.go:97] "Starting endpoint slice config controller"
	I0304 11:47:59.215560       1 shared_informer.go:311] Waiting for caches to sync for endpoint slice config
	I0304 11:47:59.215163       1 config.go:315] "Starting node config controller"
	I0304 11:47:59.215629       1 shared_informer.go:311] Waiting for caches to sync for node config
	I0304 11:47:59.321393       1 shared_informer.go:318] Caches are synced for service config
	I0304 11:47:59.321442       1 shared_informer.go:318] Caches are synced for endpoint slice config
	I0304 11:47:59.523058       1 shared_informer.go:318] Caches are synced for node config
	
	
	==> kube-scheduler [14ddd4820fa928efc9c0709541d7d4920e4ec4e0643dec69ca95c924d01edc9e] <==
	W0304 11:47:38.815912       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0304 11:47:38.815933       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	W0304 11:47:38.816000       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0304 11:47:38.816010       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	E0304 11:47:38.816022       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0304 11:47:38.816024       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope
	W0304 11:47:38.816032       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0304 11:47:38.816060       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	W0304 11:47:38.816097       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0304 11:47:38.816117       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	W0304 11:47:38.816117       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0304 11:47:38.816155       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	W0304 11:47:38.816157       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	E0304 11:47:38.816178       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope
	W0304 11:47:38.816184       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0304 11:47:38.816198       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	W0304 11:47:38.816350       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0304 11:47:38.816419       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	W0304 11:47:39.772539       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	E0304 11:47:39.772578       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope
	W0304 11:47:39.820552       1 reflector.go:535] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0304 11:47:39.820618       1 reflector.go:147] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	W0304 11:47:39.877747       1 reflector.go:535] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0304 11:47:39.877787       1 reflector.go:147] pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	I0304 11:47:42.510708       1 shared_informer.go:318] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	
	
	==> kubelet <==
	Mar 04 11:49:29 addons-975865 kubelet[1558]: I0304 11:49:29.833723    1558 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eeab5c60-f96a-488e-b668-8316e0664295" path="/var/lib/kubelet/pods/eeab5c60-f96a-488e-b668-8316e0664295/volumes"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: I0304 11:49:30.002934    1558 topology_manager.go:215] "Topology Admit Handler" podUID="6aec3f58-241e-4c1d-a7f1-7bd1de4bfa0d" podNamespace="local-path-storage" podName="helper-pod-delete-pvc-b19b11ba-71fe-4d1c-b122-7cb5d5ad1463"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: E0304 11:49:30.003039    1558 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="4540583d-c966-44cd-ab06-dd11a0e3f62f" containerName="busybox"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: E0304 11:49:30.003058    1558 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="cc50fbf1-ba8e-4734-b9e3-0ae2668c0265" containerName="metrics-server"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: E0304 11:49:30.003072    1558 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="42e61ef6-c3d7-4233-91a3-8a94b33ae8f7" containerName="registry-test"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: E0304 11:49:30.003083    1558 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="eeab5c60-f96a-488e-b668-8316e0664295" containerName="registry"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: E0304 11:49:30.003097    1558 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="b5a1edef-e542-4acc-8e53-db66447354b3" containerName="registry-proxy"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: I0304 11:49:30.003144    1558 memory_manager.go:346] "RemoveStaleState removing state" podUID="cc50fbf1-ba8e-4734-b9e3-0ae2668c0265" containerName="metrics-server"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: I0304 11:49:30.003153    1558 memory_manager.go:346] "RemoveStaleState removing state" podUID="4540583d-c966-44cd-ab06-dd11a0e3f62f" containerName="busybox"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: I0304 11:49:30.003168    1558 memory_manager.go:346] "RemoveStaleState removing state" podUID="b5a1edef-e542-4acc-8e53-db66447354b3" containerName="registry-proxy"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: I0304 11:49:30.003177    1558 memory_manager.go:346] "RemoveStaleState removing state" podUID="eeab5c60-f96a-488e-b668-8316e0664295" containerName="registry"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: I0304 11:49:30.003187    1558 memory_manager.go:346] "RemoveStaleState removing state" podUID="42e61ef6-c3d7-4233-91a3-8a94b33ae8f7" containerName="registry-test"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: I0304 11:49:30.103774    1558 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"script\" (UniqueName: \"kubernetes.io/configmap/6aec3f58-241e-4c1d-a7f1-7bd1de4bfa0d-script\") pod \"helper-pod-delete-pvc-b19b11ba-71fe-4d1c-b122-7cb5d5ad1463\" (UID: \"6aec3f58-241e-4c1d-a7f1-7bd1de4bfa0d\") " pod="local-path-storage/helper-pod-delete-pvc-b19b11ba-71fe-4d1c-b122-7cb5d5ad1463"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: I0304 11:49:30.103865    1558 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvwzx\" (UniqueName: \"kubernetes.io/projected/6aec3f58-241e-4c1d-a7f1-7bd1de4bfa0d-kube-api-access-cvwzx\") pod \"helper-pod-delete-pvc-b19b11ba-71fe-4d1c-b122-7cb5d5ad1463\" (UID: \"6aec3f58-241e-4c1d-a7f1-7bd1de4bfa0d\") " pod="local-path-storage/helper-pod-delete-pvc-b19b11ba-71fe-4d1c-b122-7cb5d5ad1463"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: I0304 11:49:30.103920    1558 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/6aec3f58-241e-4c1d-a7f1-7bd1de4bfa0d-gcp-creds\") pod \"helper-pod-delete-pvc-b19b11ba-71fe-4d1c-b122-7cb5d5ad1463\" (UID: \"6aec3f58-241e-4c1d-a7f1-7bd1de4bfa0d\") " pod="local-path-storage/helper-pod-delete-pvc-b19b11ba-71fe-4d1c-b122-7cb5d5ad1463"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: I0304 11:49:30.103961    1558 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/host-path/6aec3f58-241e-4c1d-a7f1-7bd1de4bfa0d-data\") pod \"helper-pod-delete-pvc-b19b11ba-71fe-4d1c-b122-7cb5d5ad1463\" (UID: \"6aec3f58-241e-4c1d-a7f1-7bd1de4bfa0d\") " pod="local-path-storage/helper-pod-delete-pvc-b19b11ba-71fe-4d1c-b122-7cb5d5ad1463"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: I0304 11:49:30.204750    1558 reconciler_common.go:172] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6rg8\" (UniqueName: \"kubernetes.io/projected/607fe160-2a65-4b8c-910e-de0444790e10-kube-api-access-n6rg8\") pod \"607fe160-2a65-4b8c-910e-de0444790e10\" (UID: \"607fe160-2a65-4b8c-910e-de0444790e10\") "
	Mar 04 11:49:30 addons-975865 kubelet[1558]: I0304 11:49:30.207010    1558 operation_generator.go:882] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/607fe160-2a65-4b8c-910e-de0444790e10-kube-api-access-n6rg8" (OuterVolumeSpecName: "kube-api-access-n6rg8") pod "607fe160-2a65-4b8c-910e-de0444790e10" (UID: "607fe160-2a65-4b8c-910e-de0444790e10"). InnerVolumeSpecName "kube-api-access-n6rg8". PluginName "kubernetes.io/projected", VolumeGidValue ""
	Mar 04 11:49:30 addons-975865 kubelet[1558]: I0304 11:49:30.305337    1558 reconciler_common.go:300] "Volume detached for volume \"kube-api-access-n6rg8\" (UniqueName: \"kubernetes.io/projected/607fe160-2a65-4b8c-910e-de0444790e10-kube-api-access-n6rg8\") on node \"addons-975865\" DevicePath \"\""
	Mar 04 11:49:30 addons-975865 kubelet[1558]: I0304 11:49:30.313614    1558 topology_manager.go:215] "Topology Admit Handler" podUID="7cec65fb-dd3f-4f06-8f45-41742249b981" podNamespace="default" podName="nginx"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: E0304 11:49:30.313723    1558 cpu_manager.go:395] "RemoveStaleState: removing container" podUID="607fe160-2a65-4b8c-910e-de0444790e10" containerName="cloud-spanner-emulator"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: I0304 11:49:30.313782    1558 memory_manager.go:346] "RemoveStaleState removing state" podUID="607fe160-2a65-4b8c-910e-de0444790e10" containerName="cloud-spanner-emulator"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: W0304 11:49:30.338143    1558 manager.go:1159] Failed to process watch event {EventType:0 Name:/docker/89c01ac9a8151395a60453aa534f39efedae7b9a9a00081eb711e101e4ec0822/crio-145815f95555227ddc61d7e140dbc19921fedd1dae49e625b397d786c76db0bb WatchSource:0}: Error finding container 145815f95555227ddc61d7e140dbc19921fedd1dae49e625b397d786c76db0bb: Status 404 returned error can't find the container with id 145815f95555227ddc61d7e140dbc19921fedd1dae49e625b397d786c76db0bb
	Mar 04 11:49:30 addons-975865 kubelet[1558]: I0304 11:49:30.405840    1558 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6crtx\" (UniqueName: \"kubernetes.io/projected/7cec65fb-dd3f-4f06-8f45-41742249b981-kube-api-access-6crtx\") pod \"nginx\" (UID: \"7cec65fb-dd3f-4f06-8f45-41742249b981\") " pod="default/nginx"
	Mar 04 11:49:30 addons-975865 kubelet[1558]: I0304 11:49:30.405890    1558 reconciler_common.go:258] "operationExecutor.VerifyControllerAttachedVolume started for volume \"gcp-creds\" (UniqueName: \"kubernetes.io/host-path/7cec65fb-dd3f-4f06-8f45-41742249b981-gcp-creds\") pod \"nginx\" (UID: \"7cec65fb-dd3f-4f06-8f45-41742249b981\") " pod="default/nginx"
	
	
	==> storage-provisioner [ab441c3a89cf4277af6d68ab05c84601f4d7329f9a5e71a956ae43037dd8ed5f] <==
	I0304 11:48:08.207370       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0304 11:48:08.219149       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0304 11:48:08.219202       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0304 11:48:08.230460       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0304 11:48:08.230670       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_addons-975865_801b5a50-8a27-4dc3-9875-8fa0026169bb!
	I0304 11:48:08.231719       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"7b196ec1-25b9-4762-8775-b0932dc3577b", APIVersion:"v1", ResourceVersion:"844", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' addons-975865_801b5a50-8a27-4dc3-9875-8fa0026169bb became leader
	I0304 11:48:08.402350       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_addons-975865_801b5a50-8a27-4dc3-9875-8fa0026169bb!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p addons-975865 -n addons-975865
helpers_test.go:261: (dbg) Run:  kubectl --context addons-975865 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:272: non-running pods: nginx ingress-nginx-admission-create-dxvpr ingress-nginx-admission-patch-6pkpn helper-pod-delete-pvc-b19b11ba-71fe-4d1c-b122-7cb5d5ad1463
helpers_test.go:274: ======> post-mortem[TestAddons/parallel/Headlamp]: describe non-running pods <======
helpers_test.go:277: (dbg) Run:  kubectl --context addons-975865 describe pod nginx ingress-nginx-admission-create-dxvpr ingress-nginx-admission-patch-6pkpn helper-pod-delete-pvc-b19b11ba-71fe-4d1c-b122-7cb5d5ad1463
helpers_test.go:277: (dbg) Non-zero exit: kubectl --context addons-975865 describe pod nginx ingress-nginx-admission-create-dxvpr ingress-nginx-admission-patch-6pkpn helper-pod-delete-pvc-b19b11ba-71fe-4d1c-b122-7cb5d5ad1463: exit status 1 (79.786722ms)

                                                
                                                
-- stdout --
	Name:             nginx
	Namespace:        default
	Priority:         0
	Service Account:  default
	Node:             addons-975865/192.168.49.2
	Start Time:       Mon, 04 Mar 2024 11:49:30 +0000
	Labels:           run=nginx
	Annotations:      <none>
	Status:           Pending
	IP:               
	IPs:              <none>
	Containers:
	  nginx:
	    Container ID:   
	    Image:          docker.io/nginx:alpine
	    Image ID:       
	    Port:           80/TCP
	    Host Port:      0/TCP
	    State:          Waiting
	      Reason:       ContainerCreating
	    Ready:          False
	    Restart Count:  0
	    Environment:
	      GOOGLE_APPLICATION_CREDENTIALS:  /google-app-creds.json
	      PROJECT_ID:                      this_is_fake
	      GCP_PROJECT:                     this_is_fake
	      GCLOUD_PROJECT:                  this_is_fake
	      GOOGLE_CLOUD_PROJECT:            this_is_fake
	      CLOUDSDK_CORE_PROJECT:           this_is_fake
	    Mounts:
	      /google-app-creds.json from gcp-creds (ro)
	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-6crtx (ro)
	Conditions:
	  Type              Status
	  Initialized       True 
	  Ready             False 
	  ContainersReady   False 
	  PodScheduled      True 
	Volumes:
	  kube-api-access-6crtx:
	    Type:                    Projected (a volume that contains injected data from multiple sources)
	    TokenExpirationSeconds:  3607
	    ConfigMapName:           kube-root-ca.crt
	    ConfigMapOptional:       <nil>
	    DownwardAPI:             true
	  gcp-creds:
	    Type:          HostPath (bare host directory volume)
	    Path:          /var/lib/minikube/google_application_credentials.json
	    HostPathType:  File
	QoS Class:         BestEffort
	Node-Selectors:    <none>
	Tolerations:       node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
	                   node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
	Events:
	  Type    Reason     Age   From               Message
	  ----    ------     ----  ----               -------
	  Normal  Scheduled  1s    default-scheduler  Successfully assigned default/nginx to addons-975865
	  Normal  Pulling    1s    kubelet            Pulling image "docker.io/nginx:alpine"

                                                
                                                
-- /stdout --
** stderr ** 
	Error from server (NotFound): pods "ingress-nginx-admission-create-dxvpr" not found
	Error from server (NotFound): pods "ingress-nginx-admission-patch-6pkpn" not found
	Error from server (NotFound): pods "helper-pod-delete-pvc-b19b11ba-71fe-4d1c-b122-7cb5d5ad1463" not found

                                                
                                                
** /stderr **
helpers_test.go:279: kubectl --context addons-975865 describe pod nginx ingress-nginx-admission-create-dxvpr ingress-nginx-admission-patch-6pkpn helper-pod-delete-pvc-b19b11ba-71fe-4d1c-b122-7cb5d5ad1463: exit status 1
--- FAIL: TestAddons/parallel/Headlamp (2.80s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddons (175.42s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddons
addons_test.go:207: (dbg) Run:  kubectl --context ingress-addon-legacy-577846 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:207: (dbg) Done: kubectl --context ingress-addon-legacy-577846 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s: (11.129800925s)
addons_test.go:232: (dbg) Run:  kubectl --context ingress-addon-legacy-577846 replace --force -f testdata/nginx-ingress-v1beta1.yaml
addons_test.go:245: (dbg) Run:  kubectl --context ingress-addon-legacy-577846 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:250: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [bc22b43a-b3e0-411e-b6e3-26e4dcf59e5c] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [bc22b43a-b3e0-411e-b6e3-26e4dcf59e5c] Running
addons_test.go:250: (dbg) TestIngressAddonLegacy/serial/ValidateIngressAddons: run=nginx healthy within 8.003985834s
addons_test.go:262: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-577846 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
E0304 11:59:15.024943  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
E0304 11:59:42.708326  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
addons_test.go:262: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ingress-addon-legacy-577846 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'": exit status 1 (2m10.261267161s)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 28

                                                
                                                
** /stderr **
addons_test.go:278: failed to get expected response from http://127.0.0.1/ within minikube: exit status 1
addons_test.go:286: (dbg) Run:  kubectl --context ingress-addon-legacy-577846 replace --force -f testdata/ingress-dns-example-v1beta1.yaml
addons_test.go:291: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-577846 ip
addons_test.go:297: (dbg) Run:  nslookup hello-john.test 192.168.49.2
addons_test.go:297: (dbg) Non-zero exit: nslookup hello-john.test 192.168.49.2: exit status 1 (15.016149099s)

                                                
                                                
-- stdout --
	;; connection timed out; no servers could be reached
	
	

                                                
                                                
-- /stdout --
addons_test.go:299: failed to nslookup hello-john.test host. args "nslookup hello-john.test 192.168.49.2" : exit status 1
addons_test.go:303: unexpected output from nslookup. stdout: ;; connection timed out; no servers could be reached

                                                
                                                

                                                
                                                

                                                
                                                
stderr: 
addons_test.go:306: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-577846 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:306: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-577846 addons disable ingress-dns --alsologtostderr -v=1: (1.016023427s)
addons_test.go:311: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-577846 addons disable ingress --alsologtostderr -v=1
E0304 12:00:16.003471  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
E0304 12:00:16.008765  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
E0304 12:00:16.018996  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
E0304 12:00:16.039237  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
E0304 12:00:16.079525  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
E0304 12:00:16.159853  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
E0304 12:00:16.320264  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
E0304 12:00:16.640835  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
E0304 12:00:17.281782  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
E0304 12:00:18.562230  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
E0304 12:00:21.123513  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
addons_test.go:311: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-577846 addons disable ingress --alsologtostderr -v=1: (7.378884742s)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:230: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: docker inspect <======
helpers_test.go:231: (dbg) Run:  docker inspect ingress-addon-legacy-577846
helpers_test.go:235: (dbg) docker inspect ingress-addon-legacy-577846:

                                                
                                                
-- stdout --
	[
	    {
	        "Id": "8201143f38bf371b37f6e8b719bc7ff803055b4ae60fbf06fbdb1f755cede4ae",
	        "Created": "2024-03-04T11:56:14.670549312Z",
	        "Path": "/usr/local/bin/entrypoint",
	        "Args": [
	            "/sbin/init"
	        ],
	        "State": {
	            "Status": "running",
	            "Running": true,
	            "Paused": false,
	            "Restarting": false,
	            "OOMKilled": false,
	            "Dead": false,
	            "Pid": 444979,
	            "ExitCode": 0,
	            "Error": "",
	            "StartedAt": "2024-03-04T11:56:14.911718348Z",
	            "FinishedAt": "0001-01-01T00:00:00Z"
	        },
	        "Image": "sha256:a5b872dc86053f77fb58d93168e89c4b0fa5961a7ed628d630f6cd6decd7bca0",
	        "ResolvConfPath": "/var/lib/docker/containers/8201143f38bf371b37f6e8b719bc7ff803055b4ae60fbf06fbdb1f755cede4ae/resolv.conf",
	        "HostnamePath": "/var/lib/docker/containers/8201143f38bf371b37f6e8b719bc7ff803055b4ae60fbf06fbdb1f755cede4ae/hostname",
	        "HostsPath": "/var/lib/docker/containers/8201143f38bf371b37f6e8b719bc7ff803055b4ae60fbf06fbdb1f755cede4ae/hosts",
	        "LogPath": "/var/lib/docker/containers/8201143f38bf371b37f6e8b719bc7ff803055b4ae60fbf06fbdb1f755cede4ae/8201143f38bf371b37f6e8b719bc7ff803055b4ae60fbf06fbdb1f755cede4ae-json.log",
	        "Name": "/ingress-addon-legacy-577846",
	        "RestartCount": 0,
	        "Driver": "overlay2",
	        "Platform": "linux",
	        "MountLabel": "",
	        "ProcessLabel": "",
	        "AppArmorProfile": "unconfined",
	        "ExecIDs": null,
	        "HostConfig": {
	            "Binds": [
	                "/lib/modules:/lib/modules:ro",
	                "ingress-addon-legacy-577846:/var"
	            ],
	            "ContainerIDFile": "",
	            "LogConfig": {
	                "Type": "json-file",
	                "Config": {
	                    "max-size": "100m"
	                }
	            },
	            "NetworkMode": "ingress-addon-legacy-577846",
	            "PortBindings": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": ""
	                    }
	                ]
	            },
	            "RestartPolicy": {
	                "Name": "no",
	                "MaximumRetryCount": 0
	            },
	            "AutoRemove": false,
	            "VolumeDriver": "",
	            "VolumesFrom": null,
	            "ConsoleSize": [
	                0,
	                0
	            ],
	            "CapAdd": null,
	            "CapDrop": null,
	            "CgroupnsMode": "host",
	            "Dns": [],
	            "DnsOptions": [],
	            "DnsSearch": [],
	            "ExtraHosts": null,
	            "GroupAdd": null,
	            "IpcMode": "private",
	            "Cgroup": "",
	            "Links": null,
	            "OomScoreAdj": 0,
	            "PidMode": "",
	            "Privileged": true,
	            "PublishAllPorts": false,
	            "ReadonlyRootfs": false,
	            "SecurityOpt": [
	                "seccomp=unconfined",
	                "apparmor=unconfined",
	                "label=disable"
	            ],
	            "Tmpfs": {
	                "/run": "",
	                "/tmp": ""
	            },
	            "UTSMode": "",
	            "UsernsMode": "",
	            "ShmSize": 67108864,
	            "Runtime": "runc",
	            "Isolation": "",
	            "CpuShares": 0,
	            "Memory": 4294967296,
	            "NanoCpus": 2000000000,
	            "CgroupParent": "",
	            "BlkioWeight": 0,
	            "BlkioWeightDevice": [],
	            "BlkioDeviceReadBps": [],
	            "BlkioDeviceWriteBps": [],
	            "BlkioDeviceReadIOps": [],
	            "BlkioDeviceWriteIOps": [],
	            "CpuPeriod": 0,
	            "CpuQuota": 0,
	            "CpuRealtimePeriod": 0,
	            "CpuRealtimeRuntime": 0,
	            "CpusetCpus": "",
	            "CpusetMems": "",
	            "Devices": [],
	            "DeviceCgroupRules": null,
	            "DeviceRequests": null,
	            "MemoryReservation": 0,
	            "MemorySwap": 8589934592,
	            "MemorySwappiness": null,
	            "OomKillDisable": false,
	            "PidsLimit": null,
	            "Ulimits": [],
	            "CpuCount": 0,
	            "CpuPercent": 0,
	            "IOMaximumIOps": 0,
	            "IOMaximumBandwidth": 0,
	            "MaskedPaths": null,
	            "ReadonlyPaths": null
	        },
	        "GraphDriver": {
	            "Data": {
	                "LowerDir": "/var/lib/docker/overlay2/0c4e004f2fd1430728bd9704fabf07a0e44f603bcce28bf081eff561e6a3cc09-init/diff:/var/lib/docker/overlay2/6777c34f254c285e28a6f05fba96b29f9919e3bc636ac1ce063284fa05399be2/diff",
	                "MergedDir": "/var/lib/docker/overlay2/0c4e004f2fd1430728bd9704fabf07a0e44f603bcce28bf081eff561e6a3cc09/merged",
	                "UpperDir": "/var/lib/docker/overlay2/0c4e004f2fd1430728bd9704fabf07a0e44f603bcce28bf081eff561e6a3cc09/diff",
	                "WorkDir": "/var/lib/docker/overlay2/0c4e004f2fd1430728bd9704fabf07a0e44f603bcce28bf081eff561e6a3cc09/work"
	            },
	            "Name": "overlay2"
	        },
	        "Mounts": [
	            {
	                "Type": "bind",
	                "Source": "/lib/modules",
	                "Destination": "/lib/modules",
	                "Mode": "ro",
	                "RW": false,
	                "Propagation": "rprivate"
	            },
	            {
	                "Type": "volume",
	                "Name": "ingress-addon-legacy-577846",
	                "Source": "/var/lib/docker/volumes/ingress-addon-legacy-577846/_data",
	                "Destination": "/var",
	                "Driver": "local",
	                "Mode": "z",
	                "RW": true,
	                "Propagation": ""
	            }
	        ],
	        "Config": {
	            "Hostname": "ingress-addon-legacy-577846",
	            "Domainname": "",
	            "User": "",
	            "AttachStdin": false,
	            "AttachStdout": false,
	            "AttachStderr": false,
	            "ExposedPorts": {
	                "22/tcp": {},
	                "2376/tcp": {},
	                "32443/tcp": {},
	                "5000/tcp": {},
	                "8443/tcp": {}
	            },
	            "Tty": true,
	            "OpenStdin": false,
	            "StdinOnce": false,
	            "Env": [
	                "container=docker",
	                "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
	            ],
	            "Cmd": null,
	            "Image": "gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08",
	            "Volumes": null,
	            "WorkingDir": "/",
	            "Entrypoint": [
	                "/usr/local/bin/entrypoint",
	                "/sbin/init"
	            ],
	            "OnBuild": null,
	            "Labels": {
	                "created_by.minikube.sigs.k8s.io": "true",
	                "mode.minikube.sigs.k8s.io": "ingress-addon-legacy-577846",
	                "name.minikube.sigs.k8s.io": "ingress-addon-legacy-577846",
	                "role.minikube.sigs.k8s.io": ""
	            },
	            "StopSignal": "SIGRTMIN+3"
	        },
	        "NetworkSettings": {
	            "Bridge": "",
	            "SandboxID": "323e21173161409cafd8ddd65b85f73df1687affde2412569409b3db95e960e3",
	            "SandboxKey": "/var/run/docker/netns/323e21173161",
	            "Ports": {
	                "22/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32787"
	                    }
	                ],
	                "2376/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32786"
	                    }
	                ],
	                "32443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32783"
	                    }
	                ],
	                "5000/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32785"
	                    }
	                ],
	                "8443/tcp": [
	                    {
	                        "HostIp": "127.0.0.1",
	                        "HostPort": "32784"
	                    }
	                ]
	            },
	            "HairpinMode": false,
	            "LinkLocalIPv6Address": "",
	            "LinkLocalIPv6PrefixLen": 0,
	            "SecondaryIPAddresses": null,
	            "SecondaryIPv6Addresses": null,
	            "EndpointID": "",
	            "Gateway": "",
	            "GlobalIPv6Address": "",
	            "GlobalIPv6PrefixLen": 0,
	            "IPAddress": "",
	            "IPPrefixLen": 0,
	            "IPv6Gateway": "",
	            "MacAddress": "",
	            "Networks": {
	                "ingress-addon-legacy-577846": {
	                    "IPAMConfig": {
	                        "IPv4Address": "192.168.49.2"
	                    },
	                    "Links": null,
	                    "Aliases": [
	                        "8201143f38bf",
	                        "ingress-addon-legacy-577846"
	                    ],
	                    "MacAddress": "02:42:c0:a8:31:02",
	                    "NetworkID": "32c12c0b48d9bfbd49b32f4f7f20bfe2054b1f254834eba17c4e80de65d6de12",
	                    "EndpointID": "f0e4766c26434c7f9d5b6828791cf63f8825f84ab37fb40e8cd73e243e990098",
	                    "Gateway": "192.168.49.1",
	                    "IPAddress": "192.168.49.2",
	                    "IPPrefixLen": 24,
	                    "IPv6Gateway": "",
	                    "GlobalIPv6Address": "",
	                    "GlobalIPv6PrefixLen": 0,
	                    "DriverOpts": null,
	                    "DNSNames": [
	                        "ingress-addon-legacy-577846",
	                        "8201143f38bf"
	                    ]
	                }
	            }
	        }
	    }
	]

                                                
                                                
-- /stdout --
helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ingress-addon-legacy-577846 -n ingress-addon-legacy-577846
helpers_test.go:244: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: start of post-mortem logs <<<
helpers_test.go:245: ======>  post-mortem[TestIngressAddonLegacy/serial/ValidateIngressAddons]: minikube logs <======
helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-577846 logs -n 25
helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-577846 logs -n 25: (1.044579926s)
helpers_test.go:252: TestIngressAddonLegacy/serial/ValidateIngressAddons logs: 
-- stdout --
	
	==> Audit <==
	|---------|------------------------------------------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	| Command |                                     Args                                     |           Profile           |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	| image   | functional-093444 image load --daemon                                        | functional-093444           | jenkins | v1.32.0 | 04 Mar 24 11:55 UTC | 04 Mar 24 11:55 UTC |
	|         | gcr.io/google-containers/addon-resizer:functional-093444                     |                             |         |         |                     |                     |
	|         | --alsologtostderr                                                            |                             |         |         |                     |                     |
	| image   | functional-093444 image ls                                                   | functional-093444           | jenkins | v1.32.0 | 04 Mar 24 11:55 UTC | 04 Mar 24 11:55 UTC |
	| image   | functional-093444 image load --daemon                                        | functional-093444           | jenkins | v1.32.0 | 04 Mar 24 11:55 UTC | 04 Mar 24 11:55 UTC |
	|         | gcr.io/google-containers/addon-resizer:functional-093444                     |                             |         |         |                     |                     |
	|         | --alsologtostderr                                                            |                             |         |         |                     |                     |
	| image   | functional-093444 image ls                                                   | functional-093444           | jenkins | v1.32.0 | 04 Mar 24 11:55 UTC | 04 Mar 24 11:55 UTC |
	| image   | functional-093444 image save                                                 | functional-093444           | jenkins | v1.32.0 | 04 Mar 24 11:55 UTC | 04 Mar 24 11:55 UTC |
	|         | gcr.io/google-containers/addon-resizer:functional-093444                     |                             |         |         |                     |                     |
	|         | /home/jenkins/workspace/Docker_Linux_crio_integration/addon-resizer-save.tar |                             |         |         |                     |                     |
	|         | --alsologtostderr                                                            |                             |         |         |                     |                     |
	| image   | functional-093444 image rm                                                   | functional-093444           | jenkins | v1.32.0 | 04 Mar 24 11:55 UTC | 04 Mar 24 11:55 UTC |
	|         | gcr.io/google-containers/addon-resizer:functional-093444                     |                             |         |         |                     |                     |
	|         | --alsologtostderr                                                            |                             |         |         |                     |                     |
	| image   | functional-093444 image ls                                                   | functional-093444           | jenkins | v1.32.0 | 04 Mar 24 11:55 UTC | 04 Mar 24 11:55 UTC |
	| image   | functional-093444 image load                                                 | functional-093444           | jenkins | v1.32.0 | 04 Mar 24 11:55 UTC | 04 Mar 24 11:55 UTC |
	|         | /home/jenkins/workspace/Docker_Linux_crio_integration/addon-resizer-save.tar |                             |         |         |                     |                     |
	|         | --alsologtostderr                                                            |                             |         |         |                     |                     |
	| image   | functional-093444 image ls                                                   | functional-093444           | jenkins | v1.32.0 | 04 Mar 24 11:55 UTC | 04 Mar 24 11:55 UTC |
	| image   | functional-093444 image save --daemon                                        | functional-093444           | jenkins | v1.32.0 | 04 Mar 24 11:55 UTC | 04 Mar 24 11:55 UTC |
	|         | gcr.io/google-containers/addon-resizer:functional-093444                     |                             |         |         |                     |                     |
	|         | --alsologtostderr                                                            |                             |         |         |                     |                     |
	| image   | functional-093444                                                            | functional-093444           | jenkins | v1.32.0 | 04 Mar 24 11:55 UTC | 04 Mar 24 11:55 UTC |
	|         | image ls --format short                                                      |                             |         |         |                     |                     |
	|         | --alsologtostderr                                                            |                             |         |         |                     |                     |
	| ssh     | functional-093444 ssh pgrep                                                  | functional-093444           | jenkins | v1.32.0 | 04 Mar 24 11:55 UTC |                     |
	|         | buildkitd                                                                    |                             |         |         |                     |                     |
	| image   | functional-093444                                                            | functional-093444           | jenkins | v1.32.0 | 04 Mar 24 11:55 UTC | 04 Mar 24 11:55 UTC |
	|         | image ls --format yaml                                                       |                             |         |         |                     |                     |
	|         | --alsologtostderr                                                            |                             |         |         |                     |                     |
	| image   | functional-093444                                                            | functional-093444           | jenkins | v1.32.0 | 04 Mar 24 11:55 UTC | 04 Mar 24 11:55 UTC |
	|         | image ls --format json                                                       |                             |         |         |                     |                     |
	|         | --alsologtostderr                                                            |                             |         |         |                     |                     |
	| image   | functional-093444                                                            | functional-093444           | jenkins | v1.32.0 | 04 Mar 24 11:55 UTC | 04 Mar 24 11:55 UTC |
	|         | image ls --format table                                                      |                             |         |         |                     |                     |
	|         | --alsologtostderr                                                            |                             |         |         |                     |                     |
	| image   | functional-093444 image build -t                                             | functional-093444           | jenkins | v1.32.0 | 04 Mar 24 11:55 UTC | 04 Mar 24 11:55 UTC |
	|         | localhost/my-image:functional-093444                                         |                             |         |         |                     |                     |
	|         | testdata/build --alsologtostderr                                             |                             |         |         |                     |                     |
	| image   | functional-093444 image ls                                                   | functional-093444           | jenkins | v1.32.0 | 04 Mar 24 11:55 UTC | 04 Mar 24 11:56 UTC |
	| delete  | -p functional-093444                                                         | functional-093444           | jenkins | v1.32.0 | 04 Mar 24 11:56 UTC | 04 Mar 24 11:56 UTC |
	| start   | -p ingress-addon-legacy-577846                                               | ingress-addon-legacy-577846 | jenkins | v1.32.0 | 04 Mar 24 11:56 UTC | 04 Mar 24 11:57 UTC |
	|         | --kubernetes-version=v1.18.20                                                |                             |         |         |                     |                     |
	|         | --memory=4096 --wait=true                                                    |                             |         |         |                     |                     |
	|         | --alsologtostderr                                                            |                             |         |         |                     |                     |
	|         | -v=5 --driver=docker                                                         |                             |         |         |                     |                     |
	|         | --container-runtime=crio                                                     |                             |         |         |                     |                     |
	| addons  | ingress-addon-legacy-577846                                                  | ingress-addon-legacy-577846 | jenkins | v1.32.0 | 04 Mar 24 11:57 UTC | 04 Mar 24 11:57 UTC |
	|         | addons enable ingress                                                        |                             |         |         |                     |                     |
	|         | --alsologtostderr -v=5                                                       |                             |         |         |                     |                     |
	| addons  | ingress-addon-legacy-577846                                                  | ingress-addon-legacy-577846 | jenkins | v1.32.0 | 04 Mar 24 11:57 UTC | 04 Mar 24 11:57 UTC |
	|         | addons enable ingress-dns                                                    |                             |         |         |                     |                     |
	|         | --alsologtostderr -v=5                                                       |                             |         |         |                     |                     |
	| ssh     | ingress-addon-legacy-577846                                                  | ingress-addon-legacy-577846 | jenkins | v1.32.0 | 04 Mar 24 11:57 UTC |                     |
	|         | ssh curl -s http://127.0.0.1/                                                |                             |         |         |                     |                     |
	|         | -H 'Host: nginx.example.com'                                                 |                             |         |         |                     |                     |
	| ip      | ingress-addon-legacy-577846 ip                                               | ingress-addon-legacy-577846 | jenkins | v1.32.0 | 04 Mar 24 11:59 UTC | 04 Mar 24 11:59 UTC |
	| addons  | ingress-addon-legacy-577846                                                  | ingress-addon-legacy-577846 | jenkins | v1.32.0 | 04 Mar 24 12:00 UTC | 04 Mar 24 12:00 UTC |
	|         | addons disable ingress-dns                                                   |                             |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                       |                             |         |         |                     |                     |
	| addons  | ingress-addon-legacy-577846                                                  | ingress-addon-legacy-577846 | jenkins | v1.32.0 | 04 Mar 24 12:00 UTC | 04 Mar 24 12:00 UTC |
	|         | addons disable ingress                                                       |                             |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                       |                             |         |         |                     |                     |
	|---------|------------------------------------------------------------------------------|-----------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/04 11:56:03
	Running on machine: ubuntu-20-agent-13
	Binary: Built with gc go1.22.0 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0304 11:56:03.264117  444352 out.go:291] Setting OutFile to fd 1 ...
	I0304 11:56:03.264614  444352 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 11:56:03.264634  444352 out.go:304] Setting ErrFile to fd 2...
	I0304 11:56:03.264641  444352 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 11:56:03.265117  444352 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18284-396872/.minikube/bin
	I0304 11:56:03.266250  444352 out.go:298] Setting JSON to false
	I0304 11:56:03.267080  444352 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":41912,"bootTime":1709511451,"procs":186,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1052-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0304 11:56:03.267148  444352 start.go:139] virtualization: kvm guest
	I0304 11:56:03.269387  444352 out.go:177] * [ingress-addon-legacy-577846] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
	I0304 11:56:03.271101  444352 out.go:177]   - MINIKUBE_LOCATION=18284
	I0304 11:56:03.272317  444352 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 11:56:03.271133  444352 notify.go:220] Checking for updates...
	I0304 11:56:03.274691  444352 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/18284-396872/kubeconfig
	I0304 11:56:03.276070  444352 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/18284-396872/.minikube
	I0304 11:56:03.277269  444352 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0304 11:56:03.278407  444352 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 11:56:03.279777  444352 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 11:56:03.301343  444352 docker.go:122] docker version: linux-25.0.3:Docker Engine - Community
	I0304 11:56:03.301462  444352 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0304 11:56:03.360558  444352 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:48 SystemTime:2024-03-04 11:56:03.35134193 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1052-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86_
64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-13 Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErr
ors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.6] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0304 11:56:03.360681  444352 docker.go:295] overlay module found
	I0304 11:56:03.362489  444352 out.go:177] * Using the docker driver based on user configuration
	I0304 11:56:03.363718  444352 start.go:299] selected driver: docker
	I0304 11:56:03.363730  444352 start.go:903] validating driver "docker" against <nil>
	I0304 11:56:03.363744  444352 start.go:914] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 11:56:03.364520  444352 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0304 11:56:03.414372  444352 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:48 SystemTime:2024-03-04 11:56:03.405531108 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1052-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-13 Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerEr
rors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.6] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0304 11:56:03.414573  444352 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I0304 11:56:03.414794  444352 start_flags.go:931] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 11:56:03.416807  444352 out.go:177] * Using Docker driver with root privileges
	I0304 11:56:03.418476  444352 cni.go:84] Creating CNI manager for ""
	I0304 11:56:03.418495  444352 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0304 11:56:03.418506  444352 start_flags.go:318] Found "CNI" CNI - setting NetworkPlugin=cni
	I0304 11:56:03.418531  444352 start_flags.go:323] config:
	{Name:ingress-addon-legacy-577846 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-577846 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.lo
cal ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 11:56:03.420145  444352 out.go:177] * Starting control plane node ingress-addon-legacy-577846 in cluster ingress-addon-legacy-577846
	I0304 11:56:03.421303  444352 cache.go:121] Beginning downloading kic base image for docker with crio
	I0304 11:56:03.422591  444352 out.go:177] * Pulling base image v0.0.42-1708944392-18244 ...
	I0304 11:56:03.423789  444352 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime crio
	I0304 11:56:03.423880  444352 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon
	I0304 11:56:03.438776  444352 image.go:83] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon, skipping pull
	I0304 11:56:03.438800  444352 cache.go:144] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 exists in daemon, skipping load
	I0304 11:56:03.442163  444352 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-cri-o-overlay-amd64.tar.lz4
	I0304 11:56:03.442187  444352 cache.go:56] Caching tarball of preloaded images
	I0304 11:56:03.442342  444352 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime crio
	I0304 11:56:03.443816  444352 out.go:177] * Downloading Kubernetes v1.18.20 preload ...
	I0304 11:56:03.444998  444352 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.18.20-cri-o-overlay-amd64.tar.lz4 ...
	I0304 11:56:03.473325  444352 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.18.20/preloaded-images-k8s-v18-v1.18.20-cri-o-overlay-amd64.tar.lz4?checksum=md5:0d02e096853189c5b37812b400898e14 -> /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-cri-o-overlay-amd64.tar.lz4
	I0304 11:56:06.594341  444352 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.18.20-cri-o-overlay-amd64.tar.lz4 ...
	I0304 11:56:06.594432  444352 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-cri-o-overlay-amd64.tar.lz4 ...
	I0304 11:56:07.547453  444352 cache.go:59] Finished verifying existence of preloaded tar for  v1.18.20 on crio
	I0304 11:56:07.547828  444352 profile.go:148] Saving config to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/config.json ...
	I0304 11:56:07.547863  444352 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/config.json: {Name:mk7f32de446548260ed0c42317a57708db2a8bc4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:56:07.548047  444352 cache.go:194] Successfully downloaded all kic artifacts
	I0304 11:56:07.548072  444352 start.go:365] acquiring machines lock for ingress-addon-legacy-577846: {Name:mk5ca2e5bb37663ed6c73a5318f81efea6f49c32 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 11:56:07.548123  444352 start.go:369] acquired machines lock for "ingress-addon-legacy-577846" in 34.947µs
	I0304 11:56:07.548143  444352 start.go:93] Provisioning new machine with config: &{Name:ingress-addon-legacy-577846 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-577846 Namespace:defau
lt APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Dis
ableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0304 11:56:07.548222  444352 start.go:125] createHost starting for "" (driver="docker")
	I0304 11:56:07.550450  444352 out.go:204] * Creating docker container (CPUs=2, Memory=4096MB) ...
	I0304 11:56:07.550688  444352 start.go:159] libmachine.API.Create for "ingress-addon-legacy-577846" (driver="docker")
	I0304 11:56:07.550716  444352 client.go:168] LocalClient.Create starting
	I0304 11:56:07.550788  444352 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem
	I0304 11:56:07.550817  444352 main.go:141] libmachine: Decoding PEM data...
	I0304 11:56:07.550832  444352 main.go:141] libmachine: Parsing certificate...
	I0304 11:56:07.550887  444352 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18284-396872/.minikube/certs/cert.pem
	I0304 11:56:07.550908  444352 main.go:141] libmachine: Decoding PEM data...
	I0304 11:56:07.550918  444352 main.go:141] libmachine: Parsing certificate...
	I0304 11:56:07.551204  444352 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-577846 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	W0304 11:56:07.567054  444352 cli_runner.go:211] docker network inspect ingress-addon-legacy-577846 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}" returned with exit code 1
	I0304 11:56:07.567123  444352 network_create.go:281] running [docker network inspect ingress-addon-legacy-577846] to gather additional debugging logs...
	I0304 11:56:07.567140  444352 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-577846
	W0304 11:56:07.582055  444352 cli_runner.go:211] docker network inspect ingress-addon-legacy-577846 returned with exit code 1
	I0304 11:56:07.582107  444352 network_create.go:284] error running [docker network inspect ingress-addon-legacy-577846]: docker network inspect ingress-addon-legacy-577846: exit status 1
	stdout:
	[]
	
	stderr:
	Error response from daemon: network ingress-addon-legacy-577846 not found
	I0304 11:56:07.582145  444352 network_create.go:286] output of [docker network inspect ingress-addon-legacy-577846]: -- stdout --
	[]
	
	-- /stdout --
	** stderr ** 
	Error response from daemon: network ingress-addon-legacy-577846 not found
	
	** /stderr **
	I0304 11:56:07.582257  444352 cli_runner.go:164] Run: docker network inspect bridge --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0304 11:56:07.596497  444352 network.go:207] using free private subnet 192.168.49.0/24: &{IP:192.168.49.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.49.0/24 Gateway:192.168.49.1 ClientMin:192.168.49.2 ClientMax:192.168.49.254 Broadcast:192.168.49.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc002696a50}
	I0304 11:56:07.596542  444352 network_create.go:124] attempt to create docker network ingress-addon-legacy-577846 192.168.49.0/24 with gateway 192.168.49.1 and MTU of 1500 ...
	I0304 11:56:07.596583  444352 cli_runner.go:164] Run: docker network create --driver=bridge --subnet=192.168.49.0/24 --gateway=192.168.49.1 -o --ip-masq -o --icc -o com.docker.network.driver.mtu=1500 --label=created_by.minikube.sigs.k8s.io=true --label=name.minikube.sigs.k8s.io=ingress-addon-legacy-577846 ingress-addon-legacy-577846
	I0304 11:56:07.645546  444352 network_create.go:108] docker network ingress-addon-legacy-577846 192.168.49.0/24 created
	I0304 11:56:07.645588  444352 kic.go:121] calculated static IP "192.168.49.2" for the "ingress-addon-legacy-577846" container
	I0304 11:56:07.645660  444352 cli_runner.go:164] Run: docker ps -a --format {{.Names}}
	I0304 11:56:07.659810  444352 cli_runner.go:164] Run: docker volume create ingress-addon-legacy-577846 --label name.minikube.sigs.k8s.io=ingress-addon-legacy-577846 --label created_by.minikube.sigs.k8s.io=true
	I0304 11:56:07.675956  444352 oci.go:103] Successfully created a docker volume ingress-addon-legacy-577846
	I0304 11:56:07.676048  444352 cli_runner.go:164] Run: docker run --rm --name ingress-addon-legacy-577846-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-577846 --entrypoint /usr/bin/test -v ingress-addon-legacy-577846:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -d /var/lib
	I0304 11:56:09.375891  444352 cli_runner.go:217] Completed: docker run --rm --name ingress-addon-legacy-577846-preload-sidecar --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-577846 --entrypoint /usr/bin/test -v ingress-addon-legacy-577846:/var gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -d /var/lib: (1.699783384s)
	I0304 11:56:09.375925  444352 oci.go:107] Successfully prepared a docker volume ingress-addon-legacy-577846
	I0304 11:56:09.375945  444352 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime crio
	I0304 11:56:09.375974  444352 kic.go:194] Starting extracting preloaded images to volume ...
	I0304 11:56:09.376034  444352 cli_runner.go:164] Run: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-577846:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -I lz4 -xf /preloaded.tar -C /extractDir
	I0304 11:56:14.601023  444352 cli_runner.go:217] Completed: docker run --rm --entrypoint /usr/bin/tar -v /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-cri-o-overlay-amd64.tar.lz4:/preloaded.tar:ro -v ingress-addon-legacy-577846:/extractDir gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 -I lz4 -xf /preloaded.tar -C /extractDir: (5.224928229s)
	I0304 11:56:14.601059  444352 kic.go:203] duration metric: took 5.225084 seconds to extract preloaded images to volume
	W0304 11:56:14.601184  444352 cgroups_linux.go:77] Your kernel does not support swap limit capabilities or the cgroup is not mounted.
	I0304 11:56:14.601274  444352 cli_runner.go:164] Run: docker info --format "'{{json .SecurityOptions}}'"
	I0304 11:56:14.656190  444352 cli_runner.go:164] Run: docker run -d -t --privileged --security-opt seccomp=unconfined --tmpfs /tmp --tmpfs /run -v /lib/modules:/lib/modules:ro --hostname ingress-addon-legacy-577846 --name ingress-addon-legacy-577846 --label created_by.minikube.sigs.k8s.io=true --label name.minikube.sigs.k8s.io=ingress-addon-legacy-577846 --label role.minikube.sigs.k8s.io= --label mode.minikube.sigs.k8s.io=ingress-addon-legacy-577846 --network ingress-addon-legacy-577846 --ip 192.168.49.2 --volume ingress-addon-legacy-577846:/var --security-opt apparmor=unconfined --memory=4096mb --cpus=2 -e container=docker --expose 8443 --publish=127.0.0.1::8443 --publish=127.0.0.1::22 --publish=127.0.0.1::2376 --publish=127.0.0.1::5000 --publish=127.0.0.1::32443 gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08
	I0304 11:56:14.919449  444352 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-577846 --format={{.State.Running}}
	I0304 11:56:14.938031  444352 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-577846 --format={{.State.Status}}
	I0304 11:56:14.956562  444352 cli_runner.go:164] Run: docker exec ingress-addon-legacy-577846 stat /var/lib/dpkg/alternatives/iptables
	I0304 11:56:14.997515  444352 oci.go:144] the created container "ingress-addon-legacy-577846" has a running status.
	I0304 11:56:14.997551  444352 kic.go:225] Creating ssh key for kic: /home/jenkins/minikube-integration/18284-396872/.minikube/machines/ingress-addon-legacy-577846/id_rsa...
	I0304 11:56:15.118472  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/machines/ingress-addon-legacy-577846/id_rsa.pub -> /home/docker/.ssh/authorized_keys
	I0304 11:56:15.118518  444352 kic_runner.go:191] docker (temp): /home/jenkins/minikube-integration/18284-396872/.minikube/machines/ingress-addon-legacy-577846/id_rsa.pub --> /home/docker/.ssh/authorized_keys (381 bytes)
	I0304 11:56:15.137751  444352 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-577846 --format={{.State.Status}}
	I0304 11:56:15.160322  444352 kic_runner.go:93] Run: chown docker:docker /home/docker/.ssh/authorized_keys
	I0304 11:56:15.160347  444352 kic_runner.go:114] Args: [docker exec --privileged ingress-addon-legacy-577846 chown docker:docker /home/docker/.ssh/authorized_keys]
	I0304 11:56:15.204168  444352 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-577846 --format={{.State.Status}}
	I0304 11:56:15.222641  444352 machine.go:88] provisioning docker machine ...
	I0304 11:56:15.222681  444352 ubuntu.go:169] provisioning hostname "ingress-addon-legacy-577846"
	I0304 11:56:15.222733  444352 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-577846
	I0304 11:56:15.244207  444352 main.go:141] libmachine: Using SSH client type: native
	I0304 11:56:15.244526  444352 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil>  [] 0s} 127.0.0.1 32787 <nil> <nil>}
	I0304 11:56:15.244550  444352 main.go:141] libmachine: About to run SSH command:
	sudo hostname ingress-addon-legacy-577846 && echo "ingress-addon-legacy-577846" | sudo tee /etc/hostname
	I0304 11:56:15.245427  444352 main.go:141] libmachine: Error dialing TCP: ssh: handshake failed: read tcp 127.0.0.1:60572->127.0.0.1:32787: read: connection reset by peer
	I0304 11:56:18.368327  444352 main.go:141] libmachine: SSH cmd err, output: <nil>: ingress-addon-legacy-577846
	
	I0304 11:56:18.368402  444352 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-577846
	I0304 11:56:18.384561  444352 main.go:141] libmachine: Using SSH client type: native
	I0304 11:56:18.384747  444352 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil>  [] 0s} 127.0.0.1 32787 <nil> <nil>}
	I0304 11:56:18.384766  444352 main.go:141] libmachine: About to run SSH command:
	
			if ! grep -xq '.*\singress-addon-legacy-577846' /etc/hosts; then
				if grep -xq '127.0.1.1\s.*' /etc/hosts; then
					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ingress-addon-legacy-577846/g' /etc/hosts;
				else 
					echo '127.0.1.1 ingress-addon-legacy-577846' | sudo tee -a /etc/hosts; 
				fi
			fi
	I0304 11:56:18.493914  444352 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	I0304 11:56:18.493949  444352 ubuntu.go:175] set auth options {CertDir:/home/jenkins/minikube-integration/18284-396872/.minikube CaCertPath:/home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18284-396872/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18284-396872/.minikube}
	I0304 11:56:18.493993  444352 ubuntu.go:177] setting up certificates
	I0304 11:56:18.494006  444352 provision.go:83] configureAuth start
	I0304 11:56:18.494071  444352 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-577846
	I0304 11:56:18.509637  444352 provision.go:138] copyHostCerts
	I0304 11:56:18.509673  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/18284-396872/.minikube/ca.pem
	I0304 11:56:18.509700  444352 exec_runner.go:144] found /home/jenkins/minikube-integration/18284-396872/.minikube/ca.pem, removing ...
	I0304 11:56:18.509712  444352 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18284-396872/.minikube/ca.pem
	I0304 11:56:18.509774  444352 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18284-396872/.minikube/ca.pem (1082 bytes)
	I0304 11:56:18.509846  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/18284-396872/.minikube/cert.pem
	I0304 11:56:18.509864  444352 exec_runner.go:144] found /home/jenkins/minikube-integration/18284-396872/.minikube/cert.pem, removing ...
	I0304 11:56:18.509868  444352 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18284-396872/.minikube/cert.pem
	I0304 11:56:18.509899  444352 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18284-396872/.minikube/cert.pem (1123 bytes)
	I0304 11:56:18.509982  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/18284-396872/.minikube/key.pem
	I0304 11:56:18.510011  444352 exec_runner.go:144] found /home/jenkins/minikube-integration/18284-396872/.minikube/key.pem, removing ...
	I0304 11:56:18.510018  444352 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18284-396872/.minikube/key.pem
	I0304 11:56:18.510041  444352 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18284-396872/.minikube/key.pem (1679 bytes)
	I0304 11:56:18.510091  444352 provision.go:112] generating server cert: /home/jenkins/minikube-integration/18284-396872/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca-key.pem org=jenkins.ingress-addon-legacy-577846 san=[192.168.49.2 127.0.0.1 localhost 127.0.0.1 minikube ingress-addon-legacy-577846]
	I0304 11:56:18.617140  444352 provision.go:172] copyRemoteCerts
	I0304 11:56:18.617197  444352 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker
	I0304 11:56:18.617234  444352 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-577846
	I0304 11:56:18.633052  444352 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/ingress-addon-legacy-577846/id_rsa Username:docker}
	I0304 11:56:18.718179  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem -> /etc/docker/ca.pem
	I0304 11:56:18.718311  444352 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)
	I0304 11:56:18.739273  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/machines/server.pem -> /etc/docker/server.pem
	I0304 11:56:18.739340  444352 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/machines/server.pem --> /etc/docker/server.pem (1257 bytes)
	I0304 11:56:18.760248  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem
	I0304 11:56:18.760313  444352 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)
	I0304 11:56:18.781303  444352 provision.go:86] duration metric: configureAuth took 287.281421ms
	I0304 11:56:18.781335  444352 ubuntu.go:193] setting minikube options for container-runtime
	I0304 11:56:18.781502  444352 config.go:182] Loaded profile config "ingress-addon-legacy-577846": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.18.20
	I0304 11:56:18.781600  444352 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-577846
	I0304 11:56:18.798948  444352 main.go:141] libmachine: Using SSH client type: native
	I0304 11:56:18.799196  444352 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d280] 0x82ffe0 <nil>  [] 0s} 127.0.0.1 32787 <nil> <nil>}
	I0304 11:56:18.799219  444352 main.go:141] libmachine: About to run SSH command:
	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio
	I0304 11:56:19.017358  444352 main.go:141] libmachine: SSH cmd err, output: <nil>: 
	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '
	
	I0304 11:56:19.017383  444352 machine.go:91] provisioned docker machine in 3.794717152s
	I0304 11:56:19.017394  444352 client.go:171] LocalClient.Create took 11.466672256s
	I0304 11:56:19.017416  444352 start.go:167] duration metric: libmachine.API.Create for "ingress-addon-legacy-577846" took 11.466728486s
	I0304 11:56:19.017424  444352 start.go:300] post-start starting for "ingress-addon-legacy-577846" (driver="docker")
	I0304 11:56:19.017434  444352 start.go:329] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]
	I0304 11:56:19.017492  444352 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs
	I0304 11:56:19.017541  444352 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-577846
	I0304 11:56:19.033073  444352 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/ingress-addon-legacy-577846/id_rsa Username:docker}
	I0304 11:56:19.122067  444352 ssh_runner.go:195] Run: cat /etc/os-release
	I0304 11:56:19.124927  444352 main.go:141] libmachine: Couldn't set key VERSION_CODENAME, no corresponding struct field found
	I0304 11:56:19.124957  444352 main.go:141] libmachine: Couldn't set key PRIVACY_POLICY_URL, no corresponding struct field found
	I0304 11:56:19.124965  444352 main.go:141] libmachine: Couldn't set key UBUNTU_CODENAME, no corresponding struct field found
	I0304 11:56:19.124972  444352 info.go:137] Remote host: Ubuntu 22.04.3 LTS
	I0304 11:56:19.124982  444352 filesync.go:126] Scanning /home/jenkins/minikube-integration/18284-396872/.minikube/addons for local assets ...
	I0304 11:56:19.125026  444352 filesync.go:126] Scanning /home/jenkins/minikube-integration/18284-396872/.minikube/files for local assets ...
	I0304 11:56:19.125100  444352 filesync.go:149] local asset: /home/jenkins/minikube-integration/18284-396872/.minikube/files/etc/ssl/certs/4036492.pem -> 4036492.pem in /etc/ssl/certs
	I0304 11:56:19.125112  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/files/etc/ssl/certs/4036492.pem -> /etc/ssl/certs/4036492.pem
	I0304 11:56:19.125201  444352 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs
	I0304 11:56:19.132744  444352 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/files/etc/ssl/certs/4036492.pem --> /etc/ssl/certs/4036492.pem (1708 bytes)
	I0304 11:56:19.152748  444352 start.go:303] post-start completed in 135.313935ms
	I0304 11:56:19.153058  444352 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-577846
	I0304 11:56:19.168874  444352 profile.go:148] Saving config to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/config.json ...
	I0304 11:56:19.169112  444352 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0304 11:56:19.169179  444352 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-577846
	I0304 11:56:19.183941  444352 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/ingress-addon-legacy-577846/id_rsa Username:docker}
	I0304 11:56:19.266798  444352 ssh_runner.go:195] Run: sh -c "df -BG /var | awk 'NR==2{print $4}'"
	I0304 11:56:19.270817  444352 start.go:128] duration metric: createHost completed in 11.722579542s
	I0304 11:56:19.270841  444352 start.go:83] releasing machines lock for "ingress-addon-legacy-577846", held for 11.722707756s
	I0304 11:56:19.270910  444352 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" ingress-addon-legacy-577846
	I0304 11:56:19.286981  444352 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/
	I0304 11:56:19.287047  444352 ssh_runner.go:195] Run: cat /version.json
	I0304 11:56:19.287060  444352 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-577846
	I0304 11:56:19.287092  444352 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-577846
	I0304 11:56:19.303059  444352 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/ingress-addon-legacy-577846/id_rsa Username:docker}
	I0304 11:56:19.303834  444352 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/ingress-addon-legacy-577846/id_rsa Username:docker}
	I0304 11:56:19.385723  444352 ssh_runner.go:195] Run: systemctl --version
	I0304 11:56:19.450918  444352 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"
	I0304 11:56:19.587297  444352 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"
	I0304 11:56:19.591735  444352 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f -name *loopback.conf* -not -name *.mk_disabled -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0304 11:56:19.609485  444352 cni.go:221] loopback cni configuration disabled: "/etc/cni/net.d/*loopback.conf*" found
	I0304 11:56:19.609574  444352 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;
	I0304 11:56:19.636083  444352 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist, /etc/cni/net.d/100-crio-bridge.conf] bridge cni config(s)
	I0304 11:56:19.636108  444352 start.go:475] detecting cgroup driver to use...
	I0304 11:56:19.636142  444352 detect.go:196] detected "cgroupfs" cgroup driver on host os
	I0304 11:56:19.636195  444352 ssh_runner.go:195] Run: sudo systemctl stop -f containerd
	I0304 11:56:19.649712  444352 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd
	I0304 11:56:19.659195  444352 docker.go:217] disabling cri-docker service (if available) ...
	I0304 11:56:19.659255  444352 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket
	I0304 11:56:19.671400  444352 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service
	I0304 11:56:19.683389  444352 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket
	I0304 11:56:19.755367  444352 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service
	I0304 11:56:19.838883  444352 docker.go:233] disabling docker service ...
	I0304 11:56:19.838954  444352 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket
	I0304 11:56:19.856406  444352 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service
	I0304 11:56:19.866768  444352 ssh_runner.go:195] Run: sudo systemctl disable docker.socket
	I0304 11:56:19.943548  444352 ssh_runner.go:195] Run: sudo systemctl mask docker.service
	I0304 11:56:20.020287  444352 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker
	I0304 11:56:20.030786  444352 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock
	" | sudo tee /etc/crictl.yaml"
	I0304 11:56:20.044823  444352 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.2" pause image...
	I0304 11:56:20.044882  444352 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.2"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0304 11:56:20.053482  444352 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...
	I0304 11:56:20.053542  444352 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"
	I0304 11:56:20.061991  444352 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"
	I0304 11:56:20.070934  444352 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"
	I0304 11:56:20.079469  444352 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"
	I0304 11:56:20.087358  444352 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables
	I0304 11:56:20.094666  444352 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"
	I0304 11:56:20.101837  444352 ssh_runner.go:195] Run: sudo systemctl daemon-reload
	I0304 11:56:20.170495  444352 ssh_runner.go:195] Run: sudo systemctl restart crio
	I0304 11:56:20.268623  444352 start.go:522] Will wait 60s for socket path /var/run/crio/crio.sock
	I0304 11:56:20.268691  444352 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock
	I0304 11:56:20.272145  444352 start.go:543] Will wait 60s for crictl version
	I0304 11:56:20.272203  444352 ssh_runner.go:195] Run: which crictl
	I0304 11:56:20.275273  444352 ssh_runner.go:195] Run: sudo /usr/bin/crictl version
	I0304 11:56:20.306595  444352 start.go:559] Version:  0.1.0
	RuntimeName:  cri-o
	RuntimeVersion:  1.24.6
	RuntimeApiVersion:  v1
	I0304 11:56:20.306661  444352 ssh_runner.go:195] Run: crio --version
	I0304 11:56:20.340526  444352 ssh_runner.go:195] Run: crio --version
	I0304 11:56:20.374469  444352 out.go:177] * Preparing Kubernetes v1.18.20 on CRI-O 1.24.6 ...
	I0304 11:56:20.375774  444352 cli_runner.go:164] Run: docker network inspect ingress-addon-legacy-577846 --format "{"Name": "{{.Name}}","Driver": "{{.Driver}}","Subnet": "{{range .IPAM.Config}}{{.Subnet}}{{end}}","Gateway": "{{range .IPAM.Config}}{{.Gateway}}{{end}}","MTU": {{if (index .Options "com.docker.network.driver.mtu")}}{{(index .Options "com.docker.network.driver.mtu")}}{{else}}0{{end}}, "ContainerIPs": [{{range $k,$v := .Containers }}"{{$v.IPv4Address}}",{{end}}]}"
	I0304 11:56:20.391270  444352 ssh_runner.go:195] Run: grep 192.168.49.1	host.minikube.internal$ /etc/hosts
	I0304 11:56:20.394650  444352 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.49.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0304 11:56:20.404534  444352 preload.go:132] Checking if preload exists for k8s version v1.18.20 and runtime crio
	I0304 11:56:20.404597  444352 ssh_runner.go:195] Run: sudo crictl images --output json
	I0304 11:56:20.449426  444352 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.18.20". assuming images are not preloaded.
	I0304 11:56:20.449498  444352 ssh_runner.go:195] Run: which lz4
	I0304 11:56:20.452765  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4
	I0304 11:56:20.452856  444352 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4
	I0304 11:56:20.455899  444352 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1
	stdout:
	
	stderr:
	stat: cannot statx '/preloaded.tar.lz4': No such file or directory
	I0304 11:56:20.455935  444352 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.18.20-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (495439307 bytes)
	I0304 11:56:21.395400  444352 crio.go:444] Took 0.942570 seconds to copy over tarball
	I0304 11:56:21.395479  444352 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4
	I0304 11:56:23.717998  444352 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.322487625s)
	I0304 11:56:23.718034  444352 crio.go:451] Took 2.322604 seconds to extract the tarball
	I0304 11:56:23.718043  444352 ssh_runner.go:146] rm: /preloaded.tar.lz4
	I0304 11:56:23.788184  444352 ssh_runner.go:195] Run: sudo crictl images --output json
	I0304 11:56:23.820548  444352 crio.go:492] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.18.20". assuming images are not preloaded.
	I0304 11:56:23.820579  444352 cache_images.go:88] LoadImages start: [registry.k8s.io/kube-apiserver:v1.18.20 registry.k8s.io/kube-controller-manager:v1.18.20 registry.k8s.io/kube-scheduler:v1.18.20 registry.k8s.io/kube-proxy:v1.18.20 registry.k8s.io/pause:3.2 registry.k8s.io/etcd:3.4.3-0 registry.k8s.io/coredns:1.6.7 gcr.io/k8s-minikube/storage-provisioner:v5]
	I0304 11:56:23.820675  444352 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.18.20
	I0304 11:56:23.820697  444352 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0304 11:56:23.820708  444352 image.go:134] retrieving image: registry.k8s.io/coredns:1.6.7
	I0304 11:56:23.820718  444352 image.go:134] retrieving image: registry.k8s.io/etcd:3.4.3-0
	I0304 11:56:23.820731  444352 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.18.20
	I0304 11:56:23.820655  444352 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0304 11:56:23.820854  444352 image.go:134] retrieving image: registry.k8s.io/pause:3.2
	I0304 11:56:23.820788  444352 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.18.20
	I0304 11:56:23.822203  444352 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0304 11:56:23.822229  444352 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.18.20
	I0304 11:56:23.822230  444352 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.18.20
	I0304 11:56:23.822223  444352 image.go:177] daemon lookup for registry.k8s.io/pause:3.2: Error response from daemon: No such image: registry.k8s.io/pause:3.2
	I0304 11:56:23.822267  444352 image.go:177] daemon lookup for registry.k8s.io/etcd:3.4.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.4.3-0
	I0304 11:56:23.822272  444352 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.18.20
	I0304 11:56:23.822223  444352 image.go:177] daemon lookup for registry.k8s.io/coredns:1.6.7: Error response from daemon: No such image: registry.k8s.io/coredns:1.6.7
	I0304 11:56:23.822217  444352 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.18.20: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0304 11:56:23.960677  444352 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-scheduler:v1.18.20
	I0304 11:56:23.974126  444352 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/etcd:3.4.3-0
	I0304 11:56:23.986213  444352 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-controller-manager:v1.18.20
	I0304 11:56:23.987114  444352 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-apiserver:v1.18.20
	I0304 11:56:23.989264  444352 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/kube-proxy:v1.18.20
	I0304 11:56:23.992554  444352 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/coredns:1.6.7
	I0304 11:56:24.001961  444352 cache_images.go:116] "registry.k8s.io/kube-scheduler:v1.18.20" needs transfer: "registry.k8s.io/kube-scheduler:v1.18.20" does not exist at hash "a05a1a79adaad058478b7638d2e73cf408b283305081516fbe02706b0e205346" in container runtime
	I0304 11:56:24.002019  444352 cri.go:218] Removing image: registry.k8s.io/kube-scheduler:v1.18.20
	I0304 11:56:24.002061  444352 ssh_runner.go:195] Run: which crictl
	I0304 11:56:24.019378  444352 cache_images.go:116] "registry.k8s.io/etcd:3.4.3-0" needs transfer: "registry.k8s.io/etcd:3.4.3-0" does not exist at hash "303ce5db0e90dab1c5728ec70d21091201a23cdf8aeca70ab54943bbaaf0833f" in container runtime
	I0304 11:56:24.019432  444352 cri.go:218] Removing image: registry.k8s.io/etcd:3.4.3-0
	I0304 11:56:24.019479  444352 ssh_runner.go:195] Run: which crictl
	I0304 11:56:24.022904  444352 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} registry.k8s.io/pause:3.2
	I0304 11:56:24.035193  444352 cache_images.go:116] "registry.k8s.io/kube-controller-manager:v1.18.20" needs transfer: "registry.k8s.io/kube-controller-manager:v1.18.20" does not exist at hash "e7c545a60706cf009a893afdc7dba900cc2e342b8042b9c421d607ca41e8b290" in container runtime
	I0304 11:56:24.035249  444352 cri.go:218] Removing image: registry.k8s.io/kube-controller-manager:v1.18.20
	I0304 11:56:24.035300  444352 ssh_runner.go:195] Run: which crictl
	I0304 11:56:24.037543  444352 cache_images.go:116] "registry.k8s.io/kube-apiserver:v1.18.20" needs transfer: "registry.k8s.io/kube-apiserver:v1.18.20" does not exist at hash "7d8d2960de69688eab5698081441539a1662f47e092488973e455a8334955cb1" in container runtime
	I0304 11:56:24.037582  444352 cri.go:218] Removing image: registry.k8s.io/kube-apiserver:v1.18.20
	I0304 11:56:24.037620  444352 ssh_runner.go:195] Run: which crictl
	I0304 11:56:24.099106  444352 ssh_runner.go:195] Run: sudo podman image inspect --format {{.Id}} gcr.io/k8s-minikube/storage-provisioner:v5
	I0304 11:56:24.112734  444352 cache_images.go:116] "registry.k8s.io/kube-proxy:v1.18.20" needs transfer: "registry.k8s.io/kube-proxy:v1.18.20" does not exist at hash "27f8b8d51985f755cfb3ffea424fa34865cc0da63e99378d8202f923c3c5a8ba" in container runtime
	I0304 11:56:24.112780  444352 cri.go:218] Removing image: registry.k8s.io/kube-proxy:v1.18.20
	I0304 11:56:24.112819  444352 ssh_runner.go:195] Run: which crictl
	I0304 11:56:24.112820  444352 cache_images.go:116] "registry.k8s.io/coredns:1.6.7" needs transfer: "registry.k8s.io/coredns:1.6.7" does not exist at hash "67da37a9a360e600e74464da48437257b00a754c77c40f60c65e4cb327c34bd5" in container runtime
	I0304 11:56:24.112882  444352 cri.go:218] Removing image: registry.k8s.io/coredns:1.6.7
	I0304 11:56:24.112895  444352 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-scheduler:v1.18.20
	I0304 11:56:24.112933  444352 ssh_runner.go:195] Run: which crictl
	I0304 11:56:24.112990  444352 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/etcd:3.4.3-0
	I0304 11:56:24.127784  444352 cache_images.go:116] "registry.k8s.io/pause:3.2" needs transfer: "registry.k8s.io/pause:3.2" does not exist at hash "80d28bedfe5dec59da9ebf8e6260224ac9008ab5c11dbbe16ee3ba3e4439ac2c" in container runtime
	I0304 11:56:24.127826  444352 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-controller-manager:v1.18.20
	I0304 11:56:24.127833  444352 cri.go:218] Removing image: registry.k8s.io/pause:3.2
	I0304 11:56:24.127870  444352 ssh_runner.go:195] Run: which crictl
	I0304 11:56:24.127927  444352 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-apiserver:v1.18.20
	I0304 11:56:24.311166  444352 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18284-396872/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.3-0
	I0304 11:56:24.311243  444352 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/kube-proxy:v1.18.20
	I0304 11:56:24.311261  444352 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18284-396872/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.18.20
	I0304 11:56:24.311314  444352 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/coredns:1.6.7
	I0304 11:56:24.311378  444352 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18284-396872/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.18.20
	I0304 11:56:24.311436  444352 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18284-396872/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.18.20
	I0304 11:56:24.311456  444352 ssh_runner.go:195] Run: sudo /usr/bin/crictl rmi registry.k8s.io/pause:3.2
	I0304 11:56:24.351433  444352 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18284-396872/.minikube/cache/images/amd64/registry.k8s.io/coredns_1.6.7
	I0304 11:56:24.351470  444352 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18284-396872/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.18.20
	I0304 11:56:24.351501  444352 cache_images.go:286] Loading image from: /home/jenkins/minikube-integration/18284-396872/.minikube/cache/images/amd64/registry.k8s.io/pause_3.2
	I0304 11:56:24.351546  444352 cache_images.go:92] LoadImages completed in 530.954725ms
	W0304 11:56:24.351632  444352 out.go:239] X Unable to load cached images: loading cached images: stat /home/jenkins/minikube-integration/18284-396872/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.4.3-0: no such file or directory
	I0304 11:56:24.351684  444352 ssh_runner.go:195] Run: crio config
	I0304 11:56:24.404117  444352 cni.go:84] Creating CNI manager for ""
	I0304 11:56:24.404138  444352 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0304 11:56:24.404156  444352 kubeadm.go:87] Using pod CIDR: 10.244.0.0/16
	I0304 11:56:24.404173  444352 kubeadm.go:176] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.49.2 APIServerPort:8443 KubernetesVersion:v1.18.20 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ingress-addon-legacy-577846 NodeName:ingress-addon-legacy-577846 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.49.2"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.49.2 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.c
rt StaticPodPath:/etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:false}
	I0304 11:56:24.404358  444352 kubeadm.go:181] kubeadm config:
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: InitConfiguration
	localAPIEndpoint:
	  advertiseAddress: 192.168.49.2
	  bindPort: 8443
	bootstrapTokens:
	  - groups:
	      - system:bootstrappers:kubeadm:default-node-token
	    ttl: 24h0m0s
	    usages:
	      - signing
	      - authentication
	nodeRegistration:
	  criSocket: /var/run/crio/crio.sock
	  name: "ingress-addon-legacy-577846"
	  kubeletExtraArgs:
	    node-ip: 192.168.49.2
	  taints: []
	---
	apiVersion: kubeadm.k8s.io/v1beta2
	kind: ClusterConfiguration
	apiServer:
	  certSANs: ["127.0.0.1", "localhost", "192.168.49.2"]
	  extraArgs:
	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"
	controllerManager:
	  extraArgs:
	    allocate-node-cidrs: "true"
	    leader-elect: "false"
	scheduler:
	  extraArgs:
	    leader-elect: "false"
	certificatesDir: /var/lib/minikube/certs
	clusterName: mk
	controlPlaneEndpoint: control-plane.minikube.internal:8443
	dns:
	  type: CoreDNS
	etcd:
	  local:
	    dataDir: /var/lib/minikube/etcd
	    extraArgs:
	      proxy-refresh-interval: "70000"
	kubernetesVersion: v1.18.20
	networking:
	  dnsDomain: cluster.local
	  podSubnet: "10.244.0.0/16"
	  serviceSubnet: 10.96.0.0/12
	---
	apiVersion: kubelet.config.k8s.io/v1beta1
	kind: KubeletConfiguration
	authentication:
	  x509:
	    clientCAFile: /var/lib/minikube/certs/ca.crt
	cgroupDriver: cgroupfs
	hairpinMode: hairpin-veth
	runtimeRequestTimeout: 15m
	clusterDomain: "cluster.local"
	# disable disk resource management by default
	imageGCHighThresholdPercent: 100
	evictionHard:
	  nodefs.available: "0%!"(MISSING)
	  nodefs.inodesFree: "0%!"(MISSING)
	  imagefs.available: "0%!"(MISSING)
	failSwapOn: false
	staticPodPath: /etc/kubernetes/manifests
	---
	apiVersion: kubeproxy.config.k8s.io/v1alpha1
	kind: KubeProxyConfiguration
	clusterCIDR: "10.244.0.0/16"
	metricsBindAddress: 0.0.0.0:10249
	conntrack:
	  maxPerCore: 0
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"
	  tcpEstablishedTimeout: 0s
	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"
	  tcpCloseWaitTimeout: 0s
	
	I0304 11:56:24.404503  444352 kubeadm.go:976] kubelet [Unit]
	Wants=crio.service
	
	[Service]
	ExecStart=
	ExecStart=/var/lib/minikube/binaries/v1.18.20/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroups-per-qos=false --config=/var/lib/kubelet/config.yaml --container-runtime=remote --container-runtime-endpoint=unix:///var/run/crio/crio.sock --enforce-node-allocatable= --hostname-override=ingress-addon-legacy-577846 --kubeconfig=/etc/kubernetes/kubelet.conf --network-plugin=cni --node-ip=192.168.49.2
	
	[Install]
	 config:
	{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-577846 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:}
	I0304 11:56:24.404573  444352 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.18.20
	I0304 11:56:24.412734  444352 binaries.go:44] Found k8s binaries, skipping transfer
	I0304 11:56:24.412786  444352 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube
	I0304 11:56:24.420319  444352 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (486 bytes)
	I0304 11:56:24.435723  444352 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (353 bytes)
	I0304 11:56:24.451222  444352 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2123 bytes)
	I0304 11:56:24.466319  444352 ssh_runner.go:195] Run: grep 192.168.49.2	control-plane.minikube.internal$ /etc/hosts
	I0304 11:56:24.469277  444352 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.49.2	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""
	I0304 11:56:24.478338  444352 certs.go:56] Setting up /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846 for IP: 192.168.49.2
	I0304 11:56:24.478386  444352 certs.go:190] acquiring lock for shared ca certs: {Name:mk5c6efb4e5160f77d4a7ed847715b71b13576b2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:56:24.478527  444352 certs.go:199] skipping minikubeCA CA generation: /home/jenkins/minikube-integration/18284-396872/.minikube/ca.key
	I0304 11:56:24.478564  444352 certs.go:199] skipping proxyClientCA CA generation: /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.key
	I0304 11:56:24.478605  444352 certs.go:319] generating minikube-user signed cert: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.key
	I0304 11:56:24.478622  444352 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt with IP's: []
	I0304 11:56:24.538406  444352 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt ...
	I0304 11:56:24.538437  444352 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: {Name:mk1df2ca4068e372b402384988a3295c0bda666c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:56:24.538610  444352 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.key ...
	I0304 11:56:24.538627  444352 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.key: {Name:mkca7c77c5955a8e1afc396773eb001956dd1508 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:56:24.538711  444352 certs.go:319] generating minikube signed cert: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/apiserver.key.dd3b5fb2
	I0304 11:56:24.538729  444352 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/apiserver.crt.dd3b5fb2 with IP's: [192.168.49.2 10.96.0.1 127.0.0.1 10.0.0.1]
	I0304 11:56:24.593597  444352 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/apiserver.crt.dd3b5fb2 ...
	I0304 11:56:24.593642  444352 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/apiserver.crt.dd3b5fb2: {Name:mkd10b103988b854a7f2ac2ff017ca0ccbe63987 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:56:24.593794  444352 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/apiserver.key.dd3b5fb2 ...
	I0304 11:56:24.593808  444352 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/apiserver.key.dd3b5fb2: {Name:mkdd8a48ce5b55ea27d0526034771ba93c209c5a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:56:24.593888  444352 certs.go:337] copying /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/apiserver.crt.dd3b5fb2 -> /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/apiserver.crt
	I0304 11:56:24.593981  444352 certs.go:341] copying /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/apiserver.key.dd3b5fb2 -> /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/apiserver.key
	I0304 11:56:24.594039  444352 certs.go:319] generating aggregator signed cert: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/proxy-client.key
	I0304 11:56:24.594051  444352 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/proxy-client.crt with IP's: []
	I0304 11:56:24.796317  444352 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/proxy-client.crt ...
	I0304 11:56:24.796351  444352 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/proxy-client.crt: {Name:mk84e7455f3e9fd2f38ae0d129635e0ea682be4a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:56:24.796508  444352 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/proxy-client.key ...
	I0304 11:56:24.796523  444352 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/proxy-client.key: {Name:mkdc4fd9f6b66fa5f4740b61c7f8e792047e72d3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:56:24.796596  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
	I0304 11:56:24.796628  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/apiserver.key -> /var/lib/minikube/certs/apiserver.key
	I0304 11:56:24.796642  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
	I0304 11:56:24.796652  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
	I0304 11:56:24.796662  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt
	I0304 11:56:24.796675  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/ca.key -> /var/lib/minikube/certs/ca.key
	I0304 11:56:24.796687  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
	I0304 11:56:24.796699  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
	I0304 11:56:24.796757  444352 certs.go:437] found cert: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/home/jenkins/minikube-integration/18284-396872/.minikube/certs/403649.pem (1338 bytes)
	W0304 11:56:24.796793  444352 certs.go:433] ignoring /home/jenkins/minikube-integration/18284-396872/.minikube/certs/home/jenkins/minikube-integration/18284-396872/.minikube/certs/403649_empty.pem, impossibly tiny 0 bytes
	I0304 11:56:24.796807  444352 certs.go:437] found cert: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca-key.pem (1679 bytes)
	I0304 11:56:24.796837  444352 certs.go:437] found cert: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/home/jenkins/minikube-integration/18284-396872/.minikube/certs/ca.pem (1082 bytes)
	I0304 11:56:24.796859  444352 certs.go:437] found cert: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/home/jenkins/minikube-integration/18284-396872/.minikube/certs/cert.pem (1123 bytes)
	I0304 11:56:24.796882  444352 certs.go:437] found cert: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/home/jenkins/minikube-integration/18284-396872/.minikube/certs/key.pem (1679 bytes)
	I0304 11:56:24.796919  444352 certs.go:437] found cert: /home/jenkins/minikube-integration/18284-396872/.minikube/files/etc/ssl/certs/home/jenkins/minikube-integration/18284-396872/.minikube/files/etc/ssl/certs/4036492.pem (1708 bytes)
	I0304 11:56:24.796954  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/certs/403649.pem -> /usr/share/ca-certificates/403649.pem
	I0304 11:56:24.796967  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/files/etc/ssl/certs/4036492.pem -> /usr/share/ca-certificates/4036492.pem
	I0304 11:56:24.796979  444352 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
	I0304 11:56:24.797564  444352 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1399 bytes)
	I0304 11:56:24.819202  444352 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)
	I0304 11:56:24.839710  444352 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)
	I0304 11:56:24.860651  444352 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)
	I0304 11:56:24.881014  444352 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)
	I0304 11:56:24.901718  444352 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)
	I0304 11:56:24.922015  444352 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)
	I0304 11:56:24.942228  444352 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)
	I0304 11:56:24.962759  444352 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/certs/403649.pem --> /usr/share/ca-certificates/403649.pem (1338 bytes)
	I0304 11:56:24.982806  444352 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/files/etc/ssl/certs/4036492.pem --> /usr/share/ca-certificates/4036492.pem (1708 bytes)
	I0304 11:56:25.002579  444352 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)
	I0304 11:56:25.022664  444352 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)
	I0304 11:56:25.037588  444352 ssh_runner.go:195] Run: openssl version
	I0304 11:56:25.042175  444352 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/403649.pem && ln -fs /usr/share/ca-certificates/403649.pem /etc/ssl/certs/403649.pem"
	I0304 11:56:25.049800  444352 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/403649.pem
	I0304 11:56:25.052667  444352 certs.go:480] hashing: -rw-r--r-- 1 root root 1338 Mar  4 11:53 /usr/share/ca-certificates/403649.pem
	I0304 11:56:25.052717  444352 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/403649.pem
	I0304 11:56:25.058527  444352 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/403649.pem /etc/ssl/certs/51391683.0"
	I0304 11:56:25.066095  444352 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/4036492.pem && ln -fs /usr/share/ca-certificates/4036492.pem /etc/ssl/certs/4036492.pem"
	I0304 11:56:25.073813  444352 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/4036492.pem
	I0304 11:56:25.076664  444352 certs.go:480] hashing: -rw-r--r-- 1 root root 1708 Mar  4 11:53 /usr/share/ca-certificates/4036492.pem
	I0304 11:56:25.076712  444352 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/4036492.pem
	I0304 11:56:25.082734  444352 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/4036492.pem /etc/ssl/certs/3ec20f2e.0"
	I0304 11:56:25.090292  444352 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"
	I0304 11:56:25.097788  444352 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem
	I0304 11:56:25.100766  444352 certs.go:480] hashing: -rw-r--r-- 1 root root 1111 Mar  4 11:47 /usr/share/ca-certificates/minikubeCA.pem
	I0304 11:56:25.100801  444352 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem
	I0304 11:56:25.106685  444352 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"
	I0304 11:56:25.114431  444352 ssh_runner.go:195] Run: ls /var/lib/minikube/certs/etcd
	I0304 11:56:25.117252  444352 certs.go:353] certs directory doesn't exist, likely first start: ls /var/lib/minikube/certs/etcd: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/var/lib/minikube/certs/etcd': No such file or directory
	I0304 11:56:25.117311  444352 kubeadm.go:404] StartCluster: {Name:ingress-addon-legacy-577846 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4096 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.18.20 ClusterName:ingress-addon-legacy-577846 Namespace:default APIServerName:minik
ubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimi
zations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 11:56:25.117415  444352 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}
	I0304 11:56:25.117450  444352 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"
	I0304 11:56:25.150087  444352 cri.go:89] found id: ""
	I0304 11:56:25.150154  444352 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd
	I0304 11:56:25.157738  444352 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml
	I0304 11:56:25.165149  444352 kubeadm.go:226] ignoring SystemVerification for kubeadm because of docker driver
	I0304 11:56:25.165190  444352 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf
	I0304 11:56:25.172477  444352 kubeadm.go:152] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2
	stdout:
	
	stderr:
	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory
	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory
	I0304 11:56:25.172510  444352 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.18.20:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,SystemVerification,FileContent--proc-sys-net-bridge-bridge-nf-call-iptables"
	I0304 11:56:25.213716  444352 kubeadm.go:322] W0304 11:56:25.213252    1383 configset.go:202] WARNING: kubeadm cannot validate component configs for API groups [kubelet.config.k8s.io kubeproxy.config.k8s.io]
	I0304 11:56:25.250875  444352 kubeadm.go:322] 	[WARNING SystemVerification]: failed to parse kernel config: unable to load kernel module: "configs", output: "modprobe: FATAL: Module configs not found in directory /lib/modules/5.15.0-1052-gcp\n", err: exit status 1
	I0304 11:56:25.316733  444352 kubeadm.go:322] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
	I0304 11:56:28.255766  444352 kubeadm.go:322] W0304 11:56:28.255473    1383 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
	I0304 11:56:28.256777  444352 kubeadm.go:322] W0304 11:56:28.256498    1383 manifests.go:225] the default kube-apiserver authorization-mode is "Node,RBAC"; using "Node,RBAC"
	I0304 11:56:36.231178  444352 kubeadm.go:322] [init] Using Kubernetes version: v1.18.20
	I0304 11:56:36.231264  444352 kubeadm.go:322] [preflight] Running pre-flight checks
	I0304 11:56:36.231348  444352 kubeadm.go:322] [preflight] The system verification failed. Printing the output from the verification:
	I0304 11:56:36.231396  444352 kubeadm.go:322] KERNEL_VERSION: 5.15.0-1052-gcp
	I0304 11:56:36.231447  444352 kubeadm.go:322] OS: Linux
	I0304 11:56:36.231485  444352 kubeadm.go:322] CGROUPS_CPU: enabled
	I0304 11:56:36.231565  444352 kubeadm.go:322] CGROUPS_CPUACCT: enabled
	I0304 11:56:36.231649  444352 kubeadm.go:322] CGROUPS_CPUSET: enabled
	I0304 11:56:36.231706  444352 kubeadm.go:322] CGROUPS_DEVICES: enabled
	I0304 11:56:36.231746  444352 kubeadm.go:322] CGROUPS_FREEZER: enabled
	I0304 11:56:36.231783  444352 kubeadm.go:322] CGROUPS_MEMORY: enabled
	I0304 11:56:36.231838  444352 kubeadm.go:322] [preflight] Pulling images required for setting up a Kubernetes cluster
	I0304 11:56:36.231913  444352 kubeadm.go:322] [preflight] This might take a minute or two, depending on the speed of your internet connection
	I0304 11:56:36.231983  444352 kubeadm.go:322] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
	I0304 11:56:36.232105  444352 kubeadm.go:322] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
	I0304 11:56:36.232183  444352 kubeadm.go:322] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
	I0304 11:56:36.232218  444352 kubeadm.go:322] [kubelet-start] Starting the kubelet
	I0304 11:56:36.232287  444352 kubeadm.go:322] [certs] Using certificateDir folder "/var/lib/minikube/certs"
	I0304 11:56:36.233835  444352 out.go:204]   - Generating certificates and keys ...
	I0304 11:56:36.233913  444352 kubeadm.go:322] [certs] Using existing ca certificate authority
	I0304 11:56:36.233983  444352 kubeadm.go:322] [certs] Using existing apiserver certificate and key on disk
	I0304 11:56:36.234068  444352 kubeadm.go:322] [certs] Generating "apiserver-kubelet-client" certificate and key
	I0304 11:56:36.234164  444352 kubeadm.go:322] [certs] Generating "front-proxy-ca" certificate and key
	I0304 11:56:36.234249  444352 kubeadm.go:322] [certs] Generating "front-proxy-client" certificate and key
	I0304 11:56:36.234326  444352 kubeadm.go:322] [certs] Generating "etcd/ca" certificate and key
	I0304 11:56:36.234405  444352 kubeadm.go:322] [certs] Generating "etcd/server" certificate and key
	I0304 11:56:36.234525  444352 kubeadm.go:322] [certs] etcd/server serving cert is signed for DNS names [ingress-addon-legacy-577846 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0304 11:56:36.234571  444352 kubeadm.go:322] [certs] Generating "etcd/peer" certificate and key
	I0304 11:56:36.234676  444352 kubeadm.go:322] [certs] etcd/peer serving cert is signed for DNS names [ingress-addon-legacy-577846 localhost] and IPs [192.168.49.2 127.0.0.1 ::1]
	I0304 11:56:36.234751  444352 kubeadm.go:322] [certs] Generating "etcd/healthcheck-client" certificate and key
	I0304 11:56:36.234807  444352 kubeadm.go:322] [certs] Generating "apiserver-etcd-client" certificate and key
	I0304 11:56:36.234846  444352 kubeadm.go:322] [certs] Generating "sa" key and public key
	I0304 11:56:36.234900  444352 kubeadm.go:322] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
	I0304 11:56:36.234962  444352 kubeadm.go:322] [kubeconfig] Writing "admin.conf" kubeconfig file
	I0304 11:56:36.235014  444352 kubeadm.go:322] [kubeconfig] Writing "kubelet.conf" kubeconfig file
	I0304 11:56:36.235063  444352 kubeadm.go:322] [kubeconfig] Writing "controller-manager.conf" kubeconfig file
	I0304 11:56:36.235114  444352 kubeadm.go:322] [kubeconfig] Writing "scheduler.conf" kubeconfig file
	I0304 11:56:36.235169  444352 kubeadm.go:322] [control-plane] Using manifest folder "/etc/kubernetes/manifests"
	I0304 11:56:36.236750  444352 out.go:204]   - Booting up control plane ...
	I0304 11:56:36.236836  444352 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-apiserver"
	I0304 11:56:36.236906  444352 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-controller-manager"
	I0304 11:56:36.236972  444352 kubeadm.go:322] [control-plane] Creating static Pod manifest for "kube-scheduler"
	I0304 11:56:36.237045  444352 kubeadm.go:322] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
	I0304 11:56:36.237228  444352 kubeadm.go:322] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
	I0304 11:56:36.237320  444352 kubeadm.go:322] [apiclient] All control plane components are healthy after 6.502129 seconds
	I0304 11:56:36.237407  444352 kubeadm.go:322] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
	I0304 11:56:36.237516  444352 kubeadm.go:322] [kubelet] Creating a ConfigMap "kubelet-config-1.18" in namespace kube-system with the configuration for the kubelets in the cluster
	I0304 11:56:36.237571  444352 kubeadm.go:322] [upload-certs] Skipping phase. Please see --upload-certs
	I0304 11:56:36.237682  444352 kubeadm.go:322] [mark-control-plane] Marking the node ingress-addon-legacy-577846 as control-plane by adding the label "node-role.kubernetes.io/master=''"
	I0304 11:56:36.237729  444352 kubeadm.go:322] [bootstrap-token] Using token: 48kg89.ty49cl97ag9d8ghi
	I0304 11:56:36.239239  444352 out.go:204]   - Configuring RBAC rules ...
	I0304 11:56:36.239329  444352 kubeadm.go:322] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
	I0304 11:56:36.239398  444352 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to get nodes
	I0304 11:56:36.239515  444352 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
	I0304 11:56:36.239628  444352 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
	I0304 11:56:36.239729  444352 kubeadm.go:322] [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
	I0304 11:56:36.239802  444352 kubeadm.go:322] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
	I0304 11:56:36.239904  444352 kubeadm.go:322] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key
	I0304 11:56:36.239948  444352 kubeadm.go:322] [addons] Applied essential addon: CoreDNS
	I0304 11:56:36.239987  444352 kubeadm.go:322] [addons] Applied essential addon: kube-proxy
	I0304 11:56:36.239993  444352 kubeadm.go:322] 
	I0304 11:56:36.240038  444352 kubeadm.go:322] Your Kubernetes control-plane has initialized successfully!
	I0304 11:56:36.240044  444352 kubeadm.go:322] 
	I0304 11:56:36.240107  444352 kubeadm.go:322] To start using your cluster, you need to run the following as a regular user:
	I0304 11:56:36.240112  444352 kubeadm.go:322] 
	I0304 11:56:36.240132  444352 kubeadm.go:322]   mkdir -p $HOME/.kube
	I0304 11:56:36.240196  444352 kubeadm.go:322]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
	I0304 11:56:36.240254  444352 kubeadm.go:322]   sudo chown $(id -u):$(id -g) $HOME/.kube/config
	I0304 11:56:36.240264  444352 kubeadm.go:322] 
	I0304 11:56:36.240307  444352 kubeadm.go:322] You should now deploy a pod network to the cluster.
	I0304 11:56:36.240381  444352 kubeadm.go:322] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
	I0304 11:56:36.240457  444352 kubeadm.go:322]   https://kubernetes.io/docs/concepts/cluster-administration/addons/
	I0304 11:56:36.240472  444352 kubeadm.go:322] 
	I0304 11:56:36.240552  444352 kubeadm.go:322] You can now join any number of control-plane nodes by copying certificate authorities
	I0304 11:56:36.240621  444352 kubeadm.go:322] and service account keys on each node and then running the following as root:
	I0304 11:56:36.240627  444352 kubeadm.go:322] 
	I0304 11:56:36.240702  444352 kubeadm.go:322]   kubeadm join control-plane.minikube.internal:8443 --token 48kg89.ty49cl97ag9d8ghi \
	I0304 11:56:36.240792  444352 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:a5b052ccc96434307975887cf00b655123d510584cfc7a3a600211bdeb8da90e \
	I0304 11:56:36.240824  444352 kubeadm.go:322]     --control-plane 
	I0304 11:56:36.240840  444352 kubeadm.go:322] 
	I0304 11:56:36.240905  444352 kubeadm.go:322] Then you can join any number of worker nodes by running the following on each as root:
	I0304 11:56:36.240911  444352 kubeadm.go:322] 
	I0304 11:56:36.240977  444352 kubeadm.go:322] kubeadm join control-plane.minikube.internal:8443 --token 48kg89.ty49cl97ag9d8ghi \
	I0304 11:56:36.241066  444352 kubeadm.go:322]     --discovery-token-ca-cert-hash sha256:a5b052ccc96434307975887cf00b655123d510584cfc7a3a600211bdeb8da90e 
	I0304 11:56:36.241084  444352 cni.go:84] Creating CNI manager for ""
	I0304 11:56:36.241091  444352 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0304 11:56:36.242599  444352 out.go:177] * Configuring CNI (Container Networking Interface) ...
	I0304 11:56:36.243953  444352 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap
	I0304 11:56:36.248011  444352 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.18.20/kubectl ...
	I0304 11:56:36.248034  444352 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)
	I0304 11:56:36.265658  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml
	I0304 11:56:36.631189  444352 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"
	I0304 11:56:36.631255  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:36.631266  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl label nodes minikube.k8s.io/version=v1.32.0 minikube.k8s.io/commit=ab57ba9f65fd4cb3ac8815e4f9baeeca5604e645 minikube.k8s.io/name=ingress-addon-legacy-577846 minikube.k8s.io/updated_at=2024_03_04T11_56_36_0700 minikube.k8s.io/primary=true --all --overwrite --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:36.750838  444352 ops.go:34] apiserver oom_adj: -16
	I0304 11:56:36.751004  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:37.251887  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:37.751830  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:38.251954  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:38.751852  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:39.251457  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:39.752114  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:40.251591  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:40.751075  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:41.252076  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:41.751994  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:42.251266  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:42.751341  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:43.251551  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:43.751907  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:44.251534  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:44.752107  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:45.251757  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:45.751222  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:46.251906  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:46.751343  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:47.251104  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:47.751349  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:48.252019  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:48.752002  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:49.251156  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:49.751344  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:50.251338  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:50.751208  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:51.251331  444352 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.18.20/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig
	I0304 11:56:51.338232  444352 kubeadm.go:1088] duration metric: took 14.707033s to wait for elevateKubeSystemPrivileges.
	I0304 11:56:51.338286  444352 kubeadm.go:406] StartCluster complete in 26.220981101s
	I0304 11:56:51.338311  444352 settings.go:142] acquiring lock: {Name:mkdbf9b8466495a7e4be006d870bd7dffc473c0c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:56:51.338395  444352 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/18284-396872/kubeconfig
	I0304 11:56:51.339331  444352 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/kubeconfig: {Name:mkcbf3bf1380cc7c2802e86e24097181dc1a959a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:56:51.339591  444352 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"
	I0304 11:56:51.339666  444352 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]
	I0304 11:56:51.339738  444352 addons.go:69] Setting storage-provisioner=true in profile "ingress-addon-legacy-577846"
	I0304 11:56:51.339764  444352 addons.go:69] Setting default-storageclass=true in profile "ingress-addon-legacy-577846"
	I0304 11:56:51.339798  444352 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ingress-addon-legacy-577846"
	I0304 11:56:51.339769  444352 addons.go:234] Setting addon storage-provisioner=true in "ingress-addon-legacy-577846"
	I0304 11:56:51.339912  444352 config.go:182] Loaded profile config "ingress-addon-legacy-577846": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.18.20
	I0304 11:56:51.339924  444352 host.go:66] Checking if "ingress-addon-legacy-577846" exists ...
	I0304 11:56:51.340263  444352 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-577846 --format={{.State.Status}}
	I0304 11:56:51.340361  444352 kapi.go:59] client config for ingress-addon-legacy-577846: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt", KeyFile:"/home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.key", CAFile:"/home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]ui
nt8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1c5d0e0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0304 11:56:51.340444  444352 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-577846 --format={{.State.Status}}
	I0304 11:56:51.341054  444352 cert_rotation.go:137] Starting client certificate rotation controller
	I0304 11:56:51.361268  444352 kapi.go:59] client config for ingress-addon-legacy-577846: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt", KeyFile:"/home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.key", CAFile:"/home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]ui
nt8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1c5d0e0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0304 11:56:51.361504  444352 addons.go:234] Setting addon default-storageclass=true in "ingress-addon-legacy-577846"
	I0304 11:56:51.361538  444352 host.go:66] Checking if "ingress-addon-legacy-577846" exists ...
	I0304 11:56:51.361929  444352 cli_runner.go:164] Run: docker container inspect ingress-addon-legacy-577846 --format={{.State.Status}}
	I0304 11:56:51.365182  444352 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5
	I0304 11:56:51.367539  444352 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml
	I0304 11:56:51.367561  444352 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)
	I0304 11:56:51.367619  444352 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-577846
	I0304 11:56:51.385943  444352 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml
	I0304 11:56:51.385969  444352 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)
	I0304 11:56:51.386029  444352 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" ingress-addon-legacy-577846
	I0304 11:56:51.388449  444352 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/ingress-addon-legacy-577846/id_rsa Username:docker}
	I0304 11:56:51.402939  444352 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32787 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/ingress-addon-legacy-577846/id_rsa Username:docker}
	I0304 11:56:51.426201  444352 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.49.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.18.20/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"
	I0304 11:56:51.523960  444352 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml
	I0304 11:56:51.524787  444352 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.18.20/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml
	I0304 11:56:51.906462  444352 kapi.go:248] "coredns" deployment in "kube-system" namespace and "ingress-addon-legacy-577846" context rescaled to 1 replicas
	I0304 11:56:51.906523  444352 start.go:223] Will wait 6m0s for node &{Name: IP:192.168.49.2 Port:8443 KubernetesVersion:v1.18.20 ContainerRuntime:crio ControlPlane:true Worker:true}
	I0304 11:56:51.908443  444352 out.go:177] * Verifying Kubernetes components...
	I0304 11:56:51.910313  444352 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0304 11:56:51.916701  444352 start.go:929] {"host.minikube.internal": 192.168.49.1} host record injected into CoreDNS's ConfigMap
	I0304 11:56:52.140063  444352 kapi.go:59] client config for ingress-addon-legacy-577846: &rest.Config{Host:"https://192.168.49.2:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt", KeyFile:"/home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.key", CAFile:"/home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]ui
nt8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1c5d0e0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}
	I0304 11:56:52.140371  444352 node_ready.go:35] waiting up to 6m0s for node "ingress-addon-legacy-577846" to be "Ready" ...
	I0304 11:56:52.146925  444352 out.go:177] * Enabled addons: storage-provisioner, default-storageclass
	I0304 11:56:52.148245  444352 addons.go:505] enable addons completed in 808.577631ms: enabled=[storage-provisioner default-storageclass]
	I0304 11:56:54.143606  444352 node_ready.go:58] node "ingress-addon-legacy-577846" has status "Ready":"False"
	I0304 11:56:56.144252  444352 node_ready.go:58] node "ingress-addon-legacy-577846" has status "Ready":"False"
	I0304 11:56:58.643168  444352 node_ready.go:58] node "ingress-addon-legacy-577846" has status "Ready":"False"
	I0304 11:57:00.643501  444352 node_ready.go:58] node "ingress-addon-legacy-577846" has status "Ready":"False"
	I0304 11:57:03.144156  444352 node_ready.go:58] node "ingress-addon-legacy-577846" has status "Ready":"False"
	I0304 11:57:05.644051  444352 node_ready.go:58] node "ingress-addon-legacy-577846" has status "Ready":"False"
	I0304 11:57:06.643789  444352 node_ready.go:49] node "ingress-addon-legacy-577846" has status "Ready":"True"
	I0304 11:57:06.643813  444352 node_ready.go:38] duration metric: took 14.503419052s waiting for node "ingress-addon-legacy-577846" to be "Ready" ...
	I0304 11:57:06.643823  444352 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0304 11:57:06.649833  444352 pod_ready.go:78] waiting up to 6m0s for pod "coredns-66bff467f8-lwk88" in "kube-system" namespace to be "Ready" ...
	I0304 11:57:08.653287  444352 pod_ready.go:102] pod "coredns-66bff467f8-lwk88" in "kube-system" namespace doesn't have "Ready" status: {Phase:Pending Conditions:[{Type:PodScheduled Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-03-04 11:56:51 +0000 UTC Reason:Unschedulable Message:0/1 nodes are available: 1 node(s) had taint {node.kubernetes.io/not-ready: }, that the pod didn't tolerate.}] Message: Reason: NominatedNodeName: HostIP: HostIPs:[] PodIP: PodIPs:[] StartTime:<nil> InitContainerStatuses:[] ContainerStatuses:[] QOSClass:Burstable EphemeralContainerStatuses:[] Resize: ResourceClaimStatuses:[]}
	I0304 11:57:10.655196  444352 pod_ready.go:102] pod "coredns-66bff467f8-lwk88" in "kube-system" namespace has status "Ready":"False"
	I0304 11:57:13.154981  444352 pod_ready.go:102] pod "coredns-66bff467f8-lwk88" in "kube-system" namespace has status "Ready":"False"
	I0304 11:57:15.155698  444352 pod_ready.go:102] pod "coredns-66bff467f8-lwk88" in "kube-system" namespace has status "Ready":"False"
	I0304 11:57:17.655721  444352 pod_ready.go:92] pod "coredns-66bff467f8-lwk88" in "kube-system" namespace has status "Ready":"True"
	I0304 11:57:17.655749  444352 pod_ready.go:81] duration metric: took 11.005886563s waiting for pod "coredns-66bff467f8-lwk88" in "kube-system" namespace to be "Ready" ...
	I0304 11:57:17.655762  444352 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ingress-addon-legacy-577846" in "kube-system" namespace to be "Ready" ...
	I0304 11:57:17.659693  444352 pod_ready.go:92] pod "etcd-ingress-addon-legacy-577846" in "kube-system" namespace has status "Ready":"True"
	I0304 11:57:17.659716  444352 pod_ready.go:81] duration metric: took 3.946894ms waiting for pod "etcd-ingress-addon-legacy-577846" in "kube-system" namespace to be "Ready" ...
	I0304 11:57:17.659728  444352 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ingress-addon-legacy-577846" in "kube-system" namespace to be "Ready" ...
	I0304 11:57:17.663730  444352 pod_ready.go:92] pod "kube-apiserver-ingress-addon-legacy-577846" in "kube-system" namespace has status "Ready":"True"
	I0304 11:57:17.663749  444352 pod_ready.go:81] duration metric: took 4.01494ms waiting for pod "kube-apiserver-ingress-addon-legacy-577846" in "kube-system" namespace to be "Ready" ...
	I0304 11:57:17.663758  444352 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ingress-addon-legacy-577846" in "kube-system" namespace to be "Ready" ...
	I0304 11:57:17.667522  444352 pod_ready.go:92] pod "kube-controller-manager-ingress-addon-legacy-577846" in "kube-system" namespace has status "Ready":"True"
	I0304 11:57:17.667541  444352 pod_ready.go:81] duration metric: took 3.777446ms waiting for pod "kube-controller-manager-ingress-addon-legacy-577846" in "kube-system" namespace to be "Ready" ...
	I0304 11:57:17.667549  444352 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-jr59c" in "kube-system" namespace to be "Ready" ...
	I0304 11:57:17.671223  444352 pod_ready.go:92] pod "kube-proxy-jr59c" in "kube-system" namespace has status "Ready":"True"
	I0304 11:57:17.671241  444352 pod_ready.go:81] duration metric: took 3.687238ms waiting for pod "kube-proxy-jr59c" in "kube-system" namespace to be "Ready" ...
	I0304 11:57:17.671249  444352 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ingress-addon-legacy-577846" in "kube-system" namespace to be "Ready" ...
	I0304 11:57:17.851669  444352 request.go:629] Waited for 180.350126ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ingress-addon-legacy-577846
	I0304 11:57:18.051625  444352 request.go:629] Waited for 197.419475ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes/ingress-addon-legacy-577846
	I0304 11:57:18.054324  444352 pod_ready.go:92] pod "kube-scheduler-ingress-addon-legacy-577846" in "kube-system" namespace has status "Ready":"True"
	I0304 11:57:18.054348  444352 pod_ready.go:81] duration metric: took 383.092603ms waiting for pod "kube-scheduler-ingress-addon-legacy-577846" in "kube-system" namespace to be "Ready" ...
	I0304 11:57:18.054359  444352 pod_ready.go:38] duration metric: took 11.410512649s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...
	I0304 11:57:18.054389  444352 api_server.go:52] waiting for apiserver process to appear ...
	I0304 11:57:18.054456  444352 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0304 11:57:18.065155  444352 api_server.go:72] duration metric: took 26.158584297s to wait for apiserver process to appear ...
	I0304 11:57:18.065183  444352 api_server.go:88] waiting for apiserver healthz status ...
	I0304 11:57:18.065203  444352 api_server.go:253] Checking apiserver healthz at https://192.168.49.2:8443/healthz ...
	I0304 11:57:18.069444  444352 api_server.go:279] https://192.168.49.2:8443/healthz returned 200:
	ok
	I0304 11:57:18.070221  444352 api_server.go:141] control plane version: v1.18.20
	I0304 11:57:18.070249  444352 api_server.go:131] duration metric: took 5.0585ms to wait for apiserver health ...
	I0304 11:57:18.070268  444352 system_pods.go:43] waiting for kube-system pods to appear ...
	I0304 11:57:18.251727  444352 request.go:629] Waited for 181.345709ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods
	I0304 11:57:18.257359  444352 system_pods.go:59] 8 kube-system pods found
	I0304 11:57:18.257392  444352 system_pods.go:61] "coredns-66bff467f8-lwk88" [1642b97b-5f08-49ed-a516-56a59042a09f] Running
	I0304 11:57:18.257397  444352 system_pods.go:61] "etcd-ingress-addon-legacy-577846" [43e86b6e-93b0-4f14-acc2-8323eaaf7726] Running
	I0304 11:57:18.257401  444352 system_pods.go:61] "kindnet-d9m7x" [05eaa9e6-f87c-4f32-bf33-1238e3d3d530] Running
	I0304 11:57:18.257405  444352 system_pods.go:61] "kube-apiserver-ingress-addon-legacy-577846" [61587216-36b3-47fa-9586-5498c5845ed8] Running
	I0304 11:57:18.257409  444352 system_pods.go:61] "kube-controller-manager-ingress-addon-legacy-577846" [5cd0c065-c994-42b5-85dd-51eca150eddb] Running
	I0304 11:57:18.257412  444352 system_pods.go:61] "kube-proxy-jr59c" [f07e2ed7-97c7-40e7-8eac-8b6424aaf574] Running
	I0304 11:57:18.257418  444352 system_pods.go:61] "kube-scheduler-ingress-addon-legacy-577846" [bb9e12a3-9468-4950-bd1b-1dc5f2720e0f] Running
	I0304 11:57:18.257421  444352 system_pods.go:61] "storage-provisioner" [332d4e03-565a-4b1e-9068-466c13764928] Running
	I0304 11:57:18.257427  444352 system_pods.go:74] duration metric: took 187.15098ms to wait for pod list to return data ...
	I0304 11:57:18.257435  444352 default_sa.go:34] waiting for default service account to be created ...
	I0304 11:57:18.451823  444352 request.go:629] Waited for 194.301812ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/default/serviceaccounts
	I0304 11:57:18.454244  444352 default_sa.go:45] found service account: "default"
	I0304 11:57:18.454271  444352 default_sa.go:55] duration metric: took 196.825397ms for default service account to be created ...
	I0304 11:57:18.454280  444352 system_pods.go:116] waiting for k8s-apps to be running ...
	I0304 11:57:18.651478  444352 request.go:629] Waited for 197.112317ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/namespaces/kube-system/pods
	I0304 11:57:18.657159  444352 system_pods.go:86] 8 kube-system pods found
	I0304 11:57:18.657188  444352 system_pods.go:89] "coredns-66bff467f8-lwk88" [1642b97b-5f08-49ed-a516-56a59042a09f] Running
	I0304 11:57:18.657195  444352 system_pods.go:89] "etcd-ingress-addon-legacy-577846" [43e86b6e-93b0-4f14-acc2-8323eaaf7726] Running
	I0304 11:57:18.657201  444352 system_pods.go:89] "kindnet-d9m7x" [05eaa9e6-f87c-4f32-bf33-1238e3d3d530] Running
	I0304 11:57:18.657208  444352 system_pods.go:89] "kube-apiserver-ingress-addon-legacy-577846" [61587216-36b3-47fa-9586-5498c5845ed8] Running
	I0304 11:57:18.657215  444352 system_pods.go:89] "kube-controller-manager-ingress-addon-legacy-577846" [5cd0c065-c994-42b5-85dd-51eca150eddb] Running
	I0304 11:57:18.657221  444352 system_pods.go:89] "kube-proxy-jr59c" [f07e2ed7-97c7-40e7-8eac-8b6424aaf574] Running
	I0304 11:57:18.657227  444352 system_pods.go:89] "kube-scheduler-ingress-addon-legacy-577846" [bb9e12a3-9468-4950-bd1b-1dc5f2720e0f] Running
	I0304 11:57:18.657237  444352 system_pods.go:89] "storage-provisioner" [332d4e03-565a-4b1e-9068-466c13764928] Running
	I0304 11:57:18.657246  444352 system_pods.go:126] duration metric: took 202.958989ms to wait for k8s-apps to be running ...
	I0304 11:57:18.657259  444352 system_svc.go:44] waiting for kubelet service to be running ....
	I0304 11:57:18.657324  444352 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0304 11:57:18.670687  444352 system_svc.go:56] duration metric: took 13.420096ms WaitForService to wait for kubelet.
	I0304 11:57:18.670713  444352 kubeadm.go:581] duration metric: took 26.764146462s to wait for : map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] ...
	I0304 11:57:18.670737  444352 node_conditions.go:102] verifying NodePressure condition ...
	I0304 11:57:18.851207  444352 request.go:629] Waited for 180.362681ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.49.2:8443/api/v1/nodes
	I0304 11:57:18.854209  444352 node_conditions.go:122] node storage ephemeral capacity is 304681132Ki
	I0304 11:57:18.854244  444352 node_conditions.go:123] node cpu capacity is 8
	I0304 11:57:18.854261  444352 node_conditions.go:105] duration metric: took 183.518124ms to run NodePressure ...
	I0304 11:57:18.854277  444352 start.go:228] waiting for startup goroutines ...
	I0304 11:57:18.854286  444352 start.go:233] waiting for cluster config update ...
	I0304 11:57:18.854302  444352 start.go:242] writing updated cluster config ...
	I0304 11:57:18.854644  444352 ssh_runner.go:195] Run: rm -f paused
	I0304 11:57:18.902927  444352 start.go:601] kubectl: 1.29.2, cluster: 1.18.20 (minor skew: 11)
	I0304 11:57:18.905038  444352 out.go:177] 
	W0304 11:57:18.906477  444352 out.go:239] ! /usr/local/bin/kubectl is version 1.29.2, which may have incompatibilities with Kubernetes 1.18.20.
	I0304 11:57:18.907868  444352 out.go:177]   - Want kubectl v1.18.20? Try 'minikube kubectl -- get pods -A'
	I0304 11:57:18.909057  444352 out.go:177] * Done! kubectl is now configured to use "ingress-addon-legacy-577846" cluster and "default" namespace by default
	
	
	==> CRI-O <==
	Mar 04 12:00:00 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:00.938674055Z" level=info msg="Started container" PID=4909 containerID=c691fd5e69a8493b95df135055c28c612fcc0a8cd50bbd066ec18c1eef4d31df description=default/hello-world-app-5f5d8b66bb-rscls/hello-world-app id=eb9bd441-e6d0-43b1-8efa-6051c20a1479 name=/runtime.v1alpha2.RuntimeService/StartContainer sandboxID=a527db9ce8d9529b0418d9f981db47b443a272448e7b0bf58680d9d5da71e461
	Mar 04 12:00:03 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:03.504719679Z" level=info msg="Checking image status: cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab" id=0351a229-c601-4b19-b92e-489bd4851df3 name=/runtime.v1alpha2.ImageService/ImageStatus
	Mar 04 12:00:14 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:14.505325331Z" level=info msg="Stopping pod sandbox: a70ccef4ceea050f0b1147bbaa0cec2828c4b07cdc0d14220d3ec3fcea3d781d" id=de6a36f8-ad14-41c2-a464-ced38fe23463 name=/runtime.v1alpha2.RuntimeService/StopPodSandbox
	Mar 04 12:00:14 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:14.506375078Z" level=info msg="Stopped pod sandbox: a70ccef4ceea050f0b1147bbaa0cec2828c4b07cdc0d14220d3ec3fcea3d781d" id=de6a36f8-ad14-41c2-a464-ced38fe23463 name=/runtime.v1alpha2.RuntimeService/StopPodSandbox
	Mar 04 12:00:14 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:14.991475667Z" level=info msg="Stopping pod sandbox: a70ccef4ceea050f0b1147bbaa0cec2828c4b07cdc0d14220d3ec3fcea3d781d" id=1282b4f2-f310-4425-b3d2-7e6e3249ff27 name=/runtime.v1alpha2.RuntimeService/StopPodSandbox
	Mar 04 12:00:14 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:14.991545701Z" level=info msg="Stopped pod sandbox (already stopped): a70ccef4ceea050f0b1147bbaa0cec2828c4b07cdc0d14220d3ec3fcea3d781d" id=1282b4f2-f310-4425-b3d2-7e6e3249ff27 name=/runtime.v1alpha2.RuntimeService/StopPodSandbox
	Mar 04 12:00:15 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:15.739288883Z" level=info msg="Stopping container: 37e08d536e3ea75354d0a0103769e5c313e9aec3a2272c8d91d6ef66925b461d (timeout: 2s)" id=ccd2d2f8-20d7-4fdd-a6d7-c19d82181430 name=/runtime.v1alpha2.RuntimeService/StopContainer
	Mar 04 12:00:15 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:15.739828043Z" level=info msg="Stopping container: 37e08d536e3ea75354d0a0103769e5c313e9aec3a2272c8d91d6ef66925b461d (timeout: 2s)" id=1f427f4c-2f41-4608-b40b-88f5ace7eef5 name=/runtime.v1alpha2.RuntimeService/StopContainer
	Mar 04 12:00:16 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:16.504264546Z" level=info msg="Stopping pod sandbox: a70ccef4ceea050f0b1147bbaa0cec2828c4b07cdc0d14220d3ec3fcea3d781d" id=365591d4-ae83-4caa-87f3-393843357a98 name=/runtime.v1alpha2.RuntimeService/StopPodSandbox
	Mar 04 12:00:16 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:16.504326026Z" level=info msg="Stopped pod sandbox (already stopped): a70ccef4ceea050f0b1147bbaa0cec2828c4b07cdc0d14220d3ec3fcea3d781d" id=365591d4-ae83-4caa-87f3-393843357a98 name=/runtime.v1alpha2.RuntimeService/StopPodSandbox
	Mar 04 12:00:17 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:17.746593392Z" level=warning msg="Stopping container 37e08d536e3ea75354d0a0103769e5c313e9aec3a2272c8d91d6ef66925b461d with stop signal timed out: timeout reached after 2 seconds waiting for container process to exit" id=ccd2d2f8-20d7-4fdd-a6d7-c19d82181430 name=/runtime.v1alpha2.RuntimeService/StopContainer
	Mar 04 12:00:17 ingress-addon-legacy-577846 conmon[3443]: conmon 37e08d536e3ea75354d0 <ninfo>: container 3455 exited with status 137
	Mar 04 12:00:17 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:17.891321033Z" level=info msg="Stopped container 37e08d536e3ea75354d0a0103769e5c313e9aec3a2272c8d91d6ef66925b461d: ingress-nginx/ingress-nginx-controller-7fcf777cb7-8pflk/controller" id=1f427f4c-2f41-4608-b40b-88f5ace7eef5 name=/runtime.v1alpha2.RuntimeService/StopContainer
	Mar 04 12:00:17 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:17.891733340Z" level=info msg="Stopped container 37e08d536e3ea75354d0a0103769e5c313e9aec3a2272c8d91d6ef66925b461d: ingress-nginx/ingress-nginx-controller-7fcf777cb7-8pflk/controller" id=ccd2d2f8-20d7-4fdd-a6d7-c19d82181430 name=/runtime.v1alpha2.RuntimeService/StopContainer
	Mar 04 12:00:17 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:17.892020845Z" level=info msg="Stopping pod sandbox: c9d787c7d02af3cc0f68d3cc3f573063d8ec53af52ec37c8ddf77551101ab595" id=fd91a521-63b6-42fd-ac16-8d5a29d67eea name=/runtime.v1alpha2.RuntimeService/StopPodSandbox
	Mar 04 12:00:17 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:17.892123070Z" level=info msg="Stopping pod sandbox: c9d787c7d02af3cc0f68d3cc3f573063d8ec53af52ec37c8ddf77551101ab595" id=a21932b1-0a8c-4189-82b1-0dc2bac7552a name=/runtime.v1alpha2.RuntimeService/StopPodSandbox
	Mar 04 12:00:17 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:17.894818234Z" level=info msg="Restoring iptables rules: *nat\n:KUBE-HP-3IF62QOSW6W62I7V - [0:0]\n:KUBE-HOSTPORTS - [0:0]\n:KUBE-HP-YP2WHTPFGA4BD4QU - [0:0]\n-X KUBE-HP-YP2WHTPFGA4BD4QU\n-X KUBE-HP-3IF62QOSW6W62I7V\nCOMMIT\n"
	Mar 04 12:00:17 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:17.895974651Z" level=info msg="Closing host port tcp:80"
	Mar 04 12:00:17 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:17.896006815Z" level=info msg="Closing host port tcp:443"
	Mar 04 12:00:17 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:17.896948231Z" level=info msg="Host port tcp:80 does not have an open socket"
	Mar 04 12:00:17 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:17.896964826Z" level=info msg="Host port tcp:443 does not have an open socket"
	Mar 04 12:00:17 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:17.897088718Z" level=info msg="Got pod network &{Name:ingress-nginx-controller-7fcf777cb7-8pflk Namespace:ingress-nginx ID:c9d787c7d02af3cc0f68d3cc3f573063d8ec53af52ec37c8ddf77551101ab595 UID:b8cab2e1-496b-443b-959f-ed7f51bb6668 NetNS:/var/run/netns/9dfaf94e-b2f4-4b0e-b7ce-767ee1448304 Networks:[{Name:kindnet Ifname:eth0}] RuntimeConfig:map[kindnet:{IP: MAC: PortMappings:[] Bandwidth:<nil> IpRanges:[]}] Aliases:map[]}"
	Mar 04 12:00:17 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:17.897200086Z" level=info msg="Deleting pod ingress-nginx_ingress-nginx-controller-7fcf777cb7-8pflk from CNI network \"kindnet\" (type=ptp)"
	Mar 04 12:00:17 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:17.927455307Z" level=info msg="Stopped pod sandbox: c9d787c7d02af3cc0f68d3cc3f573063d8ec53af52ec37c8ddf77551101ab595" id=fd91a521-63b6-42fd-ac16-8d5a29d67eea name=/runtime.v1alpha2.RuntimeService/StopPodSandbox
	Mar 04 12:00:17 ingress-addon-legacy-577846 crio[972]: time="2024-03-04 12:00:17.927565083Z" level=info msg="Stopped pod sandbox (already stopped): c9d787c7d02af3cc0f68d3cc3f573063d8ec53af52ec37c8ddf77551101ab595" id=a21932b1-0a8c-4189-82b1-0dc2bac7552a name=/runtime.v1alpha2.RuntimeService/StopPodSandbox
	
	
	==> container status <==
	CONTAINER           IMAGE                                                                                                              CREATED             STATE               NAME                      ATTEMPT             POD ID              POD
	c691fd5e69a84       gcr.io/google-samples/hello-app@sha256:b1455e1c4fcc5ea1023c9e3b584cd84b64eb920e332feff690a2829696e379e7            22 seconds ago      Running             hello-world-app           0                   a527db9ce8d95       hello-world-app-5f5d8b66bb-rscls
	b0e43219145eb       docker.io/library/nginx@sha256:6a2f8b28e45c4adea04ec207a251fd4a2df03ddc930f782af51e315ebc76e9a9                    2 minutes ago       Running             nginx                     0                   cf3f5a09d4add       nginx
	37e08d536e3ea       registry.k8s.io/ingress-nginx/controller@sha256:35fe394c82164efa8f47f3ed0be981b3f23da77175bbb8268a9ae438851c8324   2 minutes ago       Exited              controller                0                   c9d787c7d02af       ingress-nginx-controller-7fcf777cb7-8pflk
	6a57f46985bb2       a013daf8730dbb3908d66f67c57053f09055fddb28fde0b5808cb24c27900dc8                                                   3 minutes ago       Exited              patch                     1                   2c8b51ecc6552       ingress-nginx-admission-patch-87hhd
	7b9f0e7382a5a       docker.io/jettech/kube-webhook-certgen@sha256:784853e84a0223f34ea58fe36766c2dbeb129b125d25f16b8468c903262b77f6     3 minutes ago       Exited              create                    0                   c83faf44214ed       ingress-nginx-admission-create-vcddg
	a4a3239946884       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                                   3 minutes ago       Running             storage-provisioner       0                   bab8c3b493a7e       storage-provisioner
	b4f4dfd3c7474       67da37a9a360e600e74464da48437257b00a754c77c40f60c65e4cb327c34bd5                                                   3 minutes ago       Running             coredns                   0                   03c999642deb6       coredns-66bff467f8-lwk88
	99ea107b89e41       docker.io/kindest/kindnetd@sha256:61f9956af8019caf6dcc4d39b31857b868aaab80521432ddcc216b805c4f7988                 3 minutes ago       Running             kindnet-cni               0                   86fbdcdfab34c       kindnet-d9m7x
	83abda6eed044       27f8b8d51985f755cfb3ffea424fa34865cc0da63e99378d8202f923c3c5a8ba                                                   3 minutes ago       Running             kube-proxy                0                   f5ff4179e4569       kube-proxy-jr59c
	22a2cb4dc1c40       e7c545a60706cf009a893afdc7dba900cc2e342b8042b9c421d607ca41e8b290                                                   3 minutes ago       Running             kube-controller-manager   0                   83160885b26f8       kube-controller-manager-ingress-addon-legacy-577846
	71a78dc492a1b       a05a1a79adaad058478b7638d2e73cf408b283305081516fbe02706b0e205346                                                   3 minutes ago       Running             kube-scheduler            0                   9470dee22b21b       kube-scheduler-ingress-addon-legacy-577846
	480f9650126cd       7d8d2960de69688eab5698081441539a1662f47e092488973e455a8334955cb1                                                   3 minutes ago       Running             kube-apiserver            0                   a17e5d022eed0       kube-apiserver-ingress-addon-legacy-577846
	4750d56ca2288       303ce5db0e90dab1c5728ec70d21091201a23cdf8aeca70ab54943bbaaf0833f                                                   3 minutes ago       Running             etcd                      0                   74b162236090c       etcd-ingress-addon-legacy-577846
	
	
	==> coredns [b4f4dfd3c74743ad38e6d2e2bdd8d6db14e924ce1a5766dca347ef8aa735fc37] <==
	[INFO] 10.244.0.5:60169 - 30969 "AAAA IN hello-world-app.default.svc.cluster.local.c.k8s-minikube.internal. udp 83 false 512" NXDOMAIN qr,rd,ra 83 0.003579028s
	[INFO] 10.244.0.5:57536 - 62101 "A IN hello-world-app.default.svc.cluster.local.google.internal. udp 75 false 512" NXDOMAIN qr,rd,ra 75 0.003863744s
	[INFO] 10.244.0.5:60169 - 62248 "A IN hello-world-app.default.svc.cluster.local.google.internal. udp 75 false 512" NXDOMAIN qr,rd,ra 75 0.003707406s
	[INFO] 10.244.0.5:55675 - 43922 "A IN hello-world-app.default.svc.cluster.local.google.internal. udp 75 false 512" NXDOMAIN qr,rd,ra 75 0.003697372s
	[INFO] 10.244.0.5:44741 - 1719 "A IN hello-world-app.default.svc.cluster.local.google.internal. udp 75 false 512" NXDOMAIN qr,rd,ra 75 0.004228301s
	[INFO] 10.244.0.5:41495 - 32534 "A IN hello-world-app.default.svc.cluster.local.google.internal. udp 75 false 512" NXDOMAIN qr,rd,ra 75 0.00417086s
	[INFO] 10.244.0.5:43793 - 55966 "A IN hello-world-app.default.svc.cluster.local.google.internal. udp 75 false 512" NXDOMAIN qr,rd,ra 75 0.004052466s
	[INFO] 10.244.0.5:44054 - 18285 "A IN hello-world-app.default.svc.cluster.local.google.internal. udp 75 false 512" NXDOMAIN qr,rd,ra 75 0.003701689s
	[INFO] 10.244.0.5:44173 - 3864 "A IN hello-world-app.default.svc.cluster.local.google.internal. udp 75 false 512" NXDOMAIN qr,rd,ra 75 0.004368577s
	[INFO] 10.244.0.5:57536 - 30370 "AAAA IN hello-world-app.default.svc.cluster.local.google.internal. udp 75 false 512" NXDOMAIN qr,rd,ra 75 0.004041927s
	[INFO] 10.244.0.5:43793 - 31936 "AAAA IN hello-world-app.default.svc.cluster.local.google.internal. udp 75 false 512" NXDOMAIN qr,rd,ra 75 0.003748297s
	[INFO] 10.244.0.5:44741 - 4304 "AAAA IN hello-world-app.default.svc.cluster.local.google.internal. udp 75 false 512" NXDOMAIN qr,rd,ra 75 0.003951366s
	[INFO] 10.244.0.5:60169 - 55675 "AAAA IN hello-world-app.default.svc.cluster.local.google.internal. udp 75 false 512" NXDOMAIN qr,rd,ra 75 0.004094029s
	[INFO] 10.244.0.5:41495 - 60846 "AAAA IN hello-world-app.default.svc.cluster.local.google.internal. udp 75 false 512" NXDOMAIN qr,rd,ra 75 0.003882068s
	[INFO] 10.244.0.5:57536 - 28166 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000070933s
	[INFO] 10.244.0.5:43793 - 42775 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000044887s
	[INFO] 10.244.0.5:55675 - 43230 "AAAA IN hello-world-app.default.svc.cluster.local.google.internal. udp 75 false 512" NXDOMAIN qr,rd,ra 75 0.004139855s
	[INFO] 10.244.0.5:44741 - 8045 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000061489s
	[INFO] 10.244.0.5:41495 - 28841 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000048229s
	[INFO] 10.244.0.5:60169 - 17599 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000120426s
	[INFO] 10.244.0.5:44173 - 49847 "AAAA IN hello-world-app.default.svc.cluster.local.google.internal. udp 75 false 512" NXDOMAIN qr,rd,ra 75 0.003644558s
	[INFO] 10.244.0.5:44054 - 64813 "AAAA IN hello-world-app.default.svc.cluster.local.google.internal. udp 75 false 512" NXDOMAIN qr,rd,ra 75 0.003836228s
	[INFO] 10.244.0.5:55675 - 53494 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000063912s
	[INFO] 10.244.0.5:44054 - 18291 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.000073719s
	[INFO] 10.244.0.5:44173 - 9715 "A IN hello-world-app.default.svc.cluster.local. udp 59 false 512" NOERROR qr,aa,rd 116 0.00014048s
	
	
	==> describe nodes <==
	Name:               ingress-addon-legacy-577846
	Roles:              master
	Labels:             beta.kubernetes.io/arch=amd64
	                    beta.kubernetes.io/os=linux
	                    kubernetes.io/arch=amd64
	                    kubernetes.io/hostname=ingress-addon-legacy-577846
	                    kubernetes.io/os=linux
	                    minikube.k8s.io/commit=ab57ba9f65fd4cb3ac8815e4f9baeeca5604e645
	                    minikube.k8s.io/name=ingress-addon-legacy-577846
	                    minikube.k8s.io/primary=true
	                    minikube.k8s.io/updated_at=2024_03_04T11_56_36_0700
	                    minikube.k8s.io/version=v1.32.0
	                    node-role.kubernetes.io/master=
	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: /var/run/crio/crio.sock
	                    node.alpha.kubernetes.io/ttl: 0
	                    volumes.kubernetes.io/controller-managed-attach-detach: true
	CreationTimestamp:  Mon, 04 Mar 2024 11:56:33 +0000
	Taints:             <none>
	Unschedulable:      false
	Lease:
	  HolderIdentity:  ingress-addon-legacy-577846
	  AcquireTime:     <unset>
	  RenewTime:       Mon, 04 Mar 2024 12:00:16 +0000
	Conditions:
	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message
	  ----             ------  -----------------                 ------------------                ------                       -------
	  MemoryPressure   False   Mon, 04 Mar 2024 12:00:06 +0000   Mon, 04 Mar 2024 11:56:30 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available
	  DiskPressure     False   Mon, 04 Mar 2024 12:00:06 +0000   Mon, 04 Mar 2024 11:56:30 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure
	  PIDPressure      False   Mon, 04 Mar 2024 12:00:06 +0000   Mon, 04 Mar 2024 11:56:30 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available
	  Ready            True    Mon, 04 Mar 2024 12:00:06 +0000   Mon, 04 Mar 2024 11:57:06 +0000   KubeletReady                 kubelet is posting ready status
	Addresses:
	  InternalIP:  192.168.49.2
	  Hostname:    ingress-addon-legacy-577846
	Capacity:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32859364Ki
	  pods:               110
	Allocatable:
	  cpu:                8
	  ephemeral-storage:  304681132Ki
	  hugepages-1Gi:      0
	  hugepages-2Mi:      0
	  memory:             32859364Ki
	  pods:               110
	System Info:
	  Machine ID:                 57b78d224f51492390ba8cc6311b9c1f
	  System UUID:                39d0cc5a-ba52-4db2-a2ab-007e24de4245
	  Boot ID:                    8bd20ee9-487a-4290-b90e-1794c4ce93e6
	  Kernel Version:             5.15.0-1052-gcp
	  OS Image:                   Ubuntu 22.04.3 LTS
	  Operating System:           linux
	  Architecture:               amd64
	  Container Runtime Version:  cri-o://1.24.6
	  Kubelet Version:            v1.18.20
	  Kube-Proxy Version:         v1.18.20
	PodCIDR:                      10.244.0.0/24
	PodCIDRs:                     10.244.0.0/24
	Non-terminated Pods:          (10 in total)
	  Namespace                   Name                                                   CPU Requests  CPU Limits  Memory Requests  Memory Limits  AGE
	  ---------                   ----                                                   ------------  ----------  ---------------  -------------  ---
	  default                     hello-world-app-5f5d8b66bb-rscls                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         25s
	  default                     nginx                                                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m43s
	  kube-system                 coredns-66bff467f8-lwk88                               100m (1%!)(MISSING)     0 (0%!)(MISSING)      70Mi (0%!)(MISSING)        170Mi (0%!)(MISSING)     3m32s
	  kube-system                 etcd-ingress-addon-legacy-577846                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m47s
	  kube-system                 kindnet-d9m7x                                          100m (1%!)(MISSING)     100m (1%!)(MISSING)   50Mi (0%!)(MISSING)        50Mi (0%!)(MISSING)      3m32s
	  kube-system                 kube-apiserver-ingress-addon-legacy-577846             250m (3%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m47s
	  kube-system                 kube-controller-manager-ingress-addon-legacy-577846    200m (2%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m47s
	  kube-system                 kube-proxy-jr59c                                       0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m32s
	  kube-system                 kube-scheduler-ingress-addon-legacy-577846             100m (1%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m47s
	  kube-system                 storage-provisioner                                    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m31s
	Allocated resources:
	  (Total limits may be over 100 percent, i.e., overcommitted.)
	  Resource           Requests    Limits
	  --------           --------    ------
	  cpu                750m (9%!)(MISSING)   100m (1%!)(MISSING)
	  memory             120Mi (0%!)(MISSING)  220Mi (0%!)(MISSING)
	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-1Gi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)
	Events:
	  Type    Reason                   Age                    From        Message
	  ----    ------                   ----                   ----        -------
	  Normal  NodeHasSufficientMemory  3m55s (x4 over 3m55s)  kubelet     Node ingress-addon-legacy-577846 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    3m55s (x4 over 3m55s)  kubelet     Node ingress-addon-legacy-577846 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     3m55s (x4 over 3m55s)  kubelet     Node ingress-addon-legacy-577846 status is now: NodeHasSufficientPID
	  Normal  Starting                 3m47s                  kubelet     Starting kubelet.
	  Normal  NodeHasSufficientMemory  3m47s                  kubelet     Node ingress-addon-legacy-577846 status is now: NodeHasSufficientMemory
	  Normal  NodeHasNoDiskPressure    3m47s                  kubelet     Node ingress-addon-legacy-577846 status is now: NodeHasNoDiskPressure
	  Normal  NodeHasSufficientPID     3m47s                  kubelet     Node ingress-addon-legacy-577846 status is now: NodeHasSufficientPID
	  Normal  Starting                 3m31s                  kube-proxy  Starting kube-proxy.
	  Normal  NodeReady                3m17s                  kubelet     Node ingress-addon-legacy-577846 status is now: NodeReady
	
	
	==> dmesg <==
	[  +0.004929] FS-Cache: N-cookie c=00000010 [p=00000003 fl=2 nc=0 na=1]
	[  +0.006589] FS-Cache: N-cookie d=00000000305954b4{9p.inode} n=00000000c3c2e09c
	[  +0.008724] FS-Cache: N-key=[8] '3ca90f0200000000'
	[  +2.622047] FS-Cache: Duplicate cookie detected
	[  +0.004682] FS-Cache: O-cookie c=00000013 [p=00000002 fl=222 nc=0 na=1]
	[  +0.006767] FS-Cache: O-cookie d=000000001b7472ac{9P.session} n=00000000a835ef23
	[  +0.007525] FS-Cache: O-key=[10] '34333035333633323536'
	[  +0.005347] FS-Cache: N-cookie c=00000014 [p=00000002 fl=2 nc=0 na=1]
	[  +0.006586] FS-Cache: N-cookie d=000000001b7472ac{9P.session} n=00000000c5a58e38
	[  +0.008901] FS-Cache: N-key=[10] '34333035333633323536'
	[ +23.762281] kmem.limit_in_bytes is deprecated and will be removed. Please report your usecase to linux-mm@kvack.org if you depend on this functionality.
	[Mar 4 11:57] IPv4: martian source 10.244.0.5 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: ce 5f d4 82 b4 b0 0a b8 4b 75 ae 8c 08 00
	[  +1.019314] IPv4: martian source 10.244.0.5 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: ce 5f d4 82 b4 b0 0a b8 4b 75 ae 8c 08 00
	[  +2.015837] IPv4: martian source 10.244.0.5 from 127.0.0.1, on dev eth0
	[  +0.000005] ll header: 00000000: ce 5f d4 82 b4 b0 0a b8 4b 75 ae 8c 08 00
	[  +4.095581] IPv4: martian source 10.244.0.5 from 127.0.0.1, on dev eth0
	[  +0.000024] ll header: 00000000: ce 5f d4 82 b4 b0 0a b8 4b 75 ae 8c 08 00
	[  +8.195203] IPv4: martian source 10.244.0.5 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: ce 5f d4 82 b4 b0 0a b8 4b 75 ae 8c 08 00
	[Mar 4 11:58] IPv4: martian source 10.244.0.5 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: ce 5f d4 82 b4 b0 0a b8 4b 75 ae 8c 08 00
	[ +33.016895] IPv4: martian source 10.244.0.5 from 127.0.0.1, on dev eth0
	[  +0.000006] ll header: 00000000: ce 5f d4 82 b4 b0 0a b8 4b 75 ae 8c 08 00
	
	
	==> etcd [4750d56ca22888b93120f53c6cfaea9ef739b0475bfd69e97f2a077479e3eb76] <==
	2024-03-04 11:56:29.502382 W | auth: simple token is not cryptographically signed
	2024-03-04 11:56:29.505983 I | etcdserver: starting server... [version: 3.4.3, cluster version: to_be_decided]
	2024-03-04 11:56:29.506681 I | etcdserver: aec36adc501070cc as single-node; fast-forwarding 9 ticks (election ticks 10)
	raft2024/03/04 11:56:29 INFO: aec36adc501070cc switched to configuration voters=(12593026477526642892)
	2024-03-04 11:56:29.507281 I | etcdserver/membership: added member aec36adc501070cc [https://192.168.49.2:2380] to cluster fa54960ea34d58be
	2024-03-04 11:56:29.508946 I | embed: ClientTLS: cert = /var/lib/minikube/certs/etcd/server.crt, key = /var/lib/minikube/certs/etcd/server.key, trusted-ca = /var/lib/minikube/certs/etcd/ca.crt, client-cert-auth = true, crl-file = 
	2024-03-04 11:56:29.509129 I | embed: listening for metrics on http://127.0.0.1:2381
	2024-03-04 11:56:29.509212 I | embed: listening for peers on 192.168.49.2:2380
	raft2024/03/04 11:56:29 INFO: aec36adc501070cc is starting a new election at term 1
	raft2024/03/04 11:56:29 INFO: aec36adc501070cc became candidate at term 2
	raft2024/03/04 11:56:29 INFO: aec36adc501070cc received MsgVoteResp from aec36adc501070cc at term 2
	raft2024/03/04 11:56:29 INFO: aec36adc501070cc became leader at term 2
	raft2024/03/04 11:56:29 INFO: raft.node: aec36adc501070cc elected leader aec36adc501070cc at term 2
	2024-03-04 11:56:29.742693 I | etcdserver: setting up the initial cluster version to 3.4
	2024-03-04 11:56:29.743514 N | etcdserver/membership: set the initial cluster version to 3.4
	2024-03-04 11:56:29.743561 I | etcdserver/api: enabled capabilities for version 3.4
	2024-03-04 11:56:29.743590 I | embed: ready to serve client requests
	2024-03-04 11:56:29.743619 I | embed: ready to serve client requests
	2024-03-04 11:56:29.743674 I | etcdserver: published {Name:ingress-addon-legacy-577846 ClientURLs:[https://192.168.49.2:2379]} to cluster fa54960ea34d58be
	2024-03-04 11:56:29.745413 I | embed: serving client requests on 192.168.49.2:2379
	2024-03-04 11:56:29.745532 I | embed: serving client requests on 127.0.0.1:2379
	2024-03-04 11:56:56.685043 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-apiserver-ingress-addon-legacy-577846\" " with result "range_response_count:1 size:6680" took too long (171.437808ms) to execute
	2024-03-04 11:56:56.804059 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-controller-manager-ingress-addon-legacy-577846\" " with result "range_response_count:1 size:6682" took too long (111.2491ms) to execute
	2024-03-04 11:56:57.013438 W | etcdserver: read-only range request "key:\"/registry/pods/kube-system/kube-scheduler-ingress-addon-legacy-577846\" " with result "range_response_count:1 size:3909" took too long (202.577204ms) to execute
	2024-03-04 11:56:57.293577 W | etcdserver: read-only range request "key:\"/registry/minions/ingress-addon-legacy-577846\" " with result "range_response_count:1 size:6604" took too long (151.531641ms) to execute
	
	
	==> kernel <==
	 12:00:23 up 11:42,  0 users,  load average: 0.81, 1.24, 1.57
	Linux ingress-addon-legacy-577846 5.15.0-1052-gcp #60~20.04.1-Ubuntu SMP Thu Feb 15 13:21:04 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
	PRETTY_NAME="Ubuntu 22.04.3 LTS"
	
	
	==> kindnet [99ea107b89e413fff69dea82090cdba26201aa041446ab6d74d05d661e91d811] <==
	I0304 11:58:14.073201       1 main.go:227] handling current node
	I0304 11:58:24.077007       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:58:24.077040       1 main.go:227] handling current node
	I0304 11:58:34.080096       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:58:34.080122       1 main.go:227] handling current node
	I0304 11:58:44.083717       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:58:44.083741       1 main.go:227] handling current node
	I0304 11:58:54.092646       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:58:54.092668       1 main.go:227] handling current node
	I0304 11:59:04.095810       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:59:04.095836       1 main.go:227] handling current node
	I0304 11:59:14.107644       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:59:14.107669       1 main.go:227] handling current node
	I0304 11:59:24.111092       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:59:24.111119       1 main.go:227] handling current node
	I0304 11:59:34.121149       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:59:34.121172       1 main.go:227] handling current node
	I0304 11:59:44.125244       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:59:44.125269       1 main.go:227] handling current node
	I0304 11:59:54.129640       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 11:59:54.129689       1 main.go:227] handling current node
	I0304 12:00:04.135294       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 12:00:04.135323       1 main.go:227] handling current node
	I0304 12:00:14.145192       1 main.go:223] Handling node with IPs: map[192.168.49.2:{}]
	I0304 12:00:14.145215       1 main.go:227] handling current node
	
	
	==> kube-apiserver [480f9650126cdee2875354cf9031dc1c8b813430394eef8e0afee8c6814e9d63] <==
	E0304 11:56:33.204704       1 controller.go:152] Unable to remove old endpoints from kubernetes service: StorageError: key not found, Code: 1, Key: /registry/masterleases/192.168.49.2, ResourceVersion: 0, AdditionalErrorMsg: 
	I0304 11:56:33.302448       1 shared_informer.go:230] Caches are synced for crd-autoregister 
	I0304 11:56:33.303389       1 shared_informer.go:230] Caches are synced for cluster_authentication_trust_controller 
	I0304 11:56:33.303426       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller
	I0304 11:56:33.304164       1 cache.go:39] Caches are synced for AvailableConditionController controller
	I0304 11:56:33.304194       1 cache.go:39] Caches are synced for autoregister controller
	I0304 11:56:34.197201       1 controller.go:130] OpenAPI AggregationController: action for item : Nothing (removed from the queue).
	I0304 11:56:34.197224       1 controller.go:130] OpenAPI AggregationController: action for item k8s_internal_local_delegation_chain_0000000000: Nothing (removed from the queue).
	I0304 11:56:34.201953       1 storage_scheduling.go:134] created PriorityClass system-node-critical with value 2000001000
	I0304 11:56:34.204803       1 storage_scheduling.go:134] created PriorityClass system-cluster-critical with value 2000000000
	I0304 11:56:34.204822       1 storage_scheduling.go:143] all system priority classes are created successfully or already exist.
	I0304 11:56:34.475359       1 controller.go:609] quota admission added evaluator for: roles.rbac.authorization.k8s.io
	I0304 11:56:34.513590       1 controller.go:609] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io
	W0304 11:56:34.644343       1 lease.go:224] Resetting endpoints for master service "kubernetes" to [192.168.49.2]
	I0304 11:56:34.645047       1 controller.go:609] quota admission added evaluator for: endpoints
	I0304 11:56:34.647902       1 controller.go:609] quota admission added evaluator for: endpointslices.discovery.k8s.io
	I0304 11:56:35.485121       1 controller.go:609] quota admission added evaluator for: serviceaccounts
	I0304 11:56:36.032741       1 controller.go:609] quota admission added evaluator for: deployments.apps
	I0304 11:56:36.218091       1 controller.go:609] quota admission added evaluator for: daemonsets.apps
	I0304 11:56:36.447244       1 controller.go:609] quota admission added evaluator for: leases.coordination.k8s.io
	I0304 11:56:51.151093       1 controller.go:609] quota admission added evaluator for: controllerrevisions.apps
	I0304 11:56:51.636720       1 controller.go:609] quota admission added evaluator for: replicasets.apps
	I0304 11:57:19.559639       1 controller.go:609] quota admission added evaluator for: jobs.batch
	I0304 11:57:40.135427       1 controller.go:609] quota admission added evaluator for: ingresses.networking.k8s.io
	E0304 12:00:17.567523       1 authentication.go:53] Unable to authenticate the request due to an error: [invalid bearer token, Token has been invalidated]
	
	
	==> kube-controller-manager [22a2cb4dc1c40ac33bc7e7a7c994cc687de2e2896961d200986d259997f6614c] <==
	I0304 11:56:51.164414       1 taint_manager.go:187] Starting NoExecuteTaintManager
	I0304 11:56:51.164972       1 event.go:278] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"ingress-addon-legacy-577846", UID:"4450254f-00a9-48a3-bc10-a53045fd2b00", APIVersion:"v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RegisteredNode' Node ingress-addon-legacy-577846 event: Registered Node ingress-addon-legacy-577846 in Controller
	I0304 11:56:51.202283       1 shared_informer.go:230] Caches are synced for service account 
	I0304 11:56:51.312370       1 shared_informer.go:230] Caches are synced for HPA 
	I0304 11:56:51.513078       1 shared_informer.go:230] Caches are synced for attach detach 
	I0304 11:56:51.621756       1 shared_informer.go:230] Caches are synced for job 
	I0304 11:56:51.633206       1 shared_informer.go:230] Caches are synced for deployment 
	I0304 11:56:51.702394       1 shared_informer.go:230] Caches are synced for disruption 
	I0304 11:56:51.702513       1 disruption.go:339] Sending events to api server.
	I0304 11:56:51.704959       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"coredns", UID:"969136e1-f855-47da-aecd-9449f823ff05", APIVersion:"apps/v1", ResourceVersion:"352", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set coredns-66bff467f8 to 1
	I0304 11:56:51.714244       1 shared_informer.go:230] Caches are synced for resource quota 
	I0304 11:56:51.719842       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-66bff467f8", UID:"4ddac465-507d-4a62-b082-e4bc8015b6b7", APIVersion:"apps/v1", ResourceVersion:"355", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: coredns-66bff467f8-lwk88
	I0304 11:56:51.802323       1 shared_informer.go:230] Caches are synced for garbage collector 
	I0304 11:56:51.802559       1 shared_informer.go:230] Caches are synced for resource quota 
	I0304 11:56:51.805131       1 shared_informer.go:230] Caches are synced for garbage collector 
	I0304 11:56:51.805154       1 garbagecollector.go:142] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
	I0304 11:57:11.165192       1 node_lifecycle_controller.go:1226] Controller detected that some Nodes are Ready. Exiting master disruption mode.
	I0304 11:57:19.552171       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"ingress-nginx", Name:"ingress-nginx-controller", UID:"f0f80512-7a6d-41f0-98bd-0e0374a4c76b", APIVersion:"apps/v1", ResourceVersion:"465", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set ingress-nginx-controller-7fcf777cb7 to 1
	I0304 11:57:19.603276       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7", UID:"2aee0e02-533d-422e-8ee8-caf448d93d88", APIVersion:"apps/v1", ResourceVersion:"466", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-controller-7fcf777cb7-8pflk
	I0304 11:57:19.608319       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"86095fb8-8eac-4057-b2b9-30eaab5060b5", APIVersion:"batch/v1", ResourceVersion:"468", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-create-vcddg
	I0304 11:57:19.617651       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"da2e1213-c968-4010-8829-a1f1b6b98448", APIVersion:"batch/v1", ResourceVersion:"478", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: ingress-nginx-admission-patch-87hhd
	I0304 11:57:21.723543       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-create", UID:"86095fb8-8eac-4057-b2b9-30eaab5060b5", APIVersion:"batch/v1", ResourceVersion:"480", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
	I0304 11:57:22.806738       1 event.go:278] Event(v1.ObjectReference{Kind:"Job", Namespace:"ingress-nginx", Name:"ingress-nginx-admission-patch", UID:"da2e1213-c968-4010-8829-a1f1b6b98448", APIVersion:"batch/v1", ResourceVersion:"489", FieldPath:""}): type: 'Normal' reason: 'Completed' Job completed
	I0304 11:59:58.758333       1 event.go:278] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"default", Name:"hello-world-app", UID:"f786300f-19d4-4107-bf17-9f508c50ea83", APIVersion:"apps/v1", ResourceVersion:"705", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set hello-world-app-5f5d8b66bb to 1
	I0304 11:59:58.763429       1 event.go:278] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"default", Name:"hello-world-app-5f5d8b66bb", UID:"0942933e-b623-4398-b0b6-9d0aa1dd333f", APIVersion:"apps/v1", ResourceVersion:"706", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: hello-world-app-5f5d8b66bb-rscls
	
	
	==> kube-proxy [83abda6eed044f07d149d5214e1dd7d92915a69c81323da4c422269cac745368] <==
	W0304 11:56:52.102258       1 server_others.go:559] Unknown proxy mode "", assuming iptables proxy
	I0304 11:56:52.109947       1 node.go:136] Successfully retrieved node IP: 192.168.49.2
	I0304 11:56:52.109992       1 server_others.go:186] Using iptables Proxier.
	I0304 11:56:52.110354       1 server.go:583] Version: v1.18.20
	I0304 11:56:52.110928       1 config.go:133] Starting endpoints config controller
	I0304 11:56:52.110955       1 shared_informer.go:223] Waiting for caches to sync for endpoints config
	I0304 11:56:52.111054       1 config.go:315] Starting service config controller
	I0304 11:56:52.111076       1 shared_informer.go:223] Waiting for caches to sync for service config
	I0304 11:56:52.211104       1 shared_informer.go:230] Caches are synced for endpoints config 
	I0304 11:56:52.211322       1 shared_informer.go:230] Caches are synced for service config 
	
	
	==> kube-scheduler [71a78dc492a1b25d58d9e239c837579713cc4f43fc3d2a3768c3819c13623d1d] <==
	W0304 11:56:33.219242       1 authentication.go:298] Continuing without authentication configuration. This may treat all requests as anonymous.
	W0304 11:56:33.219295       1 authentication.go:299] To require authentication configuration lookup to succeed, set --authentication-tolerate-lookup-failure=false
	I0304 11:56:33.306703       1 registry.go:150] Registering EvenPodsSpread predicate and priority function
	I0304 11:56:33.306737       1 registry.go:150] Registering EvenPodsSpread predicate and priority function
	I0304 11:56:33.308677       1 configmap_cafile_content.go:202] Starting client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0304 11:56:33.308712       1 shared_informer.go:223] Waiting for caches to sync for client-ca::kube-system::extension-apiserver-authentication::client-ca-file
	I0304 11:56:33.309137       1 secure_serving.go:178] Serving securely on 127.0.0.1:10259
	I0304 11:56:33.309265       1 tlsconfig.go:240] Starting DynamicServingCertificateController
	E0304 11:56:33.311169       1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0304 11:56:33.311233       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope
	E0304 11:56:33.311458       1 reflector.go:178] k8s.io/kubernetes/cmd/kube-scheduler/app/server.go:233: Failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope
	E0304 11:56:33.311512       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope
	E0304 11:56:33.311616       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0304 11:56:33.311723       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope
	E0304 11:56:33.311746       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope
	E0304 11:56:33.311842       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	E0304 11:56:33.311966       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope
	E0304 11:56:33.311973       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope
	E0304 11:56:33.312072       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope
	E0304 11:56:33.312105       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope
	E0304 11:56:34.147006       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope
	E0304 11:56:34.155707       1 reflector.go:178] k8s.io/apiserver/pkg/server/dynamiccertificates/configmap_cafile_content.go:206: Failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"
	E0304 11:56:34.186022       1 reflector.go:178] k8s.io/client-go/informers/factory.go:135: Failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope
	I0304 11:56:37.208922       1 shared_informer.go:230] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file 
	E0304 11:56:51.820239       1 factory.go:503] pod: kube-system/coredns-66bff467f8-lwk88 is already present in unschedulable queue
	
	
	==> kubelet <==
	Mar 04 11:59:39 ingress-addon-legacy-577846 kubelet[1870]: E0304 11:59:39.505061    1870 kuberuntime_manager.go:818] container start failed: ImageInspectError: Failed to inspect image "cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab": rpc error: code = Unknown desc = short-name "cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab" did not resolve to an alias and no unqualified-search registries are defined in "/etc/containers/registries.conf"
	Mar 04 11:59:39 ingress-addon-legacy-577846 kubelet[1870]: E0304 11:59:39.505097    1870 pod_workers.go:191] Error syncing pod 460dbd65-f6c4-41e3-874a-d725fe82e5b5 ("kube-ingress-dns-minikube_kube-system(460dbd65-f6c4-41e3-874a-d725fe82e5b5)"), skipping: failed to "StartContainer" for "minikube-ingress-dns" with ImageInspectError: "Failed to inspect image \"cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab\": rpc error: code = Unknown desc = short-name \"cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab\" did not resolve to an alias and no unqualified-search registries are defined in \"/etc/containers/registries.conf\""
	Mar 04 11:59:50 ingress-addon-legacy-577846 kubelet[1870]: E0304 11:59:50.504973    1870 remote_image.go:87] ImageStatus "cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab" from image service failed: rpc error: code = Unknown desc = short-name "cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab" did not resolve to an alias and no unqualified-search registries are defined in "/etc/containers/registries.conf"
	Mar 04 11:59:50 ingress-addon-legacy-577846 kubelet[1870]: E0304 11:59:50.505034    1870 kuberuntime_image.go:85] ImageStatus for image {"cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab"} failed: rpc error: code = Unknown desc = short-name "cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab" did not resolve to an alias and no unqualified-search registries are defined in "/etc/containers/registries.conf"
	Mar 04 11:59:50 ingress-addon-legacy-577846 kubelet[1870]: E0304 11:59:50.505096    1870 kuberuntime_manager.go:818] container start failed: ImageInspectError: Failed to inspect image "cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab": rpc error: code = Unknown desc = short-name "cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab" did not resolve to an alias and no unqualified-search registries are defined in "/etc/containers/registries.conf"
	Mar 04 11:59:50 ingress-addon-legacy-577846 kubelet[1870]: E0304 11:59:50.505135    1870 pod_workers.go:191] Error syncing pod 460dbd65-f6c4-41e3-874a-d725fe82e5b5 ("kube-ingress-dns-minikube_kube-system(460dbd65-f6c4-41e3-874a-d725fe82e5b5)"), skipping: failed to "StartContainer" for "minikube-ingress-dns" with ImageInspectError: "Failed to inspect image \"cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab\": rpc error: code = Unknown desc = short-name \"cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab\" did not resolve to an alias and no unqualified-search registries are defined in \"/etc/containers/registries.conf\""
	Mar 04 11:59:58 ingress-addon-legacy-577846 kubelet[1870]: I0304 11:59:58.768056    1870 topology_manager.go:235] [topologymanager] Topology Admit Handler
	Mar 04 11:59:59 ingress-addon-legacy-577846 kubelet[1870]: I0304 11:59:59.002441    1870 reconciler.go:224] operationExecutor.VerifyControllerAttachedVolume started for volume "default-token-tcp42" (UniqueName: "kubernetes.io/secret/ae837043-db1b-4f8f-b406-aa6bb25e2c0a-default-token-tcp42") pod "hello-world-app-5f5d8b66bb-rscls" (UID: "ae837043-db1b-4f8f-b406-aa6bb25e2c0a")
	Mar 04 11:59:59 ingress-addon-legacy-577846 kubelet[1870]: W0304 11:59:59.395624    1870 manager.go:1131] Failed to process watch event {EventType:0 Name:/docker/8201143f38bf371b37f6e8b719bc7ff803055b4ae60fbf06fbdb1f755cede4ae/crio-a527db9ce8d9529b0418d9f981db47b443a272448e7b0bf58680d9d5da71e461 WatchSource:0}: Error finding container a527db9ce8d9529b0418d9f981db47b443a272448e7b0bf58680d9d5da71e461: Status 404 returned error &{%!!(MISSING)s(*http.body=&{0xc00137cec0 <nil> <nil> false false {0 0} false false false <nil>}) {%!!(MISSING)s(int32=0) %!!(MISSING)s(uint32=0)} %!!(MISSING)s(bool=false) <nil> %!!(MISSING)s(func(error) error=0x750800) %!!(MISSING)s(func() error=0x750790)}
	Mar 04 12:00:03 ingress-addon-legacy-577846 kubelet[1870]: E0304 12:00:03.505123    1870 remote_image.go:87] ImageStatus "cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab" from image service failed: rpc error: code = Unknown desc = short-name "cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab" did not resolve to an alias and no unqualified-search registries are defined in "/etc/containers/registries.conf"
	Mar 04 12:00:03 ingress-addon-legacy-577846 kubelet[1870]: E0304 12:00:03.505192    1870 kuberuntime_image.go:85] ImageStatus for image {"cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab"} failed: rpc error: code = Unknown desc = short-name "cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab" did not resolve to an alias and no unqualified-search registries are defined in "/etc/containers/registries.conf"
	Mar 04 12:00:03 ingress-addon-legacy-577846 kubelet[1870]: E0304 12:00:03.505256    1870 kuberuntime_manager.go:818] container start failed: ImageInspectError: Failed to inspect image "cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab": rpc error: code = Unknown desc = short-name "cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab" did not resolve to an alias and no unqualified-search registries are defined in "/etc/containers/registries.conf"
	Mar 04 12:00:03 ingress-addon-legacy-577846 kubelet[1870]: E0304 12:00:03.505286    1870 pod_workers.go:191] Error syncing pod 460dbd65-f6c4-41e3-874a-d725fe82e5b5 ("kube-ingress-dns-minikube_kube-system(460dbd65-f6c4-41e3-874a-d725fe82e5b5)"), skipping: failed to "StartContainer" for "minikube-ingress-dns" with ImageInspectError: "Failed to inspect image \"cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab\": rpc error: code = Unknown desc = short-name \"cryptexlabs/minikube-ingress-dns:0.3.0@sha256:e252d2a4c704027342b303cc563e95d2e71d2a0f1404f55d676390e28d5093ab\" did not resolve to an alias and no unqualified-search registries are defined in \"/etc/containers/registries.conf\""
	Mar 04 12:00:14 ingress-addon-legacy-577846 kubelet[1870]: I0304 12:00:14.539406    1870 reconciler.go:196] operationExecutor.UnmountVolume started for volume "minikube-ingress-dns-token-nncnw" (UniqueName: "kubernetes.io/secret/460dbd65-f6c4-41e3-874a-d725fe82e5b5-minikube-ingress-dns-token-nncnw") pod "460dbd65-f6c4-41e3-874a-d725fe82e5b5" (UID: "460dbd65-f6c4-41e3-874a-d725fe82e5b5")
	Mar 04 12:00:14 ingress-addon-legacy-577846 kubelet[1870]: I0304 12:00:14.541388    1870 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/460dbd65-f6c4-41e3-874a-d725fe82e5b5-minikube-ingress-dns-token-nncnw" (OuterVolumeSpecName: "minikube-ingress-dns-token-nncnw") pod "460dbd65-f6c4-41e3-874a-d725fe82e5b5" (UID: "460dbd65-f6c4-41e3-874a-d725fe82e5b5"). InnerVolumeSpecName "minikube-ingress-dns-token-nncnw". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Mar 04 12:00:14 ingress-addon-legacy-577846 kubelet[1870]: I0304 12:00:14.639736    1870 reconciler.go:319] Volume detached for volume "minikube-ingress-dns-token-nncnw" (UniqueName: "kubernetes.io/secret/460dbd65-f6c4-41e3-874a-d725fe82e5b5-minikube-ingress-dns-token-nncnw") on node "ingress-addon-legacy-577846" DevicePath ""
	Mar 04 12:00:15 ingress-addon-legacy-577846 kubelet[1870]: E0304 12:00:15.740327    1870 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-8pflk.17b98df4b69996df", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-8pflk", UID:"b8cab2e1-496b-443b-959f-ed7f51bb6668", APIVersion:"v1", ResourceVersion:"473", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-577846"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc1718bd3ec0a40df, ext:219738380052, loc:(*time.Location)(0x701e5a0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc1718bd3ec0a40df, ext:219738380052, loc:(*time.Location)(0x701e5a0)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-8pflk.17b98df4b69996df" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Mar 04 12:00:15 ingress-addon-legacy-577846 kubelet[1870]: E0304 12:00:15.743343    1870 event.go:260] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-controller-7fcf777cb7-8pflk.17b98df4b69996df", GenerateName:"", Namespace:"ingress-nginx", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, InvolvedObject:v1.ObjectReference{Kind:"Pod", Namespace:"ingress-nginx", Name:"ingress-nginx-controller-7fcf777cb7-8pflk", UID:"b8cab2e1-496b-443b-959f-ed7f51bb6668", APIVersion:"v1", ResourceVersion:"473", FieldPath:"spec.containers{controller}"}, Reason:"Killing", Message:"Stoppi
ng container controller", Source:v1.EventSource{Component:"kubelet", Host:"ingress-addon-legacy-577846"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xc1718bd3ec0a40df, ext:219738380052, loc:(*time.Location)(0x701e5a0)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xc1718bd3ec14de5f, ext:219739075734, loc:(*time.Location)(0x701e5a0)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'events "ingress-nginx-controller-7fcf777cb7-8pflk.17b98df4b69996df" is forbidden: unable to create new content in namespace ingress-nginx because it is being terminated' (will not retry!)
	Mar 04 12:00:17 ingress-addon-legacy-577846 kubelet[1870]: W0304 12:00:17.987544    1870 pod_container_deletor.go:77] Container "c9d787c7d02af3cc0f68d3cc3f573063d8ec53af52ec37c8ddf77551101ab595" not found in pod's containers
	Mar 04 12:00:18 ingress-addon-legacy-577846 kubelet[1870]: I0304 12:00:18.548261    1870 reconciler.go:196] operationExecutor.UnmountVolume started for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/b8cab2e1-496b-443b-959f-ed7f51bb6668-webhook-cert") pod "b8cab2e1-496b-443b-959f-ed7f51bb6668" (UID: "b8cab2e1-496b-443b-959f-ed7f51bb6668")
	Mar 04 12:00:18 ingress-addon-legacy-577846 kubelet[1870]: I0304 12:00:18.548308    1870 reconciler.go:196] operationExecutor.UnmountVolume started for volume "ingress-nginx-token-5djpl" (UniqueName: "kubernetes.io/secret/b8cab2e1-496b-443b-959f-ed7f51bb6668-ingress-nginx-token-5djpl") pod "b8cab2e1-496b-443b-959f-ed7f51bb6668" (UID: "b8cab2e1-496b-443b-959f-ed7f51bb6668")
	Mar 04 12:00:18 ingress-addon-legacy-577846 kubelet[1870]: I0304 12:00:18.550154    1870 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8cab2e1-496b-443b-959f-ed7f51bb6668-ingress-nginx-token-5djpl" (OuterVolumeSpecName: "ingress-nginx-token-5djpl") pod "b8cab2e1-496b-443b-959f-ed7f51bb6668" (UID: "b8cab2e1-496b-443b-959f-ed7f51bb6668"). InnerVolumeSpecName "ingress-nginx-token-5djpl". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Mar 04 12:00:18 ingress-addon-legacy-577846 kubelet[1870]: I0304 12:00:18.550320    1870 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8cab2e1-496b-443b-959f-ed7f51bb6668-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b8cab2e1-496b-443b-959f-ed7f51bb6668" (UID: "b8cab2e1-496b-443b-959f-ed7f51bb6668"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGidValue ""
	Mar 04 12:00:18 ingress-addon-legacy-577846 kubelet[1870]: I0304 12:00:18.648538    1870 reconciler.go:319] Volume detached for volume "ingress-nginx-token-5djpl" (UniqueName: "kubernetes.io/secret/b8cab2e1-496b-443b-959f-ed7f51bb6668-ingress-nginx-token-5djpl") on node "ingress-addon-legacy-577846" DevicePath ""
	Mar 04 12:00:18 ingress-addon-legacy-577846 kubelet[1870]: I0304 12:00:18.648572    1870 reconciler.go:319] Volume detached for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/b8cab2e1-496b-443b-959f-ed7f51bb6668-webhook-cert") on node "ingress-addon-legacy-577846" DevicePath ""
	
	
	==> storage-provisioner [a4a3239946884097208afd04116b3658d2085b1e17e1dbdfae8f97943fd45a86] <==
	I0304 11:57:11.723514       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...
	I0304 11:57:11.731558       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!
	I0304 11:57:11.731605       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...
	I0304 11:57:11.736920       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath
	I0304 11:57:11.737065       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-577846_5d82756b-1218-4a60-8a8b-44d234d1f3d8!
	I0304 11:57:11.737046       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"28d561c4-961b-44aa-a08b-c724e4b140ee", APIVersion:"v1", ResourceVersion:"419", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' ingress-addon-legacy-577846_5d82756b-1218-4a60-8a8b-44d234d1f3d8 became leader
	I0304 11:57:11.837373       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_ingress-addon-legacy-577846_5d82756b-1218-4a60-8a8b-44d234d1f3d8!
	

                                                
                                                
-- /stdout --
helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ingress-addon-legacy-577846 -n ingress-addon-legacy-577846
helpers_test.go:261: (dbg) Run:  kubectl --context ingress-addon-legacy-577846 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running
helpers_test.go:285: <<< TestIngressAddonLegacy/serial/ValidateIngressAddons FAILED: end of post-mortem logs <<<
helpers_test.go:286: ---------------------/post-mortem---------------------------------
--- FAIL: TestIngressAddonLegacy/serial/ValidateIngressAddons (175.42s)

                                                
                                    

Test pass (290/320)

Order passed test Duration
3 TestDownloadOnly/v1.16.0/json-events 7.05
4 TestDownloadOnly/v1.16.0/preload-exists 0
8 TestDownloadOnly/v1.16.0/LogsDuration 0.07
9 TestDownloadOnly/v1.16.0/DeleteAll 0.2
10 TestDownloadOnly/v1.16.0/DeleteAlwaysSucceeds 0.13
12 TestDownloadOnly/v1.28.4/json-events 4.7
13 TestDownloadOnly/v1.28.4/preload-exists 0
17 TestDownloadOnly/v1.28.4/LogsDuration 0.07
18 TestDownloadOnly/v1.28.4/DeleteAll 0.2
19 TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds 0.13
21 TestDownloadOnly/v1.29.0-rc.2/json-events 6.85
22 TestDownloadOnly/v1.29.0-rc.2/preload-exists 0
26 TestDownloadOnly/v1.29.0-rc.2/LogsDuration 0.08
27 TestDownloadOnly/v1.29.0-rc.2/DeleteAll 0.2
28 TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds 0.13
29 TestDownloadOnlyKic 1.23
30 TestBinaryMirror 0.74
31 TestOffline 56.49
34 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.07
35 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.07
36 TestAddons/Setup 128.08
38 TestAddons/parallel/Registry 13.32
40 TestAddons/parallel/InspektorGadget 11.02
41 TestAddons/parallel/MetricsServer 5.77
42 TestAddons/parallel/HelmTiller 9.26
44 TestAddons/parallel/CSI 48.15
46 TestAddons/parallel/CloudSpanner 5.57
47 TestAddons/parallel/LocalPath 52.09
48 TestAddons/parallel/NvidiaDevicePlugin 6.62
49 TestAddons/parallel/Yakd 6.01
52 TestAddons/serial/GCPAuth/Namespaces 0.12
53 TestAddons/StoppedEnableDisable 12.08
54 TestCertOptions 27.22
55 TestCertExpiration 224.3
57 TestForceSystemdFlag 34.67
58 TestForceSystemdEnv 32.19
60 TestKVMDriverInstallOrUpdate 1.2
64 TestErrorSpam/setup 23.67
65 TestErrorSpam/start 0.61
66 TestErrorSpam/status 0.87
67 TestErrorSpam/pause 1.53
68 TestErrorSpam/unpause 1.5
69 TestErrorSpam/stop 1.37
72 TestFunctional/serial/CopySyncFile 0
73 TestFunctional/serial/StartWithProxy 39.71
74 TestFunctional/serial/AuditLog 0
75 TestFunctional/serial/SoftStart 40.03
76 TestFunctional/serial/KubeContext 0.04
77 TestFunctional/serial/KubectlGetPods 0.07
80 TestFunctional/serial/CacheCmd/cache/add_remote 2.65
81 TestFunctional/serial/CacheCmd/cache/add_local 0.75
82 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.06
83 TestFunctional/serial/CacheCmd/cache/list 0.06
84 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.27
85 TestFunctional/serial/CacheCmd/cache/cache_reload 1.57
86 TestFunctional/serial/CacheCmd/cache/delete 0.12
87 TestFunctional/serial/MinikubeKubectlCmd 0.12
88 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.11
89 TestFunctional/serial/ExtraConfig 33.39
90 TestFunctional/serial/ComponentHealth 0.07
91 TestFunctional/serial/LogsCmd 1.3
92 TestFunctional/serial/LogsFileCmd 1.36
93 TestFunctional/serial/InvalidService 3.79
95 TestFunctional/parallel/ConfigCmd 0.5
96 TestFunctional/parallel/DashboardCmd 10.11
97 TestFunctional/parallel/DryRun 0.39
98 TestFunctional/parallel/InternationalLanguage 0.18
99 TestFunctional/parallel/StatusCmd 0.92
103 TestFunctional/parallel/ServiceCmdConnect 11.51
104 TestFunctional/parallel/AddonsCmd 0.17
105 TestFunctional/parallel/PersistentVolumeClaim 35.91
107 TestFunctional/parallel/SSHCmd 0.69
108 TestFunctional/parallel/CpCmd 1.82
109 TestFunctional/parallel/MySQL 20.7
110 TestFunctional/parallel/FileSync 0.27
111 TestFunctional/parallel/CertSync 1.59
115 TestFunctional/parallel/NodeLabels 0.14
117 TestFunctional/parallel/NonActiveRuntimeDisabled 0.54
119 TestFunctional/parallel/License 0.2
121 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.5
122 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0
124 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 9.23
125 TestFunctional/parallel/ServiceCmd/DeployApp 10.21
126 TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP 0.09
127 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 0
131 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.11
132 TestFunctional/parallel/ProfileCmd/profile_not_create 0.37
133 TestFunctional/parallel/ProfileCmd/profile_list 0.36
134 TestFunctional/parallel/ProfileCmd/profile_json_output 0.35
135 TestFunctional/parallel/MountCmd/any-port 6.91
136 TestFunctional/parallel/ServiceCmd/List 0.51
137 TestFunctional/parallel/ServiceCmd/JSONOutput 0.5
138 TestFunctional/parallel/ServiceCmd/HTTPS 0.35
139 TestFunctional/parallel/ServiceCmd/Format 0.36
140 TestFunctional/parallel/ServiceCmd/URL 0.41
141 TestFunctional/parallel/UpdateContextCmd/no_changes 0.26
142 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.33
143 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.45
144 TestFunctional/parallel/Version/short 0.13
145 TestFunctional/parallel/Version/components 0.75
146 TestFunctional/parallel/MountCmd/specific-port 1.72
147 TestFunctional/parallel/MountCmd/VerifyCleanup 1.76
148 TestFunctional/parallel/ImageCommands/ImageListShort 0.24
149 TestFunctional/parallel/ImageCommands/ImageListTable 0.23
150 TestFunctional/parallel/ImageCommands/ImageListJson 0.27
151 TestFunctional/parallel/ImageCommands/ImageListYaml 0.25
152 TestFunctional/parallel/ImageCommands/ImageBuild 1.86
153 TestFunctional/parallel/ImageCommands/Setup 1.04
154 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 8.33
155 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 4.27
156 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 4.61
157 TestFunctional/parallel/ImageCommands/ImageSaveToFile 0.74
158 TestFunctional/parallel/ImageCommands/ImageRemove 0.45
159 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 1.11
160 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.78
161 TestFunctional/delete_addon-resizer_images 0.07
162 TestFunctional/delete_my-image_image 0.02
163 TestFunctional/delete_minikube_cached_images 0.02
167 TestIngressAddonLegacy/StartLegacyK8sCluster 75.73
169 TestIngressAddonLegacy/serial/ValidateIngressAddonActivation 9.21
170 TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation 0.56
174 TestJSONOutput/start/Command 37.54
175 TestJSONOutput/start/Audit 0
177 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
178 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
180 TestJSONOutput/pause/Command 0.64
181 TestJSONOutput/pause/Audit 0
183 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
184 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
186 TestJSONOutput/unpause/Command 0.56
187 TestJSONOutput/unpause/Audit 0
189 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
190 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
192 TestJSONOutput/stop/Command 5.75
193 TestJSONOutput/stop/Audit 0
195 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
196 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
197 TestErrorJSONOutput 0.22
199 TestKicCustomNetwork/create_custom_network 27.93
200 TestKicCustomNetwork/use_default_bridge_network 23.32
201 TestKicExistingNetwork 24.12
202 TestKicCustomSubnet 27.15
203 TestKicStaticIP 24.22
204 TestMainNoArgs 0.06
205 TestMinikubeProfile 51.16
208 TestMountStart/serial/StartWithMountFirst 4.97
209 TestMountStart/serial/VerifyMountFirst 0.25
210 TestMountStart/serial/StartWithMountSecond 4.84
211 TestMountStart/serial/VerifyMountSecond 0.24
212 TestMountStart/serial/DeleteFirst 1.56
213 TestMountStart/serial/VerifyMountPostDelete 0.25
214 TestMountStart/serial/Stop 1.18
215 TestMountStart/serial/RestartStopped 6.67
216 TestMountStart/serial/VerifyMountPostStop 0.24
219 TestMultiNode/serial/FreshStart2Nodes 95.16
220 TestMultiNode/serial/DeployApp2Nodes 3.01
221 TestMultiNode/serial/PingHostFrom2Pods 0.75
222 TestMultiNode/serial/AddNode 19.85
223 TestMultiNode/serial/MultiNodeLabels 0.06
224 TestMultiNode/serial/ProfileList 0.27
225 TestMultiNode/serial/CopyFile 8.76
226 TestMultiNode/serial/StopNode 2.05
227 TestMultiNode/serial/StartAfterStop 10.48
228 TestMultiNode/serial/RestartKeepsNodes 115.81
229 TestMultiNode/serial/DeleteNode 4.65
230 TestMultiNode/serial/StopMultiNode 23.67
231 TestMultiNode/serial/RestartMultiNode 77.88
232 TestMultiNode/serial/ValidateNameConflict 22.92
237 TestPreload 114.25
239 TestScheduledStopUnix 97.2
242 TestInsufficientStorage 12.96
243 TestRunningBinaryUpgrade 99.12
245 TestKubernetesUpgrade 352.42
246 TestMissingContainerUpgrade 100.06
247 TestStoppedBinaryUpgrade/Setup 0.47
249 TestNoKubernetes/serial/StartNoK8sWithVersion 0.09
250 TestNoKubernetes/serial/StartWithK8s 39.73
251 TestStoppedBinaryUpgrade/Upgrade 88.04
252 TestNoKubernetes/serial/StartWithStopK8s 6.05
253 TestNoKubernetes/serial/Start 5.06
254 TestNoKubernetes/serial/VerifyK8sNotRunning 0.28
255 TestNoKubernetes/serial/ProfileList 11.54
264 TestPause/serial/Start 45.27
265 TestNoKubernetes/serial/Stop 1.29
266 TestNoKubernetes/serial/StartNoArgs 14.31
267 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.32
268 TestStoppedBinaryUpgrade/MinikubeLogs 0.88
269 TestPause/serial/SecondStartNoReconfiguration 28.27
270 TestPause/serial/Pause 0.79
271 TestPause/serial/VerifyStatus 0.31
272 TestPause/serial/Unpause 0.61
273 TestPause/serial/PauseAgain 0.75
274 TestPause/serial/DeletePaused 2.67
275 TestPause/serial/VerifyDeletedResources 0.47
283 TestNetworkPlugins/group/false 3.95
288 TestStartStop/group/old-k8s-version/serial/FirstStart 129.55
290 TestStartStop/group/no-preload/serial/FirstStart 55.2
291 TestStartStop/group/no-preload/serial/DeployApp 7.24
292 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 0.77
293 TestStartStop/group/no-preload/serial/Stop 11.82
294 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.19
295 TestStartStop/group/no-preload/serial/SecondStart 333.87
296 TestStartStop/group/old-k8s-version/serial/DeployApp 8.38
297 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 0.68
298 TestStartStop/group/old-k8s-version/serial/Stop 11.84
299 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.18
300 TestStartStop/group/old-k8s-version/serial/SecondStart 431.8
302 TestStartStop/group/embed-certs/serial/FirstStart 39.43
303 TestStartStop/group/embed-certs/serial/DeployApp 8.25
304 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 0.86
305 TestStartStop/group/embed-certs/serial/Stop 11.8
306 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.21
307 TestStartStop/group/embed-certs/serial/SecondStart 338.61
309 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 37.72
310 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 8.24
311 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 0.86
312 TestStartStop/group/default-k8s-diff-port/serial/Stop 11.83
313 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.18
314 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 334.85
315 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 11.01
316 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 5.07
317 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.22
318 TestStartStop/group/no-preload/serial/Pause 2.58
320 TestStartStop/group/newest-cni/serial/FirstStart 36.41
321 TestStartStop/group/newest-cni/serial/DeployApp 0
322 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 1.13
323 TestStartStop/group/newest-cni/serial/Stop 1.24
324 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.2
325 TestStartStop/group/newest-cni/serial/SecondStart 26.07
326 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
327 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
328 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.22
329 TestStartStop/group/newest-cni/serial/Pause 2.45
330 TestNetworkPlugins/group/auto/Start 51.3
331 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 11.01
332 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 5.08
333 TestNetworkPlugins/group/auto/KubeletFlags 0.25
334 TestNetworkPlugins/group/auto/NetCatPod 9.18
335 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.23
336 TestStartStop/group/embed-certs/serial/Pause 2.61
337 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 6.01
338 TestNetworkPlugins/group/kindnet/Start 49.72
339 TestNetworkPlugins/group/auto/DNS 0.14
340 TestNetworkPlugins/group/auto/Localhost 0.12
341 TestNetworkPlugins/group/auto/HairPin 0.11
342 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 5.08
343 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.26
344 TestStartStop/group/old-k8s-version/serial/Pause 3
345 TestNetworkPlugins/group/calico/Start 63.92
346 TestNetworkPlugins/group/custom-flannel/Start 56.66
347 TestNetworkPlugins/group/kindnet/ControllerPod 6.01
348 TestNetworkPlugins/group/kindnet/KubeletFlags 0.31
349 TestNetworkPlugins/group/kindnet/NetCatPod 11.24
350 TestNetworkPlugins/group/kindnet/DNS 0.13
351 TestNetworkPlugins/group/kindnet/Localhost 0.11
352 TestNetworkPlugins/group/kindnet/HairPin 0.1
353 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 13.01
354 TestNetworkPlugins/group/calico/ControllerPod 6.01
355 TestNetworkPlugins/group/custom-flannel/KubeletFlags 0.32
356 TestNetworkPlugins/group/custom-flannel/NetCatPod 10.23
357 TestNetworkPlugins/group/calico/KubeletFlags 0.3
358 TestNetworkPlugins/group/calico/NetCatPod 11.27
359 TestNetworkPlugins/group/custom-flannel/DNS 0.13
360 TestNetworkPlugins/group/custom-flannel/Localhost 0.11
361 TestNetworkPlugins/group/custom-flannel/HairPin 0.11
362 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 5.08
363 TestNetworkPlugins/group/enable-default-cni/Start 69.04
364 TestNetworkPlugins/group/calico/DNS 0.13
365 TestNetworkPlugins/group/calico/Localhost 0.13
366 TestNetworkPlugins/group/calico/HairPin 0.13
367 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.3
368 TestStartStop/group/default-k8s-diff-port/serial/Pause 3.28
369 TestNetworkPlugins/group/flannel/Start 58.61
370 TestNetworkPlugins/group/bridge/Start 68.15
371 TestNetworkPlugins/group/enable-default-cni/KubeletFlags 0.26
372 TestNetworkPlugins/group/enable-default-cni/NetCatPod 9.17
373 TestNetworkPlugins/group/flannel/ControllerPod 6.01
374 TestNetworkPlugins/group/flannel/KubeletFlags 0.26
375 TestNetworkPlugins/group/flannel/NetCatPod 9.2
376 TestNetworkPlugins/group/enable-default-cni/DNS 0.14
377 TestNetworkPlugins/group/enable-default-cni/Localhost 0.12
378 TestNetworkPlugins/group/enable-default-cni/HairPin 0.12
379 TestNetworkPlugins/group/flannel/DNS 0.13
380 TestNetworkPlugins/group/flannel/Localhost 0.11
381 TestNetworkPlugins/group/flannel/HairPin 0.12
382 TestNetworkPlugins/group/bridge/KubeletFlags 0.28
383 TestNetworkPlugins/group/bridge/NetCatPod 10.18
384 TestNetworkPlugins/group/bridge/DNS 0.14
385 TestNetworkPlugins/group/bridge/Localhost 0.1
386 TestNetworkPlugins/group/bridge/HairPin 0.12
x
+
TestDownloadOnly/v1.16.0/json-events (7.05s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-amd64 start -o=json --download-only -p download-only-451004 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=crio --driver=docker  --container-runtime=crio
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-451004 --force --alsologtostderr --kubernetes-version=v1.16.0 --container-runtime=crio --driver=docker  --container-runtime=crio: (7.04692762s)
--- PASS: TestDownloadOnly/v1.16.0/json-events (7.05s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/preload-exists
--- PASS: TestDownloadOnly/v1.16.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-amd64 logs -p download-only-451004
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-451004: exit status 85 (72.849113ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-451004 | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC |          |
	|         | -p download-only-451004        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |          |
	|         | --container-runtime=crio       |                      |         |         |                     |          |
	|         | --driver=docker                |                      |         |         |                     |          |
	|         | --container-runtime=crio       |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/04 11:46:44
	Running on machine: ubuntu-20-agent-13
	Binary: Built with gc go1.22.0 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0304 11:46:44.726850  403661 out.go:291] Setting OutFile to fd 1 ...
	I0304 11:46:44.727108  403661 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 11:46:44.727118  403661 out.go:304] Setting ErrFile to fd 2...
	I0304 11:46:44.727123  403661 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 11:46:44.727328  403661 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18284-396872/.minikube/bin
	W0304 11:46:44.727442  403661 root.go:314] Error reading config file at /home/jenkins/minikube-integration/18284-396872/.minikube/config/config.json: open /home/jenkins/minikube-integration/18284-396872/.minikube/config/config.json: no such file or directory
	I0304 11:46:44.728042  403661 out.go:298] Setting JSON to true
	I0304 11:46:44.729048  403661 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":41354,"bootTime":1709511451,"procs":179,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1052-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0304 11:46:44.729110  403661 start.go:139] virtualization: kvm guest
	I0304 11:46:44.731520  403661 out.go:97] [download-only-451004] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
	I0304 11:46:44.732846  403661 out.go:169] MINIKUBE_LOCATION=18284
	W0304 11:46:44.731649  403661 preload.go:295] Failed to list preload files: open /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball: no such file or directory
	I0304 11:46:44.731723  403661 notify.go:220] Checking for updates...
	I0304 11:46:44.735402  403661 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 11:46:44.737012  403661 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/18284-396872/kubeconfig
	I0304 11:46:44.738431  403661 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/18284-396872/.minikube
	I0304 11:46:44.739896  403661 out.go:169] MINIKUBE_BIN=out/minikube-linux-amd64
	W0304 11:46:44.742408  403661 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0304 11:46:44.742734  403661 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 11:46:44.764485  403661 docker.go:122] docker version: linux-25.0.3:Docker Engine - Community
	I0304 11:46:44.764620  403661 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0304 11:46:45.089789  403661 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:57 SystemTime:2024-03-04 11:46:45.08139172 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1052-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86_
64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-13 Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErr
ors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.6] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0304 11:46:45.089896  403661 docker.go:295] overlay module found
	I0304 11:46:45.091410  403661 out.go:97] Using the docker driver based on user configuration
	I0304 11:46:45.091433  403661 start.go:299] selected driver: docker
	I0304 11:46:45.091439  403661 start.go:903] validating driver "docker" against <nil>
	I0304 11:46:45.091518  403661 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0304 11:46:45.145568  403661 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:29 OomKillDisable:true NGoroutines:57 SystemTime:2024-03-04 11:46:45.135490266 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1052-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-13 Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerEr
rors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.6] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0304 11:46:45.145780  403661 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I0304 11:46:45.146349  403661 start_flags.go:394] Using suggested 8000MB memory alloc based on sys=32089MB, container=32089MB
	I0304 11:46:45.146515  403661 start_flags.go:913] Wait components to verify : map[apiserver:true system_pods:true]
	I0304 11:46:45.148351  403661 out.go:169] Using Docker driver with root privileges
	I0304 11:46:45.149551  403661 cni.go:84] Creating CNI manager for ""
	I0304 11:46:45.149575  403661 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0304 11:46:45.149593  403661 start_flags.go:318] Found "CNI" CNI - setting NetworkPlugin=cni
	I0304 11:46:45.149606  403661 start_flags.go:323] config:
	{Name:download-only-451004 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.16.0 ClusterName:download-only-451004 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRu
ntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 11:46:45.151032  403661 out.go:97] Starting control plane node download-only-451004 in cluster download-only-451004
	I0304 11:46:45.151048  403661 cache.go:121] Beginning downloading kic base image for docker with crio
	I0304 11:46:45.152249  403661 out.go:97] Pulling base image v0.0.42-1708944392-18244 ...
	I0304 11:46:45.152273  403661 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime crio
	I0304 11:46:45.152425  403661 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon
	I0304 11:46:45.167058  403661 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 to local cache
	I0304 11:46:45.167287  403661 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local cache directory
	I0304 11:46:45.167375  403661 image.go:118] Writing gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 to local cache
	I0304 11:46:45.174889  403661 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4
	I0304 11:46:45.174931  403661 cache.go:56] Caching tarball of preloaded images
	I0304 11:46:45.175173  403661 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime crio
	I0304 11:46:45.176852  403661 out.go:97] Downloading Kubernetes v1.16.0 preload ...
	I0304 11:46:45.176870  403661 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4 ...
	I0304 11:46:45.203407  403661 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.16.0/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4?checksum=md5:432b600409d778ea7a21214e83948570 -> /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4
	I0304 11:46:48.228648  403661 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4 ...
	I0304 11:46:48.228739  403661 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.16.0-cri-o-overlay-amd64.tar.lz4 ...
	I0304 11:46:48.281045  403661 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 as a tarball
	I0304 11:46:49.072775  403661 cache.go:59] Finished verifying existence of preloaded tar for  v1.16.0 on crio
	I0304 11:46:49.073137  403661 profile.go:148] Saving config to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/download-only-451004/config.json ...
	I0304 11:46:49.073170  403661 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/download-only-451004/config.json: {Name:mkf4c267cf45b2e9c05e4a2f94f1a50479da68ce Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:46:49.073356  403661 preload.go:132] Checking if preload exists for k8s version v1.16.0 and runtime crio
	I0304 11:46:49.073566  403661 download.go:107] Downloading: https://dl.k8s.io/release/v1.16.0/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.16.0/bin/linux/amd64/kubectl.sha1 -> /home/jenkins/minikube-integration/18284-396872/.minikube/cache/linux/amd64/v1.16.0/kubectl
	
	
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-451004"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.16.0/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/DeleteAll (0.2s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-amd64 delete --all
--- PASS: TestDownloadOnly/v1.16.0/DeleteAll (0.20s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-amd64 delete -p download-only-451004
--- PASS: TestDownloadOnly/v1.16.0/DeleteAlwaysSucceeds (0.13s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/json-events (4.7s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-amd64 start -o=json --download-only -p download-only-239468 --force --alsologtostderr --kubernetes-version=v1.28.4 --container-runtime=crio --driver=docker  --container-runtime=crio
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-239468 --force --alsologtostderr --kubernetes-version=v1.28.4 --container-runtime=crio --driver=docker  --container-runtime=crio: (4.696975168s)
--- PASS: TestDownloadOnly/v1.28.4/json-events (4.70s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/preload-exists
--- PASS: TestDownloadOnly/v1.28.4/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/LogsDuration (0.07s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-amd64 logs -p download-only-239468
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-239468: exit status 85 (74.309845ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-451004 | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC |                     |
	|         | -p download-only-451004        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0   |                      |         |         |                     |                     |
	|         | --container-runtime=crio       |                      |         |         |                     |                     |
	|         | --driver=docker                |                      |         |         |                     |                     |
	|         | --container-runtime=crio       |                      |         |         |                     |                     |
	| delete  | --all                          | minikube             | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC | 04 Mar 24 11:46 UTC |
	| delete  | -p download-only-451004        | download-only-451004 | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC | 04 Mar 24 11:46 UTC |
	| start   | -o=json --download-only        | download-only-239468 | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC |                     |
	|         | -p download-only-239468        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.28.4   |                      |         |         |                     |                     |
	|         | --container-runtime=crio       |                      |         |         |                     |                     |
	|         | --driver=docker                |                      |         |         |                     |                     |
	|         | --container-runtime=crio       |                      |         |         |                     |                     |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/04 11:46:52
	Running on machine: ubuntu-20-agent-13
	Binary: Built with gc go1.22.0 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0304 11:46:52.185731  403959 out.go:291] Setting OutFile to fd 1 ...
	I0304 11:46:52.185827  403959 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 11:46:52.185832  403959 out.go:304] Setting ErrFile to fd 2...
	I0304 11:46:52.185836  403959 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 11:46:52.186007  403959 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18284-396872/.minikube/bin
	I0304 11:46:52.186667  403959 out.go:298] Setting JSON to true
	I0304 11:46:52.187522  403959 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":41361,"bootTime":1709511451,"procs":175,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1052-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0304 11:46:52.187587  403959 start.go:139] virtualization: kvm guest
	I0304 11:46:52.189749  403959 out.go:97] [download-only-239468] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
	I0304 11:46:52.191102  403959 out.go:169] MINIKUBE_LOCATION=18284
	I0304 11:46:52.189929  403959 notify.go:220] Checking for updates...
	I0304 11:46:52.193724  403959 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 11:46:52.195069  403959 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/18284-396872/kubeconfig
	I0304 11:46:52.196472  403959 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/18284-396872/.minikube
	I0304 11:46:52.197716  403959 out.go:169] MINIKUBE_BIN=out/minikube-linux-amd64
	W0304 11:46:52.200336  403959 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0304 11:46:52.200559  403959 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 11:46:52.221015  403959 docker.go:122] docker version: linux-25.0.3:Docker Engine - Community
	I0304 11:46:52.221121  403959 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0304 11:46:52.270703  403959 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:51 SystemTime:2024-03-04 11:46:52.26218092 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1052-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86_
64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-13 Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErr
ors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.6] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0304 11:46:52.270803  403959 docker.go:295] overlay module found
	I0304 11:46:52.272695  403959 out.go:97] Using the docker driver based on user configuration
	I0304 11:46:52.272731  403959 start.go:299] selected driver: docker
	I0304 11:46:52.272738  403959 start.go:903] validating driver "docker" against <nil>
	I0304 11:46:52.272826  403959 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0304 11:46:52.321923  403959 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:51 SystemTime:2024-03-04 11:46:52.313722089 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1052-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-13 Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerEr
rors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.6] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0304 11:46:52.322159  403959 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I0304 11:46:52.322832  403959 start_flags.go:394] Using suggested 8000MB memory alloc based on sys=32089MB, container=32089MB
	I0304 11:46:52.323024  403959 start_flags.go:913] Wait components to verify : map[apiserver:true system_pods:true]
	I0304 11:46:52.325042  403959 out.go:169] Using Docker driver with root privileges
	
	
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-239468"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.28.4/LogsDuration (0.07s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/DeleteAll (0.2s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-amd64 delete --all
--- PASS: TestDownloadOnly/v1.28.4/DeleteAll (0.20s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds (0.13s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-amd64 delete -p download-only-239468
--- PASS: TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds (0.13s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/json-events (6.85s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-linux-amd64 start -o=json --download-only -p download-only-675340 --force --alsologtostderr --kubernetes-version=v1.29.0-rc.2 --container-runtime=crio --driver=docker  --container-runtime=crio
aaa_download_only_test.go:81: (dbg) Done: out/minikube-linux-amd64 start -o=json --download-only -p download-only-675340 --force --alsologtostderr --kubernetes-version=v1.29.0-rc.2 --container-runtime=crio --driver=docker  --container-runtime=crio: (6.85383517s)
--- PASS: TestDownloadOnly/v1.29.0-rc.2/json-events (6.85s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/preload-exists
--- PASS: TestDownloadOnly/v1.29.0-rc.2/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/LogsDuration (0.08s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-linux-amd64 logs -p download-only-675340
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-linux-amd64 logs -p download-only-675340: exit status 85 (75.257221ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |               Args                |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only           | download-only-451004 | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC |                     |
	|         | -p download-only-451004           |                      |         |         |                     |                     |
	|         | --force --alsologtostderr         |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.16.0      |                      |         |         |                     |                     |
	|         | --container-runtime=crio          |                      |         |         |                     |                     |
	|         | --driver=docker                   |                      |         |         |                     |                     |
	|         | --container-runtime=crio          |                      |         |         |                     |                     |
	| delete  | --all                             | minikube             | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC | 04 Mar 24 11:46 UTC |
	| delete  | -p download-only-451004           | download-only-451004 | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC | 04 Mar 24 11:46 UTC |
	| start   | -o=json --download-only           | download-only-239468 | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC |                     |
	|         | -p download-only-239468           |                      |         |         |                     |                     |
	|         | --force --alsologtostderr         |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.28.4      |                      |         |         |                     |                     |
	|         | --container-runtime=crio          |                      |         |         |                     |                     |
	|         | --driver=docker                   |                      |         |         |                     |                     |
	|         | --container-runtime=crio          |                      |         |         |                     |                     |
	| delete  | --all                             | minikube             | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC | 04 Mar 24 11:46 UTC |
	| delete  | -p download-only-239468           | download-only-239468 | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC | 04 Mar 24 11:46 UTC |
	| start   | -o=json --download-only           | download-only-675340 | jenkins | v1.32.0 | 04 Mar 24 11:46 UTC |                     |
	|         | -p download-only-675340           |                      |         |         |                     |                     |
	|         | --force --alsologtostderr         |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.29.0-rc.2 |                      |         |         |                     |                     |
	|         | --container-runtime=crio          |                      |         |         |                     |                     |
	|         | --driver=docker                   |                      |         |         |                     |                     |
	|         | --container-runtime=crio          |                      |         |         |                     |                     |
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/04 11:46:57
	Running on machine: ubuntu-20-agent-13
	Binary: Built with gc go1.22.0 for linux/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0304 11:46:57.292810  404247 out.go:291] Setting OutFile to fd 1 ...
	I0304 11:46:57.292945  404247 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 11:46:57.292954  404247 out.go:304] Setting ErrFile to fd 2...
	I0304 11:46:57.292959  404247 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 11:46:57.293136  404247 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18284-396872/.minikube/bin
	I0304 11:46:57.293730  404247 out.go:298] Setting JSON to true
	I0304 11:46:57.294603  404247 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":41366,"bootTime":1709511451,"procs":175,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1052-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0304 11:46:57.294669  404247 start.go:139] virtualization: kvm guest
	I0304 11:46:57.297073  404247 out.go:97] [download-only-675340] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
	I0304 11:46:57.297242  404247 notify.go:220] Checking for updates...
	I0304 11:46:57.298638  404247 out.go:169] MINIKUBE_LOCATION=18284
	I0304 11:46:57.300121  404247 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 11:46:57.301360  404247 out.go:169] KUBECONFIG=/home/jenkins/minikube-integration/18284-396872/kubeconfig
	I0304 11:46:57.302571  404247 out.go:169] MINIKUBE_HOME=/home/jenkins/minikube-integration/18284-396872/.minikube
	I0304 11:46:57.303856  404247 out.go:169] MINIKUBE_BIN=out/minikube-linux-amd64
	W0304 11:46:57.306510  404247 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0304 11:46:57.306778  404247 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 11:46:57.326517  404247 docker.go:122] docker version: linux-25.0.3:Docker Engine - Community
	I0304 11:46:57.326649  404247 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0304 11:46:57.373975  404247 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:50 SystemTime:2024-03-04 11:46:57.365864785 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1052-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-13 Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerEr
rors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.6] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0304 11:46:57.374087  404247 docker.go:295] overlay module found
	I0304 11:46:57.375931  404247 out.go:97] Using the docker driver based on user configuration
	I0304 11:46:57.375953  404247 start.go:299] selected driver: docker
	I0304 11:46:57.375959  404247 start.go:903] validating driver "docker" against <nil>
	I0304 11:46:57.376041  404247 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0304 11:46:57.423411  404247 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:1 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:25 OomKillDisable:true NGoroutines:50 SystemTime:2024-03-04 11:46:57.415491362 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1052-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-13 Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerEr
rors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.6] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0304 11:46:57.423594  404247 start_flags.go:309] no existing cluster config was found, will generate one from the flags 
	I0304 11:46:57.424056  404247 start_flags.go:394] Using suggested 8000MB memory alloc based on sys=32089MB, container=32089MB
	I0304 11:46:57.424185  404247 start_flags.go:913] Wait components to verify : map[apiserver:true system_pods:true]
	I0304 11:46:57.425978  404247 out.go:169] Using Docker driver with root privileges
	I0304 11:46:57.427445  404247 cni.go:84] Creating CNI manager for ""
	I0304 11:46:57.427468  404247 cni.go:143] "docker" driver + "crio" runtime found, recommending kindnet
	I0304 11:46:57.427479  404247 start_flags.go:318] Found "CNI" CNI - setting NetworkPlugin=cni
	I0304 11:46:57.427491  404247 start_flags.go:323] config:
	{Name:download-only-675340 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:8000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:download-only-675340 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Contai
nerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 11:46:57.428782  404247 out.go:97] Starting control plane node download-only-675340 in cluster download-only-675340
	I0304 11:46:57.428796  404247 cache.go:121] Beginning downloading kic base image for docker with crio
	I0304 11:46:57.429854  404247 out.go:97] Pulling base image v0.0.42-1708944392-18244 ...
	I0304 11:46:57.429874  404247 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime crio
	I0304 11:46:57.429924  404247 image.go:79] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local docker daemon
	I0304 11:46:57.444358  404247 cache.go:149] Downloading gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 to local cache
	I0304 11:46:57.444502  404247 image.go:63] Checking for gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local cache directory
	I0304 11:46:57.444522  404247 image.go:66] Found gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 in local cache directory, skipping pull
	I0304 11:46:57.444526  404247 image.go:105] gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 exists in cache, skipping pull
	I0304 11:46:57.444534  404247 cache.go:152] successfully saved gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 as a tarball
	I0304 11:46:57.445738  404247 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.29.0-rc.2/preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4
	I0304 11:46:57.445770  404247 cache.go:56] Caching tarball of preloaded images
	I0304 11:46:57.445893  404247 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime crio
	I0304 11:46:57.447487  404247 out.go:97] Downloading Kubernetes v1.29.0-rc.2 preload ...
	I0304 11:46:57.447506  404247 preload.go:238] getting checksum for preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4 ...
	I0304 11:46:57.470820  404247 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.29.0-rc.2/preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4?checksum=md5:9e0f57288adacc30aad3ff7e72a8dc68 -> /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4
	I0304 11:46:59.859945  404247 preload.go:249] saving checksum for preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4 ...
	I0304 11:46:59.860052  404247 preload.go:256] verifying checksum of /home/jenkins/minikube-integration/18284-396872/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-cri-o-overlay-amd64.tar.lz4 ...
	I0304 11:47:00.617229  404247 cache.go:59] Finished verifying existence of preloaded tar for  v1.29.0-rc.2 on crio
	I0304 11:47:00.617593  404247 profile.go:148] Saving config to /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/download-only-675340/config.json ...
	I0304 11:47:00.617628  404247 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/download-only-675340/config.json: {Name:mk6393cd5f15d89ae1077ebe9a435b37460ba414 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 11:47:00.617798  404247 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime crio
	I0304 11:47:00.617923  404247 download.go:107] Downloading: https://dl.k8s.io/release/v1.29.0-rc.2/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.29.0-rc.2/bin/linux/amd64/kubectl.sha256 -> /home/jenkins/minikube-integration/18284-396872/.minikube/cache/linux/amd64/v1.29.0-rc.2/kubectl
	
	
	* The control plane node "" does not exist.
	  To start a cluster, run: "minikube start -p download-only-675340"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.29.0-rc.2/LogsDuration (0.08s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/DeleteAll (0.2s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-linux-amd64 delete --all
--- PASS: TestDownloadOnly/v1.29.0-rc.2/DeleteAll (0.20s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds (0.13s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-linux-amd64 delete -p download-only-675340
--- PASS: TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds (0.13s)

                                                
                                    
x
+
TestDownloadOnlyKic (1.23s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:232: (dbg) Run:  out/minikube-linux-amd64 start --download-only -p download-docker-291405 --alsologtostderr --driver=docker  --container-runtime=crio
helpers_test.go:175: Cleaning up "download-docker-291405" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p download-docker-291405
--- PASS: TestDownloadOnlyKic (1.23s)

                                                
                                    
x
+
TestBinaryMirror (0.74s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:314: (dbg) Run:  out/minikube-linux-amd64 start --download-only -p binary-mirror-624411 --alsologtostderr --binary-mirror http://127.0.0.1:34831 --driver=docker  --container-runtime=crio
helpers_test.go:175: Cleaning up "binary-mirror-624411" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p binary-mirror-624411
--- PASS: TestBinaryMirror (0.74s)

                                                
                                    
x
+
TestOffline (56.49s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Run:  out/minikube-linux-amd64 start -p offline-crio-183685 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=crio
aab_offline_test.go:55: (dbg) Done: out/minikube-linux-amd64 start -p offline-crio-183685 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=docker  --container-runtime=crio: (54.144883417s)
helpers_test.go:175: Cleaning up "offline-crio-183685" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p offline-crio-183685
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p offline-crio-183685: (2.347588237s)
--- PASS: TestOffline (56.49s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.07s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:928: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p addons-975865
addons_test.go:928: (dbg) Non-zero exit: out/minikube-linux-amd64 addons enable dashboard -p addons-975865: exit status 85 (67.139939ms)

                                                
                                                
-- stdout --
	* Profile "addons-975865" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-975865"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.07s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.07s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:939: (dbg) Run:  out/minikube-linux-amd64 addons disable dashboard -p addons-975865
addons_test.go:939: (dbg) Non-zero exit: out/minikube-linux-amd64 addons disable dashboard -p addons-975865: exit status 85 (66.470314ms)

                                                
                                                
-- stdout --
	* Profile "addons-975865" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-975865"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.07s)

                                                
                                    
x
+
TestAddons/Setup (128.08s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:109: (dbg) Run:  out/minikube-linux-amd64 start -p addons-975865 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=docker  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller
addons_test.go:109: (dbg) Done: out/minikube-linux-amd64 start -p addons-975865 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=docker  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller: (2m8.079738133s)
--- PASS: TestAddons/Setup (128.08s)

                                                
                                    
x
+
TestAddons/parallel/Registry (13.32s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:330: registry stabilized in 16.767663ms
addons_test.go:332: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-zl52r" [eeab5c60-f96a-488e-b668-8316e0664295] Running
addons_test.go:332: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.004452554s
addons_test.go:335: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-rvr4d" [b5a1edef-e542-4acc-8e53-db66447354b3] Running
addons_test.go:335: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.00472782s
addons_test.go:340: (dbg) Run:  kubectl --context addons-975865 delete po -l run=registry-test --now
addons_test.go:345: (dbg) Run:  kubectl --context addons-975865 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:345: (dbg) Done: kubectl --context addons-975865 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (2.521791885s)
addons_test.go:359: (dbg) Run:  out/minikube-linux-amd64 -p addons-975865 ip
2024/03/04 11:49:27 [DEBUG] GET http://192.168.49.2:5000
addons_test.go:388: (dbg) Run:  out/minikube-linux-amd64 -p addons-975865 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (13.32s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (11.02s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:838: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-6bsld" [280b2532-7080-4294-ab1d-7e33111f0427] Running / Ready:ContainersNotReady (containers with unready status: [gadget]) / ContainersReady:ContainersNotReady (containers with unready status: [gadget])
addons_test.go:838: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.003965676s
addons_test.go:841: (dbg) Run:  out/minikube-linux-amd64 addons disable inspektor-gadget -p addons-975865
addons_test.go:841: (dbg) Done: out/minikube-linux-amd64 addons disable inspektor-gadget -p addons-975865: (6.019448743s)
--- PASS: TestAddons/parallel/InspektorGadget (11.02s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.77s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:407: metrics-server stabilized in 3.537538ms
addons_test.go:409: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-69cf46c98-b8n47" [cc50fbf1-ba8e-4734-b9e3-0ae2668c0265] Running
addons_test.go:409: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.004964331s
addons_test.go:415: (dbg) Run:  kubectl --context addons-975865 top pods -n kube-system
addons_test.go:432: (dbg) Run:  out/minikube-linux-amd64 -p addons-975865 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.77s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (9.26s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:456: tiller-deploy stabilized in 13.904007ms
addons_test.go:458: (dbg) TestAddons/parallel/HelmTiller: waiting 6m0s for pods matching "app=helm" in namespace "kube-system" ...
helpers_test.go:344: "tiller-deploy-7b677967b9-rq8jg" [448a96d7-e9e5-4ea5-8c75-5eecbbb2cb1f] Running
addons_test.go:458: (dbg) TestAddons/parallel/HelmTiller: app=helm healthy within 5.004138086s
addons_test.go:473: (dbg) Run:  kubectl --context addons-975865 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version
addons_test.go:473: (dbg) Done: kubectl --context addons-975865 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version: (3.715329995s)
addons_test.go:490: (dbg) Run:  out/minikube-linux-amd64 -p addons-975865 addons disable helm-tiller --alsologtostderr -v=1
--- PASS: TestAddons/parallel/HelmTiller (9.26s)

                                                
                                    
x
+
TestAddons/parallel/CSI (48.15s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:561: csi-hostpath-driver pods stabilized in 4.93284ms
addons_test.go:564: (dbg) Run:  kubectl --context addons-975865 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:569: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:574: (dbg) Run:  kubectl --context addons-975865 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:579: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [faf6eeb3-1134-45a5-bc21-dc622441f701] Pending
helpers_test.go:344: "task-pv-pod" [faf6eeb3-1134-45a5-bc21-dc622441f701] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [faf6eeb3-1134-45a5-bc21-dc622441f701] Running
addons_test.go:579: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 11.003452714s
addons_test.go:584: (dbg) Run:  kubectl --context addons-975865 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:589: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-975865 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-975865 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:594: (dbg) Run:  kubectl --context addons-975865 delete pod task-pv-pod
addons_test.go:594: (dbg) Done: kubectl --context addons-975865 delete pod task-pv-pod: (1.078744802s)
addons_test.go:600: (dbg) Run:  kubectl --context addons-975865 delete pvc hpvc
addons_test.go:606: (dbg) Run:  kubectl --context addons-975865 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:611: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:616: (dbg) Run:  kubectl --context addons-975865 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:621: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [d18889cd-66c2-43dd-bf76-dca3dda443f8] Pending
helpers_test.go:344: "task-pv-pod-restore" [d18889cd-66c2-43dd-bf76-dca3dda443f8] Running
addons_test.go:621: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 7.003314105s
addons_test.go:626: (dbg) Run:  kubectl --context addons-975865 delete pod task-pv-pod-restore
addons_test.go:630: (dbg) Run:  kubectl --context addons-975865 delete pvc hpvc-restore
addons_test.go:634: (dbg) Run:  kubectl --context addons-975865 delete volumesnapshot new-snapshot-demo
addons_test.go:638: (dbg) Run:  out/minikube-linux-amd64 -p addons-975865 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:638: (dbg) Done: out/minikube-linux-amd64 -p addons-975865 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.534718047s)
addons_test.go:642: (dbg) Run:  out/minikube-linux-amd64 -p addons-975865 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (48.15s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (5.57s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:857: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-6548d5df46-4c4pp" [607fe160-2a65-4b8c-910e-de0444790e10] Running
addons_test.go:857: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.004195269s
addons_test.go:860: (dbg) Run:  out/minikube-linux-amd64 addons disable cloud-spanner -p addons-975865
--- PASS: TestAddons/parallel/CloudSpanner (5.57s)

                                                
                                    
x
+
TestAddons/parallel/LocalPath (52.09s)

                                                
                                                
=== RUN   TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/LocalPath
addons_test.go:873: (dbg) Run:  kubectl --context addons-975865 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:879: (dbg) Run:  kubectl --context addons-975865 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:883: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-975865 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:886: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:344: "test-local-path" [4540583d-c966-44cd-ab06-dd11a0e3f62f] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "test-local-path" [4540583d-c966-44cd-ab06-dd11a0e3f62f] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "test-local-path" [4540583d-c966-44cd-ab06-dd11a0e3f62f] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:886: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 3.003390523s
addons_test.go:891: (dbg) Run:  kubectl --context addons-975865 get pvc test-pvc -o=json
addons_test.go:900: (dbg) Run:  out/minikube-linux-amd64 -p addons-975865 ssh "cat /opt/local-path-provisioner/pvc-b19b11ba-71fe-4d1c-b122-7cb5d5ad1463_default_test-pvc/file1"
addons_test.go:912: (dbg) Run:  kubectl --context addons-975865 delete pod test-local-path
addons_test.go:916: (dbg) Run:  kubectl --context addons-975865 delete pvc test-pvc
addons_test.go:920: (dbg) Run:  out/minikube-linux-amd64 -p addons-975865 addons disable storage-provisioner-rancher --alsologtostderr -v=1
addons_test.go:920: (dbg) Done: out/minikube-linux-amd64 -p addons-975865 addons disable storage-provisioner-rancher --alsologtostderr -v=1: (43.092632107s)
--- PASS: TestAddons/parallel/LocalPath (52.09s)

                                                
                                    
x
+
TestAddons/parallel/NvidiaDevicePlugin (6.62s)

                                                
                                                
=== RUN   TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:952: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:344: "nvidia-device-plugin-daemonset-blxlb" [7420b97c-e9cb-4738-b13a-1fc100a3bf50] Running
addons_test.go:952: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 6.006066971s
addons_test.go:955: (dbg) Run:  out/minikube-linux-amd64 addons disable nvidia-device-plugin -p addons-975865
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (6.62s)

                                                
                                    
x
+
TestAddons/parallel/Yakd (6.01s)

                                                
                                                
=== RUN   TestAddons/parallel/Yakd
=== PAUSE TestAddons/parallel/Yakd

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Yakd
addons_test.go:963: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...
helpers_test.go:344: "yakd-dashboard-9947fc6bf-87nxj" [794f042f-ed92-4d32-9718-cdcec2080a3d] Running
addons_test.go:963: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 6.004547187s
--- PASS: TestAddons/parallel/Yakd (6.01s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.12s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:650: (dbg) Run:  kubectl --context addons-975865 create ns new-namespace
addons_test.go:664: (dbg) Run:  kubectl --context addons-975865 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.12s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (12.08s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:172: (dbg) Run:  out/minikube-linux-amd64 stop -p addons-975865
addons_test.go:172: (dbg) Done: out/minikube-linux-amd64 stop -p addons-975865: (11.811265907s)
addons_test.go:176: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p addons-975865
addons_test.go:180: (dbg) Run:  out/minikube-linux-amd64 addons disable dashboard -p addons-975865
addons_test.go:185: (dbg) Run:  out/minikube-linux-amd64 addons disable gvisor -p addons-975865
--- PASS: TestAddons/StoppedEnableDisable (12.08s)

                                                
                                    
x
+
TestCertOptions (27.22s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-linux-amd64 start -p cert-options-744528 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=crio
cert_options_test.go:49: (dbg) Done: out/minikube-linux-amd64 start -p cert-options-744528 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=docker  --container-runtime=crio: (22.767572264s)
cert_options_test.go:60: (dbg) Run:  out/minikube-linux-amd64 -p cert-options-744528 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-744528 config view
cert_options_test.go:100: (dbg) Run:  out/minikube-linux-amd64 ssh -p cert-options-744528 -- "sudo cat /etc/kubernetes/admin.conf"
helpers_test.go:175: Cleaning up "cert-options-744528" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p cert-options-744528
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p cert-options-744528: (3.81926443s)
--- PASS: TestCertOptions (27.22s)

                                                
                                    
x
+
TestCertExpiration (224.3s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-linux-amd64 start -p cert-expiration-528326 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=crio
cert_options_test.go:123: (dbg) Done: out/minikube-linux-amd64 start -p cert-expiration-528326 --memory=2048 --cert-expiration=3m --driver=docker  --container-runtime=crio: (24.780920797s)
cert_options_test.go:131: (dbg) Run:  out/minikube-linux-amd64 start -p cert-expiration-528326 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=crio
cert_options_test.go:131: (dbg) Done: out/minikube-linux-amd64 start -p cert-expiration-528326 --memory=2048 --cert-expiration=8760h --driver=docker  --container-runtime=crio: (14.597881085s)
helpers_test.go:175: Cleaning up "cert-expiration-528326" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p cert-expiration-528326
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p cert-expiration-528326: (4.920183599s)
--- PASS: TestCertExpiration (224.30s)

                                                
                                    
x
+
TestForceSystemdFlag (34.67s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-linux-amd64 start -p force-systemd-flag-116821 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=crio
docker_test.go:91: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-flag-116821 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=docker  --container-runtime=crio: (31.200759059s)
docker_test.go:132: (dbg) Run:  out/minikube-linux-amd64 -p force-systemd-flag-116821 ssh "cat /etc/crio/crio.conf.d/02-crio.conf"
helpers_test.go:175: Cleaning up "force-systemd-flag-116821" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p force-systemd-flag-116821
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-flag-116821: (3.207241583s)
--- PASS: TestForceSystemdFlag (34.67s)

                                                
                                    
x
+
TestForceSystemdEnv (32.19s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-linux-amd64 start -p force-systemd-env-247799 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=crio
docker_test.go:155: (dbg) Done: out/minikube-linux-amd64 start -p force-systemd-env-247799 --memory=2048 --alsologtostderr -v=5 --driver=docker  --container-runtime=crio: (27.956124459s)
helpers_test.go:175: Cleaning up "force-systemd-env-247799" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p force-systemd-env-247799
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p force-systemd-env-247799: (4.235880612s)
--- PASS: TestForceSystemdEnv (32.19s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (1.2s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
=== PAUSE TestKVMDriverInstallOrUpdate

                                                
                                                

                                                
                                                
=== CONT  TestKVMDriverInstallOrUpdate
--- PASS: TestKVMDriverInstallOrUpdate (1.20s)

                                                
                                    
x
+
TestErrorSpam/setup (23.67s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-linux-amd64 start -p nospam-147274 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-147274 --driver=docker  --container-runtime=crio
error_spam_test.go:81: (dbg) Done: out/minikube-linux-amd64 start -p nospam-147274 -n=1 --memory=2250 --wait=false --log_dir=/tmp/nospam-147274 --driver=docker  --container-runtime=crio: (23.665438089s)
--- PASS: TestErrorSpam/setup (23.67s)

                                                
                                    
x
+
TestErrorSpam/start (0.61s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-147274 --log_dir /tmp/nospam-147274 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-147274 --log_dir /tmp/nospam-147274 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-amd64 -p nospam-147274 --log_dir /tmp/nospam-147274 start --dry-run
--- PASS: TestErrorSpam/start (0.61s)

                                                
                                    
x
+
TestErrorSpam/status (0.87s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-147274 --log_dir /tmp/nospam-147274 status
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-147274 --log_dir /tmp/nospam-147274 status
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-amd64 -p nospam-147274 --log_dir /tmp/nospam-147274 status
--- PASS: TestErrorSpam/status (0.87s)

                                                
                                    
x
+
TestErrorSpam/pause (1.53s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-147274 --log_dir /tmp/nospam-147274 pause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-147274 --log_dir /tmp/nospam-147274 pause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-amd64 -p nospam-147274 --log_dir /tmp/nospam-147274 pause
--- PASS: TestErrorSpam/pause (1.53s)

                                                
                                    
x
+
TestErrorSpam/unpause (1.5s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-147274 --log_dir /tmp/nospam-147274 unpause
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-147274 --log_dir /tmp/nospam-147274 unpause
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-amd64 -p nospam-147274 --log_dir /tmp/nospam-147274 unpause
--- PASS: TestErrorSpam/unpause (1.50s)

                                                
                                    
x
+
TestErrorSpam/stop (1.37s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-147274 --log_dir /tmp/nospam-147274 stop
error_spam_test.go:159: (dbg) Done: out/minikube-linux-amd64 -p nospam-147274 --log_dir /tmp/nospam-147274 stop: (1.177978767s)
error_spam_test.go:159: (dbg) Run:  out/minikube-linux-amd64 -p nospam-147274 --log_dir /tmp/nospam-147274 stop
error_spam_test.go:182: (dbg) Run:  out/minikube-linux-amd64 -p nospam-147274 --log_dir /tmp/nospam-147274 stop
--- PASS: TestErrorSpam/stop (1.37s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /home/jenkins/minikube-integration/18284-396872/.minikube/files/etc/test/nested/copy/403649/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (39.71s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-linux-amd64 start -p functional-093444 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=crio
functional_test.go:2230: (dbg) Done: out/minikube-linux-amd64 start -p functional-093444 --memory=4000 --apiserver-port=8441 --wait=all --driver=docker  --container-runtime=crio: (39.704597809s)
--- PASS: TestFunctional/serial/StartWithProxy (39.71s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (40.03s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-linux-amd64 start -p functional-093444 --alsologtostderr -v=8
E0304 11:54:15.024256  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
E0304 11:54:15.030330  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
E0304 11:54:15.040587  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
E0304 11:54:15.060866  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
E0304 11:54:15.101140  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
E0304 11:54:15.181455  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
E0304 11:54:15.341854  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
E0304 11:54:15.662693  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
E0304 11:54:16.303554  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
E0304 11:54:17.583818  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
E0304 11:54:20.144503  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
E0304 11:54:25.264731  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
functional_test.go:655: (dbg) Done: out/minikube-linux-amd64 start -p functional-093444 --alsologtostderr -v=8: (40.030952861s)
functional_test.go:659: soft start took 40.031736308s for "functional-093444" cluster.
--- PASS: TestFunctional/serial/SoftStart (40.03s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.04s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
--- PASS: TestFunctional/serial/KubeContext (0.04s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-093444 get po -A
--- PASS: TestFunctional/serial/KubectlGetPods (0.07s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (2.65s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 cache add registry.k8s.io/pause:3.3
functional_test.go:1045: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 cache add registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (2.65s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (0.75s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-093444 /tmp/TestFunctionalserialCacheCmdcacheadd_local3268903849/001
functional_test.go:1085: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 cache add minikube-local-cache-test:functional-093444
functional_test.go:1090: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 cache delete minikube-local-cache-test:functional-093444
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-093444
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (0.75s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-linux-amd64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-linux-amd64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.06s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.27s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh sudo crictl images
--- PASS: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.27s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (1.57s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh sudo crictl rmi registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-093444 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 1 (261.190594ms)

                                                
                                                
-- stdout --
	FATA[0000] no such image "registry.k8s.io/pause:latest" present 

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:1154: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 cache reload
functional_test.go:1159: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh sudo crictl inspecti registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/cache_reload (1.57s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.12s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-linux-amd64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-linux-amd64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.12s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.12s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 kubectl -- --context functional-093444 get pods
--- PASS: TestFunctional/serial/MinikubeKubectlCmd (0.12s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-093444 get pods
E0304 11:54:35.505825  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
--- PASS: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.11s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (33.39s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-linux-amd64 start -p functional-093444 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
E0304 11:54:55.986264  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
functional_test.go:753: (dbg) Done: out/minikube-linux-amd64 start -p functional-093444 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: (33.385314443s)
functional_test.go:757: restart took 33.385453582s for "functional-093444" cluster.
--- PASS: TestFunctional/serial/ExtraConfig (33.39s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.07s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-093444 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:821: etcd phase: Running
functional_test.go:831: etcd status: Ready
functional_test.go:821: kube-apiserver phase: Running
functional_test.go:831: kube-apiserver status: Ready
functional_test.go:821: kube-controller-manager phase: Running
functional_test.go:831: kube-controller-manager status: Ready
functional_test.go:821: kube-scheduler phase: Running
functional_test.go:831: kube-scheduler status: Ready
--- PASS: TestFunctional/serial/ComponentHealth (0.07s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (1.3s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 logs
functional_test.go:1232: (dbg) Done: out/minikube-linux-amd64 -p functional-093444 logs: (1.304749944s)
--- PASS: TestFunctional/serial/LogsCmd (1.30s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (1.36s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 logs --file /tmp/TestFunctionalserialLogsFileCmd2255718615/001/logs.txt
functional_test.go:1246: (dbg) Done: out/minikube-linux-amd64 -p functional-093444 logs --file /tmp/TestFunctionalserialLogsFileCmd2255718615/001/logs.txt: (1.36330742s)
--- PASS: TestFunctional/serial/LogsFileCmd (1.36s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (3.79s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-093444 apply -f testdata/invalidsvc.yaml
functional_test.go:2331: (dbg) Run:  out/minikube-linux-amd64 service invalid-svc -p functional-093444
functional_test.go:2331: (dbg) Non-zero exit: out/minikube-linux-amd64 service invalid-svc -p functional-093444: exit status 115 (322.838048ms)

                                                
                                                
-- stdout --
	|-----------|-------------|-------------|---------------------------|
	| NAMESPACE |    NAME     | TARGET PORT |            URL            |
	|-----------|-------------|-------------|---------------------------|
	| default   | invalid-svc |          80 | http://192.168.49.2:32598 |
	|-----------|-------------|-------------|---------------------------|
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to SVC_UNREACHABLE: service not available: no running pod for service invalid-svc found
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_service_96b204199e3191fa1740d4430b018a3c8028d52d_0.log                 │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
functional_test.go:2323: (dbg) Run:  kubectl --context functional-093444 delete -f testdata/invalidsvc.yaml
--- PASS: TestFunctional/serial/InvalidService (3.79s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-093444 config get cpus: exit status 14 (82.029981ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 config set cpus 2
functional_test.go:1195: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-093444 config get cpus: exit status 14 (70.979078ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (10.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-093444 --alsologtostderr -v=1]
functional_test.go:906: (dbg) stopping [out/minikube-linux-amd64 dashboard --url --port 36195 -p functional-093444 --alsologtostderr -v=1] ...
helpers_test.go:508: unable to kill pid 439524: os: process already finished
--- PASS: TestFunctional/parallel/DashboardCmd (10.11s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.39s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-linux-amd64 start -p functional-093444 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=crio
functional_test.go:970: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-093444 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=crio: exit status 23 (156.425092ms)

                                                
                                                
-- stdout --
	* [functional-093444] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=18284
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/18284-396872/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/18284-396872/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 11:55:29.025944  438647 out.go:291] Setting OutFile to fd 1 ...
	I0304 11:55:29.026083  438647 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 11:55:29.026095  438647 out.go:304] Setting ErrFile to fd 2...
	I0304 11:55:29.026102  438647 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 11:55:29.026342  438647 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18284-396872/.minikube/bin
	I0304 11:55:29.027052  438647 out.go:298] Setting JSON to false
	I0304 11:55:29.028465  438647 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":41878,"bootTime":1709511451,"procs":239,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1052-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0304 11:55:29.028553  438647 start.go:139] virtualization: kvm guest
	I0304 11:55:29.030482  438647 out.go:177] * [functional-093444] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
	I0304 11:55:29.032076  438647 out.go:177]   - MINIKUBE_LOCATION=18284
	I0304 11:55:29.033220  438647 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 11:55:29.032107  438647 notify.go:220] Checking for updates...
	I0304 11:55:29.035459  438647 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/18284-396872/kubeconfig
	I0304 11:55:29.036711  438647 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/18284-396872/.minikube
	I0304 11:55:29.038001  438647 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0304 11:55:29.039233  438647 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 11:55:29.040624  438647 config.go:182] Loaded profile config "functional-093444": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
	I0304 11:55:29.041194  438647 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 11:55:29.062892  438647 docker.go:122] docker version: linux-25.0.3:Docker Engine - Community
	I0304 11:55:29.063004  438647 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0304 11:55:29.112348  438647 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:58 SystemTime:2024-03-04 11:55:29.10313174 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1052-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86_
64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-13 Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerErr
ors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.6] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0304 11:55:29.112492  438647 docker.go:295] overlay module found
	I0304 11:55:29.114972  438647 out.go:177] * Using the docker driver based on existing profile
	I0304 11:55:29.116178  438647 start.go:299] selected driver: docker
	I0304 11:55:29.116196  438647 start.go:903] validating driver "docker" against &{Name:functional-093444 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-093444 Namespace:default APIServerName:miniku
beCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L
MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 11:55:29.116341  438647 start.go:914] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 11:55:29.118368  438647 out.go:177] 
	W0304 11:55:29.119742  438647 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0304 11:55:29.121036  438647 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-linux-amd64 start -p functional-093444 --dry-run --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
--- PASS: TestFunctional/parallel/DryRun (0.39s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-linux-amd64 start -p functional-093444 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=crio
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p functional-093444 --dry-run --memory 250MB --alsologtostderr --driver=docker  --container-runtime=crio: exit status 23 (176.833501ms)

                                                
                                                
-- stdout --
	* [functional-093444] minikube v1.32.0 sur Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=18284
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/18284-396872/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/18284-396872/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote docker basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 11:55:28.852928  438544 out.go:291] Setting OutFile to fd 1 ...
	I0304 11:55:28.853072  438544 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 11:55:28.853086  438544 out.go:304] Setting ErrFile to fd 2...
	I0304 11:55:28.853092  438544 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 11:55:28.853380  438544 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18284-396872/.minikube/bin
	I0304 11:55:28.853879  438544 out.go:298] Setting JSON to false
	I0304 11:55:28.855027  438544 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":41878,"bootTime":1709511451,"procs":240,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1052-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0304 11:55:28.855104  438544 start.go:139] virtualization: kvm guest
	I0304 11:55:28.857643  438544 out.go:177] * [functional-093444] minikube v1.32.0 sur Ubuntu 20.04 (kvm/amd64)
	I0304 11:55:28.859044  438544 out.go:177]   - MINIKUBE_LOCATION=18284
	I0304 11:55:28.859104  438544 notify.go:220] Checking for updates...
	I0304 11:55:28.860363  438544 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 11:55:28.861701  438544 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/18284-396872/kubeconfig
	I0304 11:55:28.863222  438544 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/18284-396872/.minikube
	I0304 11:55:28.864625  438544 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0304 11:55:28.865985  438544 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 11:55:28.867979  438544 config.go:182] Loaded profile config "functional-093444": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
	I0304 11:55:28.868417  438544 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 11:55:28.895037  438544 docker.go:122] docker version: linux-25.0.3:Docker Engine - Community
	I0304 11:55:28.895220  438544 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0304 11:55:28.954536  438544 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:1 ContainersRunning:1 ContainersPaused:0 ContainersStopped:0 Images:2 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:32 OomKillDisable:true NGoroutines:58 SystemTime:2024-03-04 11:55:28.945233613 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1052-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-13 Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerEr
rors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.6] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0304 11:55:28.954671  438544 docker.go:295] overlay module found
	I0304 11:55:28.956752  438544 out.go:177] * Utilisation du pilote docker basé sur le profil existant
	I0304 11:55:28.958381  438544 start.go:299] selected driver: docker
	I0304 11:55:28.958404  438544 start.go:903] validating driver "docker" against &{Name:functional-093444 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 VMDriver: Driver:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-093444 Namespace:default APIServerName:miniku
beCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8441 NodeName:} Nodes:[{Name: IP:192.168.49.2 Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L
MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 11:55:28.958544  438544 start.go:914] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 11:55:28.960957  438544 out.go:177] 
	W0304 11:55:28.962382  438544 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0304 11:55:28.963606  438544 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (0.92s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 status
functional_test.go:856: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:868: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 status -o json
--- PASS: TestFunctional/parallel/StatusCmd (0.92s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (11.51s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1625: (dbg) Run:  kubectl --context functional-093444 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8
functional_test.go:1631: (dbg) Run:  kubectl --context functional-093444 expose deployment hello-node-connect --type=NodePort --port=8080
functional_test.go:1636: (dbg) TestFunctional/parallel/ServiceCmdConnect: waiting 10m0s for pods matching "app=hello-node-connect" in namespace "default" ...
helpers_test.go:344: "hello-node-connect-55497b8b78-4gvbx" [8b8702dd-1ab2-4602-9a4e-d804d77f67bc] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver])
helpers_test.go:344: "hello-node-connect-55497b8b78-4gvbx" [8b8702dd-1ab2-4602-9a4e-d804d77f67bc] Running
functional_test.go:1636: (dbg) TestFunctional/parallel/ServiceCmdConnect: app=hello-node-connect healthy within 11.004217132s
functional_test.go:1645: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 service hello-node-connect --url
functional_test.go:1651: found endpoint for hello-node-connect: http://192.168.49.2:31619
functional_test.go:1671: http://192.168.49.2:31619: success! body:

                                                
                                                

                                                
                                                
Hostname: hello-node-connect-55497b8b78-4gvbx

                                                
                                                
Pod Information:
	-no pod information available-

                                                
                                                
Server values:
	server_version=nginx: 1.13.3 - lua: 10008

                                                
                                                
Request Information:
	client_address=10.244.0.1
	method=GET
	real path=/
	query=
	request_version=1.1
	request_uri=http://192.168.49.2:8080/

                                                
                                                
Request Headers:
	accept-encoding=gzip
	host=192.168.49.2:31619
	user-agent=Go-http-client/1.1

                                                
                                                
Request Body:
	-no body in request-

                                                
                                                
--- PASS: TestFunctional/parallel/ServiceCmdConnect (11.51s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.17s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1686: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 addons list
functional_test.go:1698: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.17s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (35.91s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 4m0s for pods matching "integration-test=storage-provisioner" in namespace "kube-system" ...
helpers_test.go:344: "storage-provisioner" [dc5b7592-bdff-4e43-8bc4-2e2c91d5a2e0] Running
functional_test_pvc_test.go:44: (dbg) TestFunctional/parallel/PersistentVolumeClaim: integration-test=storage-provisioner healthy within 6.00387639s
functional_test_pvc_test.go:49: (dbg) Run:  kubectl --context functional-093444 get storageclass -o=json
functional_test_pvc_test.go:69: (dbg) Run:  kubectl --context functional-093444 apply -f testdata/storage-provisioner/pvc.yaml
functional_test_pvc_test.go:76: (dbg) Run:  kubectl --context functional-093444 get pvc myclaim -o=json
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-093444 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [019bfcc4-478d-4c40-a8f9-05fb9650e7b8] Pending
helpers_test.go:344: "sp-pod" [019bfcc4-478d-4c40-a8f9-05fb9650e7b8] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [019bfcc4-478d-4c40-a8f9-05fb9650e7b8] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 11.004039599s
functional_test_pvc_test.go:100: (dbg) Run:  kubectl --context functional-093444 exec sp-pod -- touch /tmp/mount/foo
functional_test_pvc_test.go:106: (dbg) Run:  kubectl --context functional-093444 delete -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:106: (dbg) Done: kubectl --context functional-093444 delete -f testdata/storage-provisioner/pod.yaml: (1.163541359s)
functional_test_pvc_test.go:125: (dbg) Run:  kubectl --context functional-093444 apply -f testdata/storage-provisioner/pod.yaml
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: waiting 3m0s for pods matching "test=storage-provisioner" in namespace "default" ...
helpers_test.go:344: "sp-pod" [3978518d-d2e7-48a2-a261-ec180e7b7d98] Pending
helpers_test.go:344: "sp-pod" [3978518d-d2e7-48a2-a261-ec180e7b7d98] Pending / Ready:ContainersNotReady (containers with unready status: [myfrontend]) / ContainersReady:ContainersNotReady (containers with unready status: [myfrontend])
helpers_test.go:344: "sp-pod" [3978518d-d2e7-48a2-a261-ec180e7b7d98] Running
functional_test_pvc_test.go:130: (dbg) TestFunctional/parallel/PersistentVolumeClaim: test=storage-provisioner healthy within 17.003774214s
functional_test_pvc_test.go:114: (dbg) Run:  kubectl --context functional-093444 exec sp-pod -- ls /tmp/mount
--- PASS: TestFunctional/parallel/PersistentVolumeClaim (35.91s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.69s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1721: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "echo hello"
functional_test.go:1738: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "cat /etc/hostname"
--- PASS: TestFunctional/parallel/SSHCmd (0.69s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (1.82s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh -n functional-093444 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 cp functional-093444:/home/docker/cp-test.txt /tmp/TestFunctionalparallelCpCmd88178386/001/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh -n functional-093444 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh -n functional-093444 "sudo cat /tmp/does/not/exist/cp-test.txt"
--- PASS: TestFunctional/parallel/CpCmd (1.82s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (20.7s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1789: (dbg) Run:  kubectl --context functional-093444 replace --force -f testdata/mysql.yaml
functional_test.go:1795: (dbg) TestFunctional/parallel/MySQL: waiting 10m0s for pods matching "app=mysql" in namespace "default" ...
helpers_test.go:344: "mysql-859648c796-tkjv4" [2fb7f75c-c102-48c1-8aa3-f73b1d8de511] Pending / Ready:ContainersNotReady (containers with unready status: [mysql]) / ContainersReady:ContainersNotReady (containers with unready status: [mysql])
helpers_test.go:344: "mysql-859648c796-tkjv4" [2fb7f75c-c102-48c1-8aa3-f73b1d8de511] Running
functional_test.go:1795: (dbg) TestFunctional/parallel/MySQL: app=mysql healthy within 19.003686586s
functional_test.go:1803: (dbg) Run:  kubectl --context functional-093444 exec mysql-859648c796-tkjv4 -- mysql -ppassword -e "show databases;"
functional_test.go:1803: (dbg) Non-zero exit: kubectl --context functional-093444 exec mysql-859648c796-tkjv4 -- mysql -ppassword -e "show databases;": exit status 1 (116.303039ms)

                                                
                                                
** stderr ** 
	mysql: [Warning] Using a password on the command line interface can be insecure.
	ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)
	command terminated with exit code 1

                                                
                                                
** /stderr **
functional_test.go:1803: (dbg) Run:  kubectl --context functional-093444 exec mysql-859648c796-tkjv4 -- mysql -ppassword -e "show databases;"
--- PASS: TestFunctional/parallel/MySQL (20.70s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/403649/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "sudo cat /etc/test/nested/copy/403649/hosts"
functional_test.go:1932: file sync test content: Test file for checking file sync process
--- PASS: TestFunctional/parallel/FileSync (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (1.59s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/403649.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "sudo cat /etc/ssl/certs/403649.pem"
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/403649.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "sudo cat /usr/share/ca-certificates/403649.pem"
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/4036492.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "sudo cat /etc/ssl/certs/4036492.pem"
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/4036492.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "sudo cat /usr/share/ca-certificates/4036492.pem"
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
--- PASS: TestFunctional/parallel/CertSync (1.59s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-093444 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
--- PASS: TestFunctional/parallel/NodeLabels (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.54s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "sudo systemctl is-active docker"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-093444 ssh "sudo systemctl is-active docker": exit status 1 (258.508774ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
functional_test.go:2023: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "sudo systemctl is-active containerd"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-093444 ssh "sudo systemctl is-active containerd": exit status 1 (278.830287ms)

                                                
                                                
-- stdout --
	inactive

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/NonActiveRuntimeDisabled (0.54s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-linux-amd64 license
--- PASS: TestFunctional/parallel/License (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-amd64 -p functional-093444 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-linux-amd64 -p functional-093444 tunnel --alsologtostderr]
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-amd64 -p functional-093444 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 435832: os: process already finished
helpers_test.go:502: unable to terminate pid 435474: os: process already finished
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-linux-amd64 -p functional-093444 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-linux-amd64 -p functional-093444 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (9.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:212: (dbg) Run:  kubectl --context functional-093444 apply -f testdata/testsvc.yaml
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: waiting 4m0s for pods matching "run=nginx-svc" in namespace "default" ...
helpers_test.go:344: "nginx-svc" [e42b7670-a847-4ff7-b15b-e1d40198c4db] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx-svc" [e42b7670-a847-4ff7-b15b-e1d40198c4db] Running
functional_test_tunnel_test.go:216: (dbg) TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup: run=nginx-svc healthy within 9.004712302s
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (9.23s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (10.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1435: (dbg) Run:  kubectl --context functional-093444 create deployment hello-node --image=registry.k8s.io/echoserver:1.8
functional_test.go:1441: (dbg) Run:  kubectl --context functional-093444 expose deployment hello-node --type=NodePort --port=8080
functional_test.go:1446: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: waiting 10m0s for pods matching "app=hello-node" in namespace "default" ...
helpers_test.go:344: "hello-node-d7447cc7f-tvmq9" [a6255a7d-46e7-452c-a878-b0952534857a] Pending / Ready:ContainersNotReady (containers with unready status: [echoserver]) / ContainersReady:ContainersNotReady (containers with unready status: [echoserver])
helpers_test.go:344: "hello-node-d7447cc7f-tvmq9" [a6255a7d-46e7-452c-a878-b0952534857a] Running
functional_test.go:1446: (dbg) TestFunctional/parallel/ServiceCmd/DeployApp: app=hello-node healthy within 10.00363816s
--- PASS: TestFunctional/parallel/ServiceCmd/DeployApp (10.21s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.09s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP
functional_test_tunnel_test.go:234: (dbg) Run:  kubectl --context functional-093444 get svc nginx-svc -o jsonpath={.status.loadBalancer.ingress[0].ip}
--- PASS: TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (0.09s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:299: tunnel at http://10.104.219.204 is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-linux-amd64 -p functional-093444 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1266: (dbg) Run:  out/minikube-linux-amd64 profile lis
functional_test.go:1271: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.37s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.36s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1306: (dbg) Run:  out/minikube-linux-amd64 profile list
functional_test.go:1311: Took "289.882998ms" to run "out/minikube-linux-amd64 profile list"
functional_test.go:1320: (dbg) Run:  out/minikube-linux-amd64 profile list -l
functional_test.go:1325: Took "67.332446ms" to run "out/minikube-linux-amd64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.36s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.35s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1357: (dbg) Run:  out/minikube-linux-amd64 profile list -o json
functional_test.go:1362: Took "284.385267ms" to run "out/minikube-linux-amd64 profile list -o json"
functional_test.go:1370: (dbg) Run:  out/minikube-linux-amd64 profile list -o json --light
functional_test.go:1375: Took "62.899872ms" to run "out/minikube-linux-amd64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.35s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (6.91s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-093444 /tmp/TestFunctionalparallelMountCmdany-port2813240810/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1709553326497530875" to /tmp/TestFunctionalparallelMountCmdany-port2813240810/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1709553326497530875" to /tmp/TestFunctionalparallelMountCmdany-port2813240810/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1709553326497530875" to /tmp/TestFunctionalparallelMountCmdany-port2813240810/001/test-1709553326497530875
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-093444 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (274.315578ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:129: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh -- ls -la /mount-9p
functional_test_mount_test.go:133: guest mount directory contents
total 2
-rw-r--r-- 1 docker docker 24 Mar  4 11:55 created-by-test
-rw-r--r-- 1 docker docker 24 Mar  4 11:55 created-by-test-removed-by-pod
-rw-r--r-- 1 docker docker 24 Mar  4 11:55 test-1709553326497530875
functional_test_mount_test.go:137: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh cat /mount-9p/test-1709553326497530875
functional_test_mount_test.go:148: (dbg) Run:  kubectl --context functional-093444 replace --force -f testdata/busybox-mount-test.yaml
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: waiting 4m0s for pods matching "integration-test=busybox-mount" in namespace "default" ...
helpers_test.go:344: "busybox-mount" [0e63446e-d048-4a05-bd1f-8cb57c709ae8] Pending
helpers_test.go:344: "busybox-mount" [0e63446e-d048-4a05-bd1f-8cb57c709ae8] Pending / Ready:ContainersNotReady (containers with unready status: [mount-munger]) / ContainersReady:ContainersNotReady (containers with unready status: [mount-munger])
helpers_test.go:344: "busybox-mount" [0e63446e-d048-4a05-bd1f-8cb57c709ae8] Running
helpers_test.go:344: "busybox-mount" [0e63446e-d048-4a05-bd1f-8cb57c709ae8] Running: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "busybox-mount" [0e63446e-d048-4a05-bd1f-8cb57c709ae8] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
functional_test_mount_test.go:153: (dbg) TestFunctional/parallel/MountCmd/any-port: integration-test=busybox-mount healthy within 4.003528631s
functional_test_mount_test.go:169: (dbg) Run:  kubectl --context functional-093444 logs busybox-mount
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh stat /mount-9p/created-by-test
functional_test_mount_test.go:181: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh stat /mount-9p/created-by-pod
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-093444 /tmp/TestFunctionalparallelMountCmdany-port2813240810/001:/mount-9p --alsologtostderr -v=1] ...
--- PASS: TestFunctional/parallel/MountCmd/any-port (6.91s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.51s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1455: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 service list
--- PASS: TestFunctional/parallel/ServiceCmd/List (0.51s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1485: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 service list -o json
functional_test.go:1490: Took "501.313041ms" to run "out/minikube-linux-amd64 -p functional-093444 service list -o json"
--- PASS: TestFunctional/parallel/ServiceCmd/JSONOutput (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.35s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1505: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 service --namespace=default --https --url hello-node
functional_test.go:1518: found endpoint: https://192.168.49.2:31138
--- PASS: TestFunctional/parallel/ServiceCmd/HTTPS (0.35s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.36s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1536: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 service hello-node --url --format={{.IP}}
--- PASS: TestFunctional/parallel/ServiceCmd/Format (0.36s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1555: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 service hello-node --url
functional_test.go:1561: found endpoint for hello-node: http://192.168.49.2:31138
--- PASS: TestFunctional/parallel/ServiceCmd/URL (0.41s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_changes (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.33s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 update-context --alsologtostderr -v=2
--- PASS: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.45s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 version --short
--- PASS: TestFunctional/parallel/Version/short (0.13s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (0.75s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 version -o=json --components
--- PASS: TestFunctional/parallel/Version/components (0.75s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (1.72s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-093444 /tmp/TestFunctionalparallelMountCmdspecific-port3832230133/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-093444 ssh "findmnt -T /mount-9p | grep 9p": exit status 1 (358.766046ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:257: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh -- ls -la /mount-9p
functional_test_mount_test.go:261: guest mount directory contents
total 0
functional_test_mount_test.go:263: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-093444 /tmp/TestFunctionalparallelMountCmdspecific-port3832230133/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
functional_test_mount_test.go:264: reading mount text
functional_test_mount_test.go:278: done reading mount text
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-093444 ssh "sudo umount -f /mount-9p": exit status 1 (330.72211ms)

                                                
                                                
-- stdout --
	umount: /mount-9p: not mounted.

                                                
                                                
-- /stdout --
** stderr ** 
	ssh: Process exited with status 32

                                                
                                                
** /stderr **
functional_test_mount_test.go:232: "out/minikube-linux-amd64 -p functional-093444 ssh \"sudo umount -f /mount-9p\"": exit status 1
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-093444 /tmp/TestFunctionalparallelMountCmdspecific-port3832230133/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- PASS: TestFunctional/parallel/MountCmd/specific-port (1.72s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (1.76s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-093444 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2152074927/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-093444 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2152074927/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-linux-amd64 mount -p functional-093444 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2152074927/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-093444 ssh "findmnt -T" /mount1: exit status 1 (383.988494ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "findmnt -T" /mount2
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh "findmnt -T" /mount3
functional_test_mount_test.go:370: (dbg) Run:  out/minikube-linux-amd64 mount -p functional-093444 --kill=true
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-093444 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2152074927/001:/mount1 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-093444 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2152074927/001:/mount2 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-linux-amd64 mount -p functional-093444 /tmp/TestFunctionalparallelMountCmdVerifyCleanup2152074927/001:/mount3 --alsologtostderr -v=1] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
--- PASS: TestFunctional/parallel/MountCmd/VerifyCleanup (1.76s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-amd64 -p functional-093444 image ls --format short --alsologtostderr:
registry.k8s.io/pause:latest
registry.k8s.io/pause:3.9
registry.k8s.io/pause:3.3
registry.k8s.io/pause:3.1
registry.k8s.io/kube-scheduler:v1.28.4
registry.k8s.io/kube-proxy:v1.28.4
registry.k8s.io/kube-controller-manager:v1.28.4
registry.k8s.io/kube-apiserver:v1.28.4
registry.k8s.io/etcd:3.5.9-0
registry.k8s.io/echoserver:1.8
registry.k8s.io/coredns/coredns:v1.10.1
gcr.io/k8s-minikube/storage-provisioner:v5
gcr.io/k8s-minikube/busybox:1.28.4-glibc
gcr.io/google-containers/addon-resizer:functional-093444
docker.io/library/nginx:latest
docker.io/library/nginx:alpine
docker.io/library/mysql:5.7
docker.io/kindest/kindnetd:v20240202-8f1494ea
docker.io/kindest/kindnetd:v20230809-80a64d96
functional_test.go:268: (dbg) Stderr: out/minikube-linux-amd64 -p functional-093444 image ls --format short --alsologtostderr:
I0304 11:55:58.282312  443484 out.go:291] Setting OutFile to fd 1 ...
I0304 11:55:58.282476  443484 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 11:55:58.282489  443484 out.go:304] Setting ErrFile to fd 2...
I0304 11:55:58.282493  443484 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 11:55:58.282693  443484 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18284-396872/.minikube/bin
I0304 11:55:58.283351  443484 config.go:182] Loaded profile config "functional-093444": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0304 11:55:58.283493  443484 config.go:182] Loaded profile config "functional-093444": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0304 11:55:58.283963  443484 cli_runner.go:164] Run: docker container inspect functional-093444 --format={{.State.Status}}
I0304 11:55:58.307237  443484 ssh_runner.go:195] Run: systemctl --version
I0304 11:55:58.307296  443484 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-093444
I0304 11:55:58.325869  443484 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32782 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/functional-093444/id_rsa Username:docker}
I0304 11:55:58.413993  443484 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListShort (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-amd64 -p functional-093444 image ls --format table --alsologtostderr:
|-----------------------------------------|--------------------|---------------|--------|
|                  Image                  |        Tag         |   Image ID    |  Size  |
|-----------------------------------------|--------------------|---------------|--------|
| registry.k8s.io/echoserver              | 1.8                | 82e4c8a736a4f | 97.8MB |
| registry.k8s.io/etcd                    | 3.5.9-0            | 73deb9a3f7025 | 295MB  |
| registry.k8s.io/kube-controller-manager | v1.28.4            | d058aa5ab969c | 123MB  |
| registry.k8s.io/kube-scheduler          | v1.28.4            | e3db313c6dbc0 | 61.6MB |
| docker.io/kindest/kindnetd              | v20230809-80a64d96 | c7d1297425461 | 65.3MB |
| docker.io/library/nginx                 | alpine             | 6913ed9ec8d00 | 44.4MB |
| gcr.io/k8s-minikube/busybox             | 1.28.4-glibc       | 56cc512116c8f | 4.63MB |
| docker.io/library/nginx                 | latest             | e4720093a3c13 | 191MB  |
| gcr.io/k8s-minikube/storage-provisioner | v5                 | 6e38f40d628db | 31.5MB |
| registry.k8s.io/kube-proxy              | v1.28.4            | 83f6cc407eed8 | 74.7MB |
| docker.io/library/mysql                 | 5.7                | 5107333e08a87 | 520MB  |
| registry.k8s.io/coredns/coredns         | v1.10.1            | ead0a4a53df89 | 53.6MB |
| registry.k8s.io/kube-apiserver          | v1.28.4            | 7fe0e6f37db33 | 127MB  |
| registry.k8s.io/pause                   | 3.1                | da86e6ba6ca19 | 747kB  |
| registry.k8s.io/pause                   | 3.3                | 0184c1613d929 | 686kB  |
| registry.k8s.io/pause                   | 3.9                | e6f1816883972 | 750kB  |
| registry.k8s.io/pause                   | latest             | 350b164e7ae1d | 247kB  |
| docker.io/kindest/kindnetd              | v20240202-8f1494ea | 4950bb10b3f87 | 65.3MB |
| gcr.io/google-containers/addon-resizer  | functional-093444  | ffd4cfbbe753e | 34.1MB |
|-----------------------------------------|--------------------|---------------|--------|
functional_test.go:268: (dbg) Stderr: out/minikube-linux-amd64 -p functional-093444 image ls --format table --alsologtostderr:
I0304 11:55:58.522467  443688 out.go:291] Setting OutFile to fd 1 ...
I0304 11:55:58.522603  443688 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 11:55:58.522612  443688 out.go:304] Setting ErrFile to fd 2...
I0304 11:55:58.522617  443688 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 11:55:58.522792  443688 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18284-396872/.minikube/bin
I0304 11:55:58.523925  443688 config.go:182] Loaded profile config "functional-093444": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0304 11:55:58.524126  443688 config.go:182] Loaded profile config "functional-093444": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0304 11:55:58.525211  443688 cli_runner.go:164] Run: docker container inspect functional-093444 --format={{.State.Status}}
I0304 11:55:58.542851  443688 ssh_runner.go:195] Run: systemctl --version
I0304 11:55:58.542906  443688 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-093444
I0304 11:55:58.558974  443688 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32782 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/functional-093444/id_rsa Username:docker}
I0304 11:55:58.642055  443688 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListTable (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-amd64 -p functional-093444 image ls --format json --alsologtostderr:
[{"id":"e6f1816883972d4be47bd48879a08919b96afcd344132622e4d444987919323c","repoDigests":["registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097","registry.k8s.io/pause@sha256:8d4106c88ec0bd28001e34c975d65175d994072d65341f62a8ab0754b0fafe10"],"repoTags":["registry.k8s.io/pause:3.9"],"size":"750414"},{"id":"115053965e86b2df4d78af78d7951b8644839d20a03820c6df59a261103315f7","repoDigests":["docker.io/kubernetesui/metrics-scraper@sha256:43227e8286fd379ee0415a5e2156a9439c4056807e3caa38e1dd413b0644807a","docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c"],"repoTags":[],"size":"43824855"},{"id":"5107333e08a87b836d48ff7528b1e84b9c86781cc9f1748bbc1b8c42a870d933","repoDigests":["docker.io/library/mysql@sha256:4bc6bc963e6d8443453676cae56536f4b8156d78bae03c0145cbe47c2aad73bb","docker.io/library/mysql@sha256:dab0a802b44617303694fb17d166501de279c3031ddeb28c56ecf7fcab5ef0da"],"repoTags":["docker.io/library/mysql:5.7"],
"size":"519571821"},{"id":"6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562","repoDigests":["gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944","gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f"],"repoTags":["gcr.io/k8s-minikube/storage-provisioner:v5"],"size":"31470524"},{"id":"7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257","repoDigests":["registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499","registry.k8s.io/kube-apiserver@sha256:5b28a364467cf7e134343bb3ee2c6d40682b473a743a72142c7bbe25767d36eb"],"repoTags":["registry.k8s.io/kube-apiserver:v1.28.4"],"size":"127226832"},{"id":"e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1","repoDigests":["registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba","registry.k8s.io/kube-scheduler@sha256:d994c
8a78e8cb1ec189fabfd258ff002cccdeb63678fad08ec0fba32298ffe32"],"repoTags":["registry.k8s.io/kube-scheduler:v1.28.4"],"size":"61551410"},{"id":"350b164e7ae1dcddeffadd65c76226c9b6dc5553f5179153fb0e36b78f2a5e06","repoDigests":["registry.k8s.io/pause@sha256:5bcb06ed43da4a16c6e6e33898eb0506e940bd66822659ecf0a898bbb0da7cb9"],"repoTags":["registry.k8s.io/pause:latest"],"size":"247077"},{"id":"c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc","repoDigests":["docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052","docker.io/kindest/kindnetd@sha256:a315b9c49a50d5e126e1b5fa5ef0eae2a9b367c9c4f868e897d772b142372bb4"],"repoTags":["docker.io/kindest/kindnetd:v20230809-80a64d96"],"size":"65258016"},{"id":"6913ed9ec8d009744018c1740879327fe2e085935b2cce7a234bf05347b670d7","repoDigests":["docker.io/library/nginx@sha256:6a2f8b28e45c4adea04ec207a251fd4a2df03ddc930f782af51e315ebc76e9a9","docker.io/library/nginx@sha256:cb0953165f59b5cf2227ae979a49a2284956d997fad4ed7a338eeb
c6aef3e70b"],"repoTags":["docker.io/library/nginx:alpine"],"size":"44394342"},{"id":"ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91","repoDigests":["gcr.io/google-containers/addon-resizer@sha256:0ce7cf4876524f069adf654e4dd3c95fe4bfc889c8bbc03cd6ecd061d9392126"],"repoTags":["gcr.io/google-containers/addon-resizer:functional-093444"],"size":"34114467"},{"id":"ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc","repoDigests":["registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e","registry.k8s.io/coredns/coredns@sha256:be7652ce0b43b1339f3d14d9b14af9f588578011092c1f7893bd55432d83a378"],"repoTags":["registry.k8s.io/coredns/coredns:v1.10.1"],"size":"53621675"},{"id":"0184c1613d92931126feb4c548e5da11015513b9e4c104e7305ee8b53b50a9da","repoDigests":["registry.k8s.io/pause@sha256:1000de19145c53d83aab989956fa8fca08dcbcc5b0208bdc193517905e6ccd04"],"repoTags":["registry.k8s.io/pause:3.3"],"size":"686139"},{"id":"4950bb10b3f87e8d4a8f772a0d89
34625cac4ccfa3675fea34cad0dab83fd5a5","repoDigests":["docker.io/kindest/kindnetd@sha256:61f9956af8019caf6dcc4d39b31857b868aaab80521432ddcc216b805c4f7988","docker.io/kindest/kindnetd@sha256:bdddbe20c61d325166b48dd517059f5b93c21526eb74c5c80d86cd6d37236bac"],"repoTags":["docker.io/kindest/kindnetd:v20240202-8f1494ea"],"size":"65291810"},{"id":"e4720093a3c1381245b53a5a51b417963b3c4472d3f47fc301930a4f3b17666a","repoDigests":["docker.io/library/nginx@sha256:05aa73005987caaed48ea8213696b0df761ccd600d2c53fc0a1a97a180301d71","docker.io/library/nginx@sha256:c26ae7472d624ba1fafd296e73cecc4f93f853088e6a9c13c0d52f6ca5865107"],"repoTags":["docker.io/library/nginx:latest"],"size":"190865895"},{"id":"56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c","repoDigests":["gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e","gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998"],"repoTags":["gcr.io/k8s-minikube/busybox:1.2
8.4-glibc"],"size":"4631262"},{"id":"da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e","repoDigests":["registry.k8s.io/pause@sha256:84805ddcaaae94434d8eacb7e843f549ec1da0cd277787b97ad9d9ac2cea929e"],"repoTags":["registry.k8s.io/pause:3.1"],"size":"746911"},{"id":"07655ddf2eebe5d250f7a72c25f638b27126805d61779741b4e62e69ba080558","repoDigests":["docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93","docker.io/kubernetesui/dashboard@sha256:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029"],"repoTags":[],"size":"249229937"},{"id":"82e4c8a736a4fcf22b5ef9f6a4ff6207064c7187d7694bf97bd561605a538410","repoDigests":["registry.k8s.io/echoserver@sha256:cb3386f863f6a4b05f33c191361723f9d5927ac287463b1bea633bf859475969"],"repoTags":["registry.k8s.io/echoserver:1.8"],"size":"97846543"},{"id":"73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9","repoDigests":["registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d860
9d66829b542eb0b6b7ab15","registry.k8s.io/etcd@sha256:e013d0d5e4e25d00c61a7ff839927a1f36479678f11e49502b53a5e0b14f10c3"],"repoTags":["registry.k8s.io/etcd:3.5.9-0"],"size":"295456551"},{"id":"d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591","repoDigests":["registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c","registry.k8s.io/kube-controller-manager@sha256:c173b92b1ac1ac50de36a9d8d3af6377cbb7bbd930f42d4332cbaea521c57232"],"repoTags":["registry.k8s.io/kube-controller-manager:v1.28.4"],"size":"123261750"},{"id":"83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e","repoDigests":["registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e","registry.k8s.io/kube-proxy@sha256:e63408a0f5068a7e9d4b34fd72b4a2b0e5512509b53cd2123a37fc991b0ef532"],"repoTags":["registry.k8s.io/kube-proxy:v1.28.4"],"size":"74749335"}]
functional_test.go:268: (dbg) Stderr: out/minikube-linux-amd64 -p functional-093444 image ls --format json --alsologtostderr:
I0304 11:55:58.301067  443486 out.go:291] Setting OutFile to fd 1 ...
I0304 11:55:58.301179  443486 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 11:55:58.301188  443486 out.go:304] Setting ErrFile to fd 2...
I0304 11:55:58.301192  443486 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 11:55:58.301408  443486 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18284-396872/.minikube/bin
I0304 11:55:58.301986  443486 config.go:182] Loaded profile config "functional-093444": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0304 11:55:58.302091  443486 config.go:182] Loaded profile config "functional-093444": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0304 11:55:58.302504  443486 cli_runner.go:164] Run: docker container inspect functional-093444 --format={{.State.Status}}
I0304 11:55:58.321036  443486 ssh_runner.go:195] Run: systemctl --version
I0304 11:55:58.321105  443486 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-093444
I0304 11:55:58.345600  443486 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32782 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/functional-093444/id_rsa Username:docker}
I0304 11:55:58.434374  443486 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListJson (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-linux-amd64 -p functional-093444 image ls --format yaml --alsologtostderr:
- id: ffd4cfbbe753e62419e129ee2ac618beb94e51baa7471df5038b0b516b59cf91
repoDigests:
- gcr.io/google-containers/addon-resizer@sha256:0ce7cf4876524f069adf654e4dd3c95fe4bfc889c8bbc03cd6ecd061d9392126
repoTags:
- gcr.io/google-containers/addon-resizer:functional-093444
size: "34114467"
- id: 6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562
repoDigests:
- gcr.io/k8s-minikube/storage-provisioner@sha256:18eb69d1418e854ad5a19e399310e52808a8321e4c441c1dddad8977a0d7a944
- gcr.io/k8s-minikube/storage-provisioner@sha256:c4c05d6ad6c0f24d87b39e596d4dddf64bec3e0d84f5b36e4511d4ebf583f38f
repoTags:
- gcr.io/k8s-minikube/storage-provisioner:v5
size: "31470524"
- id: ead0a4a53df89fd173874b46093b6e62d8c72967bbf606d672c9e8c9b601a4fc
repoDigests:
- registry.k8s.io/coredns/coredns@sha256:a0ead06651cf580044aeb0a0feba63591858fb2e43ade8c9dea45a6a89ae7e5e
- registry.k8s.io/coredns/coredns@sha256:be7652ce0b43b1339f3d14d9b14af9f588578011092c1f7893bd55432d83a378
repoTags:
- registry.k8s.io/coredns/coredns:v1.10.1
size: "53621675"
- id: 73deb9a3f702532592a4167455f8bf2e5f5d900bcc959ba2fd2d35c321de1af9
repoDigests:
- registry.k8s.io/etcd@sha256:6c54bcd6cf6de7760c17ddfb31dd76f5ac64c5d8609d66829b542eb0b6b7ab15
- registry.k8s.io/etcd@sha256:e013d0d5e4e25d00c61a7ff839927a1f36479678f11e49502b53a5e0b14f10c3
repoTags:
- registry.k8s.io/etcd:3.5.9-0
size: "295456551"
- id: 83f6cc407eed88d214aad97f3539bde5c8e485ff14424cd021a3a2899304398e
repoDigests:
- registry.k8s.io/kube-proxy@sha256:b68e9ff5bed1103e0659277256d805ab9313c8b7856ee45d0d3eea0227760f7e
- registry.k8s.io/kube-proxy@sha256:e63408a0f5068a7e9d4b34fd72b4a2b0e5512509b53cd2123a37fc991b0ef532
repoTags:
- registry.k8s.io/kube-proxy:v1.28.4
size: "74749335"
- id: 4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5
repoDigests:
- docker.io/kindest/kindnetd@sha256:61f9956af8019caf6dcc4d39b31857b868aaab80521432ddcc216b805c4f7988
- docker.io/kindest/kindnetd@sha256:bdddbe20c61d325166b48dd517059f5b93c21526eb74c5c80d86cd6d37236bac
repoTags:
- docker.io/kindest/kindnetd:v20240202-8f1494ea
size: "65291810"
- id: 115053965e86b2df4d78af78d7951b8644839d20a03820c6df59a261103315f7
repoDigests:
- docker.io/kubernetesui/metrics-scraper@sha256:43227e8286fd379ee0415a5e2156a9439c4056807e3caa38e1dd413b0644807a
- docker.io/kubernetesui/metrics-scraper@sha256:76049887f07a0476dc93efc2d3569b9529bf982b22d29f356092ce206e98765c
repoTags: []
size: "43824855"
- id: e4720093a3c1381245b53a5a51b417963b3c4472d3f47fc301930a4f3b17666a
repoDigests:
- docker.io/library/nginx@sha256:05aa73005987caaed48ea8213696b0df761ccd600d2c53fc0a1a97a180301d71
- docker.io/library/nginx@sha256:c26ae7472d624ba1fafd296e73cecc4f93f853088e6a9c13c0d52f6ca5865107
repoTags:
- docker.io/library/nginx:latest
size: "190865895"
- id: 7fe0e6f37db33464725e616a12ccc4e36970370005a2b09683a974db6350c257
repoDigests:
- registry.k8s.io/kube-apiserver@sha256:3993d654a91d922a7ea098b2f4b3ff2853c200e3387c66c8a1e84f7222c85499
- registry.k8s.io/kube-apiserver@sha256:5b28a364467cf7e134343bb3ee2c6d40682b473a743a72142c7bbe25767d36eb
repoTags:
- registry.k8s.io/kube-apiserver:v1.28.4
size: "127226832"
- id: da86e6ba6ca197bf6bc5e9d900febd906b133eaa4750e6bed647b0fbe50ed43e
repoDigests:
- registry.k8s.io/pause@sha256:84805ddcaaae94434d8eacb7e843f549ec1da0cd277787b97ad9d9ac2cea929e
repoTags:
- registry.k8s.io/pause:3.1
size: "746911"
- id: 350b164e7ae1dcddeffadd65c76226c9b6dc5553f5179153fb0e36b78f2a5e06
repoDigests:
- registry.k8s.io/pause@sha256:5bcb06ed43da4a16c6e6e33898eb0506e940bd66822659ecf0a898bbb0da7cb9
repoTags:
- registry.k8s.io/pause:latest
size: "247077"
- id: c7d1297425461d3e24fe0ba658818593be65d13a2dd45a4c02d8768d6c8c18cc
repoDigests:
- docker.io/kindest/kindnetd@sha256:4a58d1cd2b45bf2460762a51a4aa9c80861f460af35800c05baab0573f923052
- docker.io/kindest/kindnetd@sha256:a315b9c49a50d5e126e1b5fa5ef0eae2a9b367c9c4f868e897d772b142372bb4
repoTags:
- docker.io/kindest/kindnetd:v20230809-80a64d96
size: "65258016"
- id: 07655ddf2eebe5d250f7a72c25f638b27126805d61779741b4e62e69ba080558
repoDigests:
- docker.io/kubernetesui/dashboard@sha256:2e500d29e9d5f4a086b908eb8dfe7ecac57d2ab09d65b24f588b1d449841ef93
- docker.io/kubernetesui/dashboard@sha256:ca93706ef4e400542202d620b8094a7e4e568ca9b1869c71b053cdf8b5dc3029
repoTags: []
size: "249229937"
- id: d058aa5ab969ce7b84d25e7188be1f80633b18db8ea7d02d9d0a78e676236591
repoDigests:
- registry.k8s.io/kube-controller-manager@sha256:65486c8c338f96dc022dd1a0abe8763e38f35095b84b208c78f44d9e99447d1c
- registry.k8s.io/kube-controller-manager@sha256:c173b92b1ac1ac50de36a9d8d3af6377cbb7bbd930f42d4332cbaea521c57232
repoTags:
- registry.k8s.io/kube-controller-manager:v1.28.4
size: "123261750"
- id: 0184c1613d92931126feb4c548e5da11015513b9e4c104e7305ee8b53b50a9da
repoDigests:
- registry.k8s.io/pause@sha256:1000de19145c53d83aab989956fa8fca08dcbcc5b0208bdc193517905e6ccd04
repoTags:
- registry.k8s.io/pause:3.3
size: "686139"
- id: 6913ed9ec8d009744018c1740879327fe2e085935b2cce7a234bf05347b670d7
repoDigests:
- docker.io/library/nginx@sha256:6a2f8b28e45c4adea04ec207a251fd4a2df03ddc930f782af51e315ebc76e9a9
- docker.io/library/nginx@sha256:cb0953165f59b5cf2227ae979a49a2284956d997fad4ed7a338eebc6aef3e70b
repoTags:
- docker.io/library/nginx:alpine
size: "44394342"
- id: 56cc512116c8f894f11ce1995460aef1ee0972d48bc2a3bdb1faaac7c020289c
repoDigests:
- gcr.io/k8s-minikube/busybox@sha256:2d03e6ceeb99250061dd110530b0ece7998cd84121f952adef120ea7c5a6f00e
- gcr.io/k8s-minikube/busybox@sha256:a85c92d5aa82aa6db0f92e5af591c2670a60a762da6bdfec52d960d55295f998
repoTags:
- gcr.io/k8s-minikube/busybox:1.28.4-glibc
size: "4631262"
- id: e3db313c6dbc065d4ac3b32c7a6f2a878949031b881d217b63881a109c5cfba1
repoDigests:
- registry.k8s.io/kube-scheduler@sha256:335bba9e861b88fa8b7bb9250bcd69b7a33f83da4fee93f9fc0eedc6f34e28ba
- registry.k8s.io/kube-scheduler@sha256:d994c8a78e8cb1ec189fabfd258ff002cccdeb63678fad08ec0fba32298ffe32
repoTags:
- registry.k8s.io/kube-scheduler:v1.28.4
size: "61551410"
- id: e6f1816883972d4be47bd48879a08919b96afcd344132622e4d444987919323c
repoDigests:
- registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097
- registry.k8s.io/pause@sha256:8d4106c88ec0bd28001e34c975d65175d994072d65341f62a8ab0754b0fafe10
repoTags:
- registry.k8s.io/pause:3.9
size: "750414"
- id: 5107333e08a87b836d48ff7528b1e84b9c86781cc9f1748bbc1b8c42a870d933
repoDigests:
- docker.io/library/mysql@sha256:4bc6bc963e6d8443453676cae56536f4b8156d78bae03c0145cbe47c2aad73bb
- docker.io/library/mysql@sha256:dab0a802b44617303694fb17d166501de279c3031ddeb28c56ecf7fcab5ef0da
repoTags:
- docker.io/library/mysql:5.7
size: "519571821"
- id: 82e4c8a736a4fcf22b5ef9f6a4ff6207064c7187d7694bf97bd561605a538410
repoDigests:
- registry.k8s.io/echoserver@sha256:cb3386f863f6a4b05f33c191361723f9d5927ac287463b1bea633bf859475969
repoTags:
- registry.k8s.io/echoserver:1.8
size: "97846543"

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-linux-amd64 -p functional-093444 image ls --format yaml --alsologtostderr:
I0304 11:55:58.293772  443485 out.go:291] Setting OutFile to fd 1 ...
I0304 11:55:58.293918  443485 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 11:55:58.293933  443485 out.go:304] Setting ErrFile to fd 2...
I0304 11:55:58.293940  443485 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 11:55:58.294305  443485 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18284-396872/.minikube/bin
I0304 11:55:58.295189  443485 config.go:182] Loaded profile config "functional-093444": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0304 11:55:58.295373  443485 config.go:182] Loaded profile config "functional-093444": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0304 11:55:58.295962  443485 cli_runner.go:164] Run: docker container inspect functional-093444 --format={{.State.Status}}
I0304 11:55:58.325480  443485 ssh_runner.go:195] Run: systemctl --version
I0304 11:55:58.325554  443485 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-093444
I0304 11:55:58.344435  443485 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32782 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/functional-093444/id_rsa Username:docker}
I0304 11:55:58.425973  443485 ssh_runner.go:195] Run: sudo crictl images --output json
--- PASS: TestFunctional/parallel/ImageCommands/ImageListYaml (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (1.86s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-linux-amd64 -p functional-093444 ssh pgrep buildkitd: exit status 1 (263.810473ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 1

                                                
                                                
** /stderr **
functional_test.go:314: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 image build -t localhost/my-image:functional-093444 testdata/build --alsologtostderr
functional_test.go:314: (dbg) Done: out/minikube-linux-amd64 -p functional-093444 image build -t localhost/my-image:functional-093444 testdata/build --alsologtostderr: (1.392669527s)
functional_test.go:319: (dbg) Stdout: out/minikube-linux-amd64 -p functional-093444 image build -t localhost/my-image:functional-093444 testdata/build --alsologtostderr:
STEP 1/3: FROM gcr.io/k8s-minikube/busybox
STEP 2/3: RUN true
--> 03a2c0757ec
STEP 3/3: ADD content.txt /
COMMIT localhost/my-image:functional-093444
--> bedd120f1e2
Successfully tagged localhost/my-image:functional-093444
bedd120f1e24c4d6e8de210431866fda260809d3b868cb6ded191f04eb03df42
functional_test.go:322: (dbg) Stderr: out/minikube-linux-amd64 -p functional-093444 image build -t localhost/my-image:functional-093444 testdata/build --alsologtostderr:
I0304 11:55:58.543704  443701 out.go:291] Setting OutFile to fd 1 ...
I0304 11:55:58.543969  443701 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 11:55:58.543989  443701 out.go:304] Setting ErrFile to fd 2...
I0304 11:55:58.543999  443701 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 11:55:58.544601  443701 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18284-396872/.minikube/bin
I0304 11:55:58.545364  443701 config.go:182] Loaded profile config "functional-093444": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0304 11:55:58.545914  443701 config.go:182] Loaded profile config "functional-093444": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
I0304 11:55:58.546343  443701 cli_runner.go:164] Run: docker container inspect functional-093444 --format={{.State.Status}}
I0304 11:55:58.562460  443701 ssh_runner.go:195] Run: systemctl --version
I0304 11:55:58.562509  443701 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" functional-093444
I0304 11:55:58.577832  443701 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32782 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/functional-093444/id_rsa Username:docker}
I0304 11:55:58.657933  443701 build_images.go:151] Building image from path: /tmp/build.2536448625.tar
I0304 11:55:58.657994  443701 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build
I0304 11:55:58.666560  443701 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/build/build.2536448625.tar
I0304 11:55:58.669937  443701 ssh_runner.go:352] existence check for /var/lib/minikube/build/build.2536448625.tar: stat -c "%s %y" /var/lib/minikube/build/build.2536448625.tar: Process exited with status 1
stdout:

                                                
                                                
stderr:
stat: cannot statx '/var/lib/minikube/build/build.2536448625.tar': No such file or directory
I0304 11:55:58.669977  443701 ssh_runner.go:362] scp /tmp/build.2536448625.tar --> /var/lib/minikube/build/build.2536448625.tar (3072 bytes)
I0304 11:55:58.692952  443701 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/build/build.2536448625
I0304 11:55:58.701032  443701 ssh_runner.go:195] Run: sudo tar -C /var/lib/minikube/build/build.2536448625 -xf /var/lib/minikube/build/build.2536448625.tar
I0304 11:55:58.708893  443701 crio.go:297] Building image: /var/lib/minikube/build/build.2536448625
I0304 11:55:58.708957  443701 ssh_runner.go:195] Run: sudo podman build -t localhost/my-image:functional-093444 /var/lib/minikube/build/build.2536448625 --cgroup-manager=cgroupfs
Trying to pull gcr.io/k8s-minikube/busybox:latest...
Getting image source signatures
Copying blob sha256:5cc84ad355aaa64f46ea9c7bbcc319a9d808ab15088a27209c9e70ef86e5a2aa
Copying blob sha256:5cc84ad355aaa64f46ea9c7bbcc319a9d808ab15088a27209c9e70ef86e5a2aa
Copying config sha256:beae173ccac6ad749f76713cf4440fe3d21d1043fe616dfbe30775815d1d0f6a
Writing manifest to image destination
Storing signatures
I0304 11:55:59.852636  443701 ssh_runner.go:235] Completed: sudo podman build -t localhost/my-image:functional-093444 /var/lib/minikube/build/build.2536448625 --cgroup-manager=cgroupfs: (1.143651588s)
I0304 11:55:59.852704  443701 ssh_runner.go:195] Run: sudo rm -rf /var/lib/minikube/build/build.2536448625
I0304 11:55:59.861357  443701 ssh_runner.go:195] Run: sudo rm -f /var/lib/minikube/build/build.2536448625.tar
I0304 11:55:59.869239  443701 build_images.go:207] Built localhost/my-image:functional-093444 from /tmp/build.2536448625.tar
I0304 11:55:59.869268  443701 build_images.go:123] succeeded building to: functional-093444
I0304 11:55:59.869275  443701 build_images.go:124] failed building to: 
functional_test.go:447: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageBuild (1.86s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (1.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.8
E0304 11:55:36.947009  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
functional_test.go:341: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.8: (1.013576453s)
functional_test.go:346: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-093444
--- PASS: TestFunctional/parallel/ImageCommands/Setup (1.04s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (8.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 image load --daemon gcr.io/google-containers/addon-resizer:functional-093444 --alsologtostderr
2024/03/04 11:55:39 [DEBUG] GET http://127.0.0.1:36195/api/v1/namespaces/kubernetes-dashboard/services/http:kubernetes-dashboard:/proxy/
functional_test.go:354: (dbg) Done: out/minikube-linux-amd64 -p functional-093444 image load --daemon gcr.io/google-containers/addon-resizer:functional-093444 --alsologtostderr: (8.120827525s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (8.33s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (4.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 image load --daemon gcr.io/google-containers/addon-resizer:functional-093444 --alsologtostderr
functional_test.go:364: (dbg) Done: out/minikube-linux-amd64 -p functional-093444 image load --daemon gcr.io/google-containers/addon-resizer:functional-093444 --alsologtostderr: (4.058978686s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (4.27s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (4.61s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.9
functional_test.go:239: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-093444
functional_test.go:244: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 image load --daemon gcr.io/google-containers/addon-resizer:functional-093444 --alsologtostderr
functional_test.go:244: (dbg) Done: out/minikube-linux-amd64 -p functional-093444 image load --daemon gcr.io/google-containers/addon-resizer:functional-093444 --alsologtostderr: (3.511840125s)
functional_test.go:447: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (4.61s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.74s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 image save gcr.io/google-containers/addon-resizer:functional-093444 /home/jenkins/workspace/Docker_Linux_crio_integration/addon-resizer-save.tar --alsologtostderr
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.74s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 image rm gcr.io/google-containers/addon-resizer:functional-093444 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.45s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 image load /home/jenkins/workspace/Docker_Linux_crio_integration/addon-resizer-save.tar --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (1.11s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.78s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi gcr.io/google-containers/addon-resizer:functional-093444
functional_test.go:423: (dbg) Run:  out/minikube-linux-amd64 -p functional-093444 image save --daemon gcr.io/google-containers/addon-resizer:functional-093444 --alsologtostderr
functional_test.go:428: (dbg) Run:  docker image inspect gcr.io/google-containers/addon-resizer:functional-093444
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.78s)

                                                
                                    
x
+
TestFunctional/delete_addon-resizer_images (0.07s)

                                                
                                                
=== RUN   TestFunctional/delete_addon-resizer_images
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:functional-093444
--- PASS: TestFunctional/delete_addon-resizer_images (0.07s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-093444
--- PASS: TestFunctional/delete_my-image_image (0.02s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-093444
--- PASS: TestFunctional/delete_minikube_cached_images (0.02s)

                                                
                                    
x
+
TestIngressAddonLegacy/StartLegacyK8sCluster (75.73s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/StartLegacyK8sCluster
ingress_addon_legacy_test.go:39: (dbg) Run:  out/minikube-linux-amd64 start -p ingress-addon-legacy-577846 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=crio
E0304 11:56:58.867708  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
ingress_addon_legacy_test.go:39: (dbg) Done: out/minikube-linux-amd64 start -p ingress-addon-legacy-577846 --kubernetes-version=v1.18.20 --memory=4096 --wait=true --alsologtostderr -v=5 --driver=docker  --container-runtime=crio: (1m15.7324747s)
--- PASS: TestIngressAddonLegacy/StartLegacyK8sCluster (75.73s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (9.21s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressAddonActivation
ingress_addon_legacy_test.go:70: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-577846 addons enable ingress --alsologtostderr -v=5
ingress_addon_legacy_test.go:70: (dbg) Done: out/minikube-linux-amd64 -p ingress-addon-legacy-577846 addons enable ingress --alsologtostderr -v=5: (9.206925409s)
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressAddonActivation (9.21s)

                                                
                                    
x
+
TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.56s)

                                                
                                                
=== RUN   TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation
ingress_addon_legacy_test.go:79: (dbg) Run:  out/minikube-linux-amd64 -p ingress-addon-legacy-577846 addons enable ingress-dns --alsologtostderr -v=5
--- PASS: TestIngressAddonLegacy/serial/ValidateIngressDNSAddonActivation (0.56s)

                                                
                                    
x
+
TestJSONOutput/start/Command (37.54s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 start -p json-output-971533 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=crio
E0304 12:00:36.484052  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
E0304 12:00:56.964454  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 start -p json-output-971533 --output=json --user=testUser --memory=2200 --wait=true --driver=docker  --container-runtime=crio: (37.540923615s)
--- PASS: TestJSONOutput/start/Command (37.54s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.64s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 pause -p json-output-971533 --output=json --user=testUser
--- PASS: TestJSONOutput/pause/Command (0.64s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.56s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 unpause -p json-output-971533 --output=json --user=testUser
--- PASS: TestJSONOutput/unpause/Command (0.56s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (5.75s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-linux-amd64 stop -p json-output-971533 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-linux-amd64 stop -p json-output-971533 --output=json --user=testUser: (5.747352933s)
--- PASS: TestJSONOutput/stop/Command (5.75s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.22s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-linux-amd64 start -p json-output-error-025696 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p json-output-error-025696 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (76.254643ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"8878a49b-c050-471c-aef4-455c036c6658","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-025696] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"8dfc480e-7333-48ef-917a-0a0690e45204","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=18284"}}
	{"specversion":"1.0","id":"f1c7a1ff-8997-4860-baa1-e7f3ff04aabe","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"f5c0a214-c849-45ae-8ced-94c98deff63f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/18284-396872/kubeconfig"}}
	{"specversion":"1.0","id":"c4b90fec-e032-4ff1-843e-b89a1ed623da","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/18284-396872/.minikube"}}
	{"specversion":"1.0","id":"d28a56c0-c2a9-4f21-98f0-0f75ec162ee7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}
	{"specversion":"1.0","id":"3e9c6ff5-fe01-4648-9c08-c744b8ff20bd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"ead5facd-d617-4299-9802-910f06977a52","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on linux/amd64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-025696" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p json-output-error-025696
--- PASS: TestErrorJSONOutput (0.22s)

                                                
                                    
x
+
TestKicCustomNetwork/create_custom_network (27.93s)

                                                
                                                
=== RUN   TestKicCustomNetwork/create_custom_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-amd64 start -p docker-network-383271 --network=
E0304 12:01:37.925785  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-amd64 start -p docker-network-383271 --network=: (25.994010803s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-383271" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p docker-network-383271
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p docker-network-383271: (1.916153191s)
--- PASS: TestKicCustomNetwork/create_custom_network (27.93s)

                                                
                                    
x
+
TestKicCustomNetwork/use_default_bridge_network (23.32s)

                                                
                                                
=== RUN   TestKicCustomNetwork/use_default_bridge_network
kic_custom_network_test.go:57: (dbg) Run:  out/minikube-linux-amd64 start -p docker-network-343089 --network=bridge
kic_custom_network_test.go:57: (dbg) Done: out/minikube-linux-amd64 start -p docker-network-343089 --network=bridge: (21.481667686s)
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
helpers_test.go:175: Cleaning up "docker-network-343089" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p docker-network-343089
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p docker-network-343089: (1.819705322s)
--- PASS: TestKicCustomNetwork/use_default_bridge_network (23.32s)

                                                
                                    
x
+
TestKicExistingNetwork (24.12s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:150: (dbg) Run:  docker network ls --format {{.Name}}
kic_custom_network_test.go:93: (dbg) Run:  out/minikube-linux-amd64 start -p existing-network-211952 --network=existing-network
E0304 12:02:28.718216  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
E0304 12:02:28.723548  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
E0304 12:02:28.733832  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
E0304 12:02:28.754141  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
E0304 12:02:28.794397  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
E0304 12:02:28.874661  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
E0304 12:02:29.035061  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
kic_custom_network_test.go:93: (dbg) Done: out/minikube-linux-amd64 start -p existing-network-211952 --network=existing-network: (22.094575174s)
helpers_test.go:175: Cleaning up "existing-network-211952" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p existing-network-211952
E0304 12:02:29.355261  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
E0304 12:02:29.995775  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p existing-network-211952: (1.904339771s)
--- PASS: TestKicExistingNetwork (24.12s)

                                                
                                    
x
+
TestKicCustomSubnet (27.15s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p custom-subnet-955610 --subnet=192.168.60.0/24
E0304 12:02:31.276543  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
E0304 12:02:33.838306  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
E0304 12:02:38.958998  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
E0304 12:02:49.199846  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
kic_custom_network_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p custom-subnet-955610 --subnet=192.168.60.0/24: (25.075650871s)
kic_custom_network_test.go:161: (dbg) Run:  docker network inspect custom-subnet-955610 --format "{{(index .IPAM.Config 0).Subnet}}"
helpers_test.go:175: Cleaning up "custom-subnet-955610" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p custom-subnet-955610
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p custom-subnet-955610: (2.054469955s)
--- PASS: TestKicCustomSubnet (27.15s)

                                                
                                    
x
+
TestKicStaticIP (24.22s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:132: (dbg) Run:  out/minikube-linux-amd64 start -p static-ip-807921 --static-ip=192.168.200.200
E0304 12:02:59.846314  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
E0304 12:03:09.680877  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
kic_custom_network_test.go:132: (dbg) Done: out/minikube-linux-amd64 start -p static-ip-807921 --static-ip=192.168.200.200: (22.097353841s)
kic_custom_network_test.go:138: (dbg) Run:  out/minikube-linux-amd64 -p static-ip-807921 ip
helpers_test.go:175: Cleaning up "static-ip-807921" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p static-ip-807921
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p static-ip-807921: (1.990182314s)
--- PASS: TestKicStaticIP (24.22s)

                                                
                                    
x
+
TestMainNoArgs (0.06s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-linux-amd64
--- PASS: TestMainNoArgs (0.06s)

                                                
                                    
x
+
TestMinikubeProfile (51.16s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-amd64 start -p first-504117 --driver=docker  --container-runtime=crio
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p first-504117 --driver=docker  --container-runtime=crio: (21.707655087s)
minikube_profile_test.go:44: (dbg) Run:  out/minikube-linux-amd64 start -p second-507311 --driver=docker  --container-runtime=crio
E0304 12:03:50.642302  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p second-507311 --driver=docker  --container-runtime=crio: (24.455947984s)
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-amd64 profile first-504117
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-amd64 profile list -ojson
minikube_profile_test.go:51: (dbg) Run:  out/minikube-linux-amd64 profile second-507311
minikube_profile_test.go:55: (dbg) Run:  out/minikube-linux-amd64 profile list -ojson
helpers_test.go:175: Cleaning up "second-507311" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p second-507311
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p second-507311: (1.82063562s)
helpers_test.go:175: Cleaning up "first-504117" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p first-504117
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p first-504117: (2.188669397s)
--- PASS: TestMinikubeProfile (51.16s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (4.97s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-amd64 start -p mount-start-1-367551 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=crio
E0304 12:04:15.024876  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
mount_start_test.go:98: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-1-367551 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=crio: (3.969473673s)
--- PASS: TestMountStart/serial/StartWithMountFirst (4.97s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountFirst (0.25s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountFirst
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-1-367551 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountFirst (0.25s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountSecond (4.84s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountSecond
mount_start_test.go:98: (dbg) Run:  out/minikube-linux-amd64 start -p mount-start-2-382102 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=crio
mount_start_test.go:98: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-2-382102 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46465 --mount-uid 0 --no-kubernetes --driver=docker  --container-runtime=crio: (3.841502205s)
--- PASS: TestMountStart/serial/StartWithMountSecond (4.84s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountSecond (0.24s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountSecond
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-2-382102 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountSecond (0.24s)

                                                
                                    
x
+
TestMountStart/serial/DeleteFirst (1.56s)

                                                
                                                
=== RUN   TestMountStart/serial/DeleteFirst
pause_test.go:132: (dbg) Run:  out/minikube-linux-amd64 delete -p mount-start-1-367551 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-amd64 delete -p mount-start-1-367551 --alsologtostderr -v=5: (1.563500171s)
--- PASS: TestMountStart/serial/DeleteFirst (1.56s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostDelete (0.25s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostDelete
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-2-382102 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostDelete (0.25s)

                                                
                                    
x
+
TestMountStart/serial/Stop (1.18s)

                                                
                                                
=== RUN   TestMountStart/serial/Stop
mount_start_test.go:155: (dbg) Run:  out/minikube-linux-amd64 stop -p mount-start-2-382102
mount_start_test.go:155: (dbg) Done: out/minikube-linux-amd64 stop -p mount-start-2-382102: (1.178595311s)
--- PASS: TestMountStart/serial/Stop (1.18s)

                                                
                                    
x
+
TestMountStart/serial/RestartStopped (6.67s)

                                                
                                                
=== RUN   TestMountStart/serial/RestartStopped
mount_start_test.go:166: (dbg) Run:  out/minikube-linux-amd64 start -p mount-start-2-382102
mount_start_test.go:166: (dbg) Done: out/minikube-linux-amd64 start -p mount-start-2-382102: (5.672953872s)
--- PASS: TestMountStart/serial/RestartStopped (6.67s)

                                                
                                    
x
+
TestMountStart/serial/VerifyMountPostStop (0.24s)

                                                
                                                
=== RUN   TestMountStart/serial/VerifyMountPostStop
mount_start_test.go:114: (dbg) Run:  out/minikube-linux-amd64 -p mount-start-2-382102 ssh -- ls /minikube-host
--- PASS: TestMountStart/serial/VerifyMountPostStop (0.24s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (95.16s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:86: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-749606 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=crio
E0304 12:05:12.563311  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
E0304 12:05:16.003637  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
E0304 12:05:43.687312  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
multinode_test.go:86: (dbg) Done: out/minikube-linux-amd64 start -p multinode-749606 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=docker  --container-runtime=crio: (1m34.723993617s)
multinode_test.go:92: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 status --alsologtostderr
--- PASS: TestMultiNode/serial/FreshStart2Nodes (95.16s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (3.01s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:509: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-749606 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:514: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-749606 -- rollout status deployment/busybox
multinode_test.go:514: (dbg) Done: out/minikube-linux-amd64 kubectl -p multinode-749606 -- rollout status deployment/busybox: (1.53179929s)
multinode_test.go:521: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-749606 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:544: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-749606 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:552: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-749606 -- exec busybox-5b5d89c9d6-2vkm2 -- nslookup kubernetes.io
multinode_test.go:552: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-749606 -- exec busybox-5b5d89c9d6-9g67m -- nslookup kubernetes.io
multinode_test.go:562: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-749606 -- exec busybox-5b5d89c9d6-2vkm2 -- nslookup kubernetes.default
multinode_test.go:562: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-749606 -- exec busybox-5b5d89c9d6-9g67m -- nslookup kubernetes.default
multinode_test.go:570: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-749606 -- exec busybox-5b5d89c9d6-2vkm2 -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:570: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-749606 -- exec busybox-5b5d89c9d6-9g67m -- nslookup kubernetes.default.svc.cluster.local
--- PASS: TestMultiNode/serial/DeployApp2Nodes (3.01s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (0.75s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:580: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-749606 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:588: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-749606 -- exec busybox-5b5d89c9d6-2vkm2 -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:599: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-749606 -- exec busybox-5b5d89c9d6-2vkm2 -- sh -c "ping -c 1 192.168.58.1"
multinode_test.go:588: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-749606 -- exec busybox-5b5d89c9d6-9g67m -- sh -c "nslookup host.minikube.internal | awk 'NR==5' | cut -d' ' -f3"
multinode_test.go:599: (dbg) Run:  out/minikube-linux-amd64 kubectl -p multinode-749606 -- exec busybox-5b5d89c9d6-9g67m -- sh -c "ping -c 1 192.168.58.1"
--- PASS: TestMultiNode/serial/PingHostFrom2Pods (0.75s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (19.85s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:111: (dbg) Run:  out/minikube-linux-amd64 node add -p multinode-749606 -v 3 --alsologtostderr
multinode_test.go:111: (dbg) Done: out/minikube-linux-amd64 node add -p multinode-749606 -v 3 --alsologtostderr: (19.289538869s)
multinode_test.go:117: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 status --alsologtostderr
--- PASS: TestMultiNode/serial/AddNode (19.85s)

                                                
                                    
x
+
TestMultiNode/serial/MultiNodeLabels (0.06s)

                                                
                                                
=== RUN   TestMultiNode/serial/MultiNodeLabels
multinode_test.go:211: (dbg) Run:  kubectl --context multinode-749606 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
--- PASS: TestMultiNode/serial/MultiNodeLabels (0.06s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.27s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:133: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
--- PASS: TestMultiNode/serial/ProfileList (0.27s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (8.76s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:174: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 status --output json --alsologtostderr
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 cp testdata/cp-test.txt multinode-749606:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 ssh -n multinode-749606 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 cp multinode-749606:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile932035949/001/cp-test_multinode-749606.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 ssh -n multinode-749606 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 cp multinode-749606:/home/docker/cp-test.txt multinode-749606-m02:/home/docker/cp-test_multinode-749606_multinode-749606-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 ssh -n multinode-749606 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 ssh -n multinode-749606-m02 "sudo cat /home/docker/cp-test_multinode-749606_multinode-749606-m02.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 cp multinode-749606:/home/docker/cp-test.txt multinode-749606-m03:/home/docker/cp-test_multinode-749606_multinode-749606-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 ssh -n multinode-749606 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 ssh -n multinode-749606-m03 "sudo cat /home/docker/cp-test_multinode-749606_multinode-749606-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 cp testdata/cp-test.txt multinode-749606-m02:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 ssh -n multinode-749606-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 cp multinode-749606-m02:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile932035949/001/cp-test_multinode-749606-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 ssh -n multinode-749606-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 cp multinode-749606-m02:/home/docker/cp-test.txt multinode-749606:/home/docker/cp-test_multinode-749606-m02_multinode-749606.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 ssh -n multinode-749606-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 ssh -n multinode-749606 "sudo cat /home/docker/cp-test_multinode-749606-m02_multinode-749606.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 cp multinode-749606-m02:/home/docker/cp-test.txt multinode-749606-m03:/home/docker/cp-test_multinode-749606-m02_multinode-749606-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 ssh -n multinode-749606-m02 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 ssh -n multinode-749606-m03 "sudo cat /home/docker/cp-test_multinode-749606-m02_multinode-749606-m03.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 cp testdata/cp-test.txt multinode-749606-m03:/home/docker/cp-test.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 ssh -n multinode-749606-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 cp multinode-749606-m03:/home/docker/cp-test.txt /tmp/TestMultiNodeserialCopyFile932035949/001/cp-test_multinode-749606-m03.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 ssh -n multinode-749606-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 cp multinode-749606-m03:/home/docker/cp-test.txt multinode-749606:/home/docker/cp-test_multinode-749606-m03_multinode-749606.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 ssh -n multinode-749606-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 ssh -n multinode-749606 "sudo cat /home/docker/cp-test_multinode-749606-m03_multinode-749606.txt"
helpers_test.go:556: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 cp multinode-749606-m03:/home/docker/cp-test.txt multinode-749606-m02:/home/docker/cp-test_multinode-749606-m03_multinode-749606-m02.txt
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 ssh -n multinode-749606-m03 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 ssh -n multinode-749606-m02 "sudo cat /home/docker/cp-test_multinode-749606-m03_multinode-749606-m02.txt"
--- PASS: TestMultiNode/serial/CopyFile (8.76s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (2.05s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:238: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 node stop m03
multinode_test.go:238: (dbg) Done: out/minikube-linux-amd64 -p multinode-749606 node stop m03: (1.173436669s)
multinode_test.go:244: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 status
multinode_test.go:244: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-749606 status: exit status 7 (437.325529ms)

                                                
                                                
-- stdout --
	multinode-749606
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-749606-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-749606-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:251: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 status --alsologtostderr
multinode_test.go:251: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-749606 status --alsologtostderr: exit status 7 (436.997893ms)

                                                
                                                
-- stdout --
	multinode-749606
	type: Control Plane
	host: Running
	kubelet: Running
	apiserver: Running
	kubeconfig: Configured
	
	multinode-749606-m02
	type: Worker
	host: Running
	kubelet: Running
	
	multinode-749606-m03
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 12:06:45.224876  502543 out.go:291] Setting OutFile to fd 1 ...
	I0304 12:06:45.224973  502543 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 12:06:45.224981  502543 out.go:304] Setting ErrFile to fd 2...
	I0304 12:06:45.224985  502543 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 12:06:45.225148  502543 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18284-396872/.minikube/bin
	I0304 12:06:45.225729  502543 out.go:298] Setting JSON to false
	I0304 12:06:45.225774  502543 mustload.go:65] Loading cluster: multinode-749606
	I0304 12:06:45.226255  502543 notify.go:220] Checking for updates...
	I0304 12:06:45.227026  502543 config.go:182] Loaded profile config "multinode-749606": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
	I0304 12:06:45.227053  502543 status.go:255] checking status of multinode-749606 ...
	I0304 12:06:45.227520  502543 cli_runner.go:164] Run: docker container inspect multinode-749606 --format={{.State.Status}}
	I0304 12:06:45.243507  502543 status.go:330] multinode-749606 host status = "Running" (err=<nil>)
	I0304 12:06:45.243546  502543 host.go:66] Checking if "multinode-749606" exists ...
	I0304 12:06:45.243833  502543 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-749606
	I0304 12:06:45.260236  502543 host.go:66] Checking if "multinode-749606" exists ...
	I0304 12:06:45.260475  502543 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0304 12:06:45.260520  502543 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-749606
	I0304 12:06:45.276237  502543 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32847 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/multinode-749606/id_rsa Username:docker}
	I0304 12:06:45.358765  502543 ssh_runner.go:195] Run: systemctl --version
	I0304 12:06:45.362521  502543 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0304 12:06:45.372166  502543 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0304 12:06:45.420999  502543 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:3 ContainersRunning:2 ContainersPaused:0 ContainersStopped:1 Images:3 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:41 OomKillDisable:true NGoroutines:67 SystemTime:2024-03-04 12:06:45.412560514 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1052-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-13 Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerEr
rors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.6] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0304 12:06:45.421538  502543 kubeconfig.go:92] found "multinode-749606" server: "https://192.168.58.2:8443"
	I0304 12:06:45.421561  502543 api_server.go:166] Checking apiserver status ...
	I0304 12:06:45.421592  502543 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*
	I0304 12:06:45.431650  502543 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1408/cgroup
	I0304 12:06:45.439714  502543 api_server.go:182] apiserver freezer: "9:freezer:/docker/5458f14a297f346d66b0e77daf5882c3dabd1c2c1fbf42fb950da3dcb558a5c5/crio/crio-cfeacf1aa6209dd7db94ead52c19886214b11e8bc8c0c4e5945692b783391b76"
	I0304 12:06:45.439762  502543 ssh_runner.go:195] Run: sudo cat /sys/fs/cgroup/freezer/docker/5458f14a297f346d66b0e77daf5882c3dabd1c2c1fbf42fb950da3dcb558a5c5/crio/crio-cfeacf1aa6209dd7db94ead52c19886214b11e8bc8c0c4e5945692b783391b76/freezer.state
	I0304 12:06:45.447164  502543 api_server.go:204] freezer state: "THAWED"
	I0304 12:06:45.447189  502543 api_server.go:253] Checking apiserver healthz at https://192.168.58.2:8443/healthz ...
	I0304 12:06:45.450889  502543 api_server.go:279] https://192.168.58.2:8443/healthz returned 200:
	ok
	I0304 12:06:45.450916  502543 status.go:421] multinode-749606 apiserver status = Running (err=<nil>)
	I0304 12:06:45.450929  502543 status.go:257] multinode-749606 status: &{Name:multinode-749606 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0304 12:06:45.450953  502543 status.go:255] checking status of multinode-749606-m02 ...
	I0304 12:06:45.451195  502543 cli_runner.go:164] Run: docker container inspect multinode-749606-m02 --format={{.State.Status}}
	I0304 12:06:45.466525  502543 status.go:330] multinode-749606-m02 host status = "Running" (err=<nil>)
	I0304 12:06:45.466544  502543 host.go:66] Checking if "multinode-749606-m02" exists ...
	I0304 12:06:45.466764  502543 cli_runner.go:164] Run: docker container inspect -f "{{range .NetworkSettings.Networks}}{{.IPAddress}},{{.GlobalIPv6Address}}{{end}}" multinode-749606-m02
	I0304 12:06:45.482500  502543 host.go:66] Checking if "multinode-749606-m02" exists ...
	I0304 12:06:45.482747  502543 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
	I0304 12:06:45.482800  502543 cli_runner.go:164] Run: docker container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" multinode-749606-m02
	I0304 12:06:45.498488  502543 sshutil.go:53] new ssh client: &{IP:127.0.0.1 Port:32852 SSHKeyPath:/home/jenkins/minikube-integration/18284-396872/.minikube/machines/multinode-749606-m02/id_rsa Username:docker}
	I0304 12:06:45.578571  502543 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet
	I0304 12:06:45.588254  502543 status.go:257] multinode-749606-m02 status: &{Name:multinode-749606-m02 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}
	I0304 12:06:45.588284  502543 status.go:255] checking status of multinode-749606-m03 ...
	I0304 12:06:45.588518  502543 cli_runner.go:164] Run: docker container inspect multinode-749606-m03 --format={{.State.Status}}
	I0304 12:06:45.605229  502543 status.go:330] multinode-749606-m03 host status = "Stopped" (err=<nil>)
	I0304 12:06:45.605250  502543 status.go:343] host is not running, skipping remaining checks
	I0304 12:06:45.605256  502543 status.go:257] multinode-749606-m03 status: &{Name:multinode-749606-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopNode (2.05s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (10.48s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:272: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:282: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 node start m03 --alsologtostderr
multinode_test.go:282: (dbg) Done: out/minikube-linux-amd64 -p multinode-749606 node start m03 --alsologtostderr: (9.824033568s)
multinode_test.go:289: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 status
multinode_test.go:303: (dbg) Run:  kubectl get nodes
--- PASS: TestMultiNode/serial/StartAfterStop (10.48s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (115.81s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:311: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-749606
multinode_test.go:318: (dbg) Run:  out/minikube-linux-amd64 stop -p multinode-749606
multinode_test.go:318: (dbg) Done: out/minikube-linux-amd64 stop -p multinode-749606: (24.567316391s)
multinode_test.go:323: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-749606 --wait=true -v=8 --alsologtostderr
E0304 12:07:28.718024  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
E0304 12:07:56.403652  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
multinode_test.go:323: (dbg) Done: out/minikube-linux-amd64 start -p multinode-749606 --wait=true -v=8 --alsologtostderr: (1m31.117666148s)
multinode_test.go:328: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-749606
--- PASS: TestMultiNode/serial/RestartKeepsNodes (115.81s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (4.65s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:422: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 node delete m03
multinode_test.go:422: (dbg) Done: out/minikube-linux-amd64 -p multinode-749606 node delete m03: (4.078332715s)
multinode_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 status --alsologtostderr
multinode_test.go:442: (dbg) Run:  docker volume ls
multinode_test.go:452: (dbg) Run:  kubectl get nodes
multinode_test.go:460: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
--- PASS: TestMultiNode/serial/DeleteNode (4.65s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (23.67s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:342: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 stop
E0304 12:09:15.025003  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
multinode_test.go:342: (dbg) Done: out/minikube-linux-amd64 -p multinode-749606 stop: (23.482814786s)
multinode_test.go:348: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 status
multinode_test.go:348: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-749606 status: exit status 7 (95.423826ms)

                                                
                                                
-- stdout --
	multinode-749606
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-749606-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:355: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 status --alsologtostderr
multinode_test.go:355: (dbg) Non-zero exit: out/minikube-linux-amd64 -p multinode-749606 status --alsologtostderr: exit status 7 (90.560261ms)

                                                
                                                
-- stdout --
	multinode-749606
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	
	multinode-749606-m02
	type: Worker
	host: Stopped
	kubelet: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 12:09:20.169117  512516 out.go:291] Setting OutFile to fd 1 ...
	I0304 12:09:20.169595  512516 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 12:09:20.169615  512516 out.go:304] Setting ErrFile to fd 2...
	I0304 12:09:20.169622  512516 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 12:09:20.170077  512516 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18284-396872/.minikube/bin
	I0304 12:09:20.170419  512516 out.go:298] Setting JSON to false
	I0304 12:09:20.170593  512516 mustload.go:65] Loading cluster: multinode-749606
	I0304 12:09:20.170616  512516 notify.go:220] Checking for updates...
	I0304 12:09:20.171184  512516 config.go:182] Loaded profile config "multinode-749606": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
	I0304 12:09:20.171209  512516 status.go:255] checking status of multinode-749606 ...
	I0304 12:09:20.171695  512516 cli_runner.go:164] Run: docker container inspect multinode-749606 --format={{.State.Status}}
	I0304 12:09:20.189615  512516 status.go:330] multinode-749606 host status = "Stopped" (err=<nil>)
	I0304 12:09:20.189650  512516 status.go:343] host is not running, skipping remaining checks
	I0304 12:09:20.189656  512516 status.go:257] multinode-749606 status: &{Name:multinode-749606 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0304 12:09:20.189688  512516 status.go:255] checking status of multinode-749606-m02 ...
	I0304 12:09:20.189938  512516 cli_runner.go:164] Run: docker container inspect multinode-749606-m02 --format={{.State.Status}}
	I0304 12:09:20.205854  512516 status.go:330] multinode-749606-m02 host status = "Stopped" (err=<nil>)
	I0304 12:09:20.205897  512516 status.go:343] host is not running, skipping remaining checks
	I0304 12:09:20.205903  512516 status.go:257] multinode-749606-m02 status: &{Name:multinode-749606-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
--- PASS: TestMultiNode/serial/StopMultiNode (23.67s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (77.88s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:372: (dbg) Run:  docker version -f {{.Server.Version}}
multinode_test.go:382: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-749606 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=crio
E0304 12:10:16.002920  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
multinode_test.go:382: (dbg) Done: out/minikube-linux-amd64 start -p multinode-749606 --wait=true -v=8 --alsologtostderr --driver=docker  --container-runtime=crio: (1m17.307272266s)
multinode_test.go:388: (dbg) Run:  out/minikube-linux-amd64 -p multinode-749606 status --alsologtostderr
multinode_test.go:402: (dbg) Run:  kubectl get nodes
multinode_test.go:410: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"
E0304 12:10:38.069485  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
--- PASS: TestMultiNode/serial/RestartMultiNode (77.88s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (22.92s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:471: (dbg) Run:  out/minikube-linux-amd64 node list -p multinode-749606
multinode_test.go:480: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-749606-m02 --driver=docker  --container-runtime=crio
multinode_test.go:480: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p multinode-749606-m02 --driver=docker  --container-runtime=crio: exit status 14 (76.075364ms)

                                                
                                                
-- stdout --
	* [multinode-749606-m02] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=18284
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/18284-396872/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/18284-396872/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Profile name 'multinode-749606-m02' is duplicated with machine name 'multinode-749606-m02' in profile 'multinode-749606'
	X Exiting due to MK_USAGE: Profile name should be unique

                                                
                                                
** /stderr **
multinode_test.go:488: (dbg) Run:  out/minikube-linux-amd64 start -p multinode-749606-m03 --driver=docker  --container-runtime=crio
multinode_test.go:488: (dbg) Done: out/minikube-linux-amd64 start -p multinode-749606-m03 --driver=docker  --container-runtime=crio: (20.696665251s)
multinode_test.go:495: (dbg) Run:  out/minikube-linux-amd64 node add -p multinode-749606
multinode_test.go:495: (dbg) Non-zero exit: out/minikube-linux-amd64 node add -p multinode-749606: exit status 80 (268.501078ms)

                                                
                                                
-- stdout --
	* Adding node m03 to cluster multinode-749606
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_ADD: failed to add node: Node multinode-749606-m03 already exists in multinode-749606-m03 profile
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                             │
	│    * If the above advice does not help, please let us know:                                 │
	│      https://github.com/kubernetes/minikube/issues/new/choose                               │
	│                                                                                             │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
	│    * Please also attach the following file to the GitHub issue:                             │
	│    * - /tmp/minikube_node_040ea7097fd6ed71e65be9a474587f81f0ccd21d_0.log                    │
	│                                                                                             │
	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:500: (dbg) Run:  out/minikube-linux-amd64 delete -p multinode-749606-m03
multinode_test.go:500: (dbg) Done: out/minikube-linux-amd64 delete -p multinode-749606-m03: (1.819994872s)
--- PASS: TestMultiNode/serial/ValidateNameConflict (22.92s)

                                                
                                    
x
+
TestPreload (114.25s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-linux-amd64 start -p test-preload-077448 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.24.4
preload_test.go:44: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-077448 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.24.4: (1m4.792832532s)
preload_test.go:52: (dbg) Run:  out/minikube-linux-amd64 -p test-preload-077448 image pull gcr.io/k8s-minikube/busybox
preload_test.go:58: (dbg) Run:  out/minikube-linux-amd64 stop -p test-preload-077448
preload_test.go:58: (dbg) Done: out/minikube-linux-amd64 stop -p test-preload-077448: (5.717021414s)
preload_test.go:66: (dbg) Run:  out/minikube-linux-amd64 start -p test-preload-077448 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=crio
E0304 12:12:28.718230  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
preload_test.go:66: (dbg) Done: out/minikube-linux-amd64 start -p test-preload-077448 --memory=2200 --alsologtostderr -v=1 --wait=true --driver=docker  --container-runtime=crio: (40.390857091s)
preload_test.go:71: (dbg) Run:  out/minikube-linux-amd64 -p test-preload-077448 image list
helpers_test.go:175: Cleaning up "test-preload-077448" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p test-preload-077448
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p test-preload-077448: (2.202460353s)
--- PASS: TestPreload (114.25s)

                                                
                                    
x
+
TestScheduledStopUnix (97.2s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-linux-amd64 start -p scheduled-stop-952325 --memory=2048 --driver=docker  --container-runtime=crio
scheduled_stop_test.go:128: (dbg) Done: out/minikube-linux-amd64 start -p scheduled-stop-952325 --memory=2048 --driver=docker  --container-runtime=crio: (21.150214539s)
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-952325 --schedule 5m
scheduled_stop_test.go:191: (dbg) Run:  out/minikube-linux-amd64 status --format={{.TimeToStop}} -p scheduled-stop-952325 -n scheduled-stop-952325
scheduled_stop_test.go:169: signal error was:  <nil>
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-952325 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-952325 --cancel-scheduled
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-952325 -n scheduled-stop-952325
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-amd64 status -p scheduled-stop-952325
scheduled_stop_test.go:137: (dbg) Run:  out/minikube-linux-amd64 stop -p scheduled-stop-952325 --schedule 15s
scheduled_stop_test.go:169: signal error was:  os: process already finished
E0304 12:14:15.024410  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
scheduled_stop_test.go:205: (dbg) Run:  out/minikube-linux-amd64 status -p scheduled-stop-952325
scheduled_stop_test.go:205: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p scheduled-stop-952325: exit status 7 (78.228279ms)

                                                
                                                
-- stdout --
	scheduled-stop-952325
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-952325 -n scheduled-stop-952325
scheduled_stop_test.go:176: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p scheduled-stop-952325 -n scheduled-stop-952325: exit status 7 (73.90683ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
scheduled_stop_test.go:176: status error: exit status 7 (may be ok)
helpers_test.go:175: Cleaning up "scheduled-stop-952325" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p scheduled-stop-952325
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p scheduled-stop-952325: (4.657607645s)
--- PASS: TestScheduledStopUnix (97.20s)

                                                
                                    
x
+
TestInsufficientStorage (12.96s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:50: (dbg) Run:  out/minikube-linux-amd64 start -p insufficient-storage-484694 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=crio
status_test.go:50: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p insufficient-storage-484694 --memory=2048 --output=json --wait=true --driver=docker  --container-runtime=crio: exit status 26 (10.653302068s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"1497b334-274e-4db5-af7e-07eff63018a6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[insufficient-storage-484694] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"c11d0b38-9586-4412-80de-df29d0667941","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=18284"}}
	{"specversion":"1.0","id":"ce57ba69-a26f-40f8-b523-40d0ecffba28","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"d89258c5-a69a-4465-bab2-2cf1cf0472cd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/home/jenkins/minikube-integration/18284-396872/kubeconfig"}}
	{"specversion":"1.0","id":"dd00d38f-ea1c-4c9e-b96c-8df234766530","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/home/jenkins/minikube-integration/18284-396872/.minikube"}}
	{"specversion":"1.0","id":"2ab6de27-9f2d-461f-9222-5dd6603c3c3c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-linux-amd64"}}
	{"specversion":"1.0","id":"0e0d2147-3cf2-4dbd-b1b9-64d25dc09643","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"ad43207b-787c-4c09-a597-3e9ac3ed7807","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_STORAGE_CAPACITY=100"}}
	{"specversion":"1.0","id":"eaae1b17-d00c-4dec-b5d0-ab3ab9b55913","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_TEST_AVAILABLE_STORAGE=19"}}
	{"specversion":"1.0","id":"3598ff4c-9ab3-4116-8aff-e43d78ecca85","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the docker driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"34f96c94-c76b-47ed-8c24-4fd17e956a43","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"Using Docker driver with root privileges"}}
	{"specversion":"1.0","id":"71e07ddb-d91f-40f7-bdb8-60a12405a5af","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting control plane node insufficient-storage-484694 in cluster insufficient-storage-484694","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"4d9a6658-ce5b-4d36-87be-5208cbbb20c6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"5","message":"Pulling base image v0.0.42-1708944392-18244 ...","name":"Pulling Base Image","totalsteps":"19"}}
	{"specversion":"1.0","id":"e55b01f9-abc2-4519-9e54-2f8d5e7c2c03","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"8","message":"Creating docker container (CPUs=2, Memory=2048MB) ...","name":"Creating Container","totalsteps":"19"}}
	{"specversion":"1.0","id":"2ed4ec59-5e34-4365-a08a-5fee04de34f8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Try one or more of the following to free up space on the device:\n\t\n\t\t\t1. Run \"docker system prune\" to remove unused Docker data (optionally with \"-a\")\n\t\t\t2. Increase the storage allocated to Docker for Desktop by clicking on:\n\t\t\t\tDocker icon \u003e Preferences \u003e Resources \u003e Disk Image Size\n\t\t\t3. Run \"minikube ssh -- docker system prune\" if using the Docker container runtime","exitcode":"26","issues":"https://github.com/kubernetes/minikube/issues/9024","message":"Docker is out of disk space! (/var is at 100%% of capacity). You can pass '--force' to skip this check.","name":"RSRC_DOCKER_STORAGE","url":""}}

                                                
                                                
-- /stdout --
status_test.go:76: (dbg) Run:  out/minikube-linux-amd64 status -p insufficient-storage-484694 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p insufficient-storage-484694 --output=json --layout=cluster: exit status 7 (263.91781ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-484694","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","Step":"Creating Container","StepDetail":"Creating docker container (CPUs=2, Memory=2048MB) ...","BinaryVersion":"v1.32.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-484694","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0304 12:14:47.227705  533500 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-484694" does not appear in /home/jenkins/minikube-integration/18284-396872/kubeconfig

                                                
                                                
** /stderr **
status_test.go:76: (dbg) Run:  out/minikube-linux-amd64 status -p insufficient-storage-484694 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p insufficient-storage-484694 --output=json --layout=cluster: exit status 7 (257.505333ms)

                                                
                                                
-- stdout --
	{"Name":"insufficient-storage-484694","StatusCode":507,"StatusName":"InsufficientStorage","StatusDetail":"/var is almost out of disk space","BinaryVersion":"v1.32.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":500,"StatusName":"Error"}},"Nodes":[{"Name":"insufficient-storage-484694","StatusCode":507,"StatusName":"InsufficientStorage","Components":{"apiserver":{"Name":"apiserver","StatusCode":405,"StatusName":"Stopped"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
** stderr ** 
	E0304 12:14:47.486034  533587 status.go:415] kubeconfig endpoint: extract IP: "insufficient-storage-484694" does not appear in /home/jenkins/minikube-integration/18284-396872/kubeconfig
	E0304 12:14:47.495408  533587 status.go:559] unable to read event log: stat: stat /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/insufficient-storage-484694/events.json: no such file or directory

                                                
                                                
** /stderr **
helpers_test.go:175: Cleaning up "insufficient-storage-484694" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p insufficient-storage-484694
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p insufficient-storage-484694: (1.785723007s)
--- PASS: TestInsufficientStorage (12.96s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (99.12s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:120: (dbg) Run:  /tmp/minikube-v1.26.0.2499275976 start -p running-upgrade-366716 --memory=2200 --vm-driver=docker  --container-runtime=crio
E0304 12:15:16.003462  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
version_upgrade_test.go:120: (dbg) Done: /tmp/minikube-v1.26.0.2499275976 start -p running-upgrade-366716 --memory=2200 --vm-driver=docker  --container-runtime=crio: (1m3.50705774s)
version_upgrade_test.go:130: (dbg) Run:  out/minikube-linux-amd64 start -p running-upgrade-366716 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:130: (dbg) Done: out/minikube-linux-amd64 start -p running-upgrade-366716 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (30.236767332s)
helpers_test.go:175: Cleaning up "running-upgrade-366716" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p running-upgrade-366716
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p running-upgrade-366716: (4.690626331s)
--- PASS: TestRunningBinaryUpgrade (99.12s)

                                                
                                    
x
+
TestKubernetesUpgrade (352.42s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:222: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-369188 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:222: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-369188 --memory=2200 --kubernetes-version=v1.16.0 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (51.30626319s)
version_upgrade_test.go:227: (dbg) Run:  out/minikube-linux-amd64 stop -p kubernetes-upgrade-369188
version_upgrade_test.go:227: (dbg) Done: out/minikube-linux-amd64 stop -p kubernetes-upgrade-369188: (3.517493975s)
version_upgrade_test.go:232: (dbg) Run:  out/minikube-linux-amd64 -p kubernetes-upgrade-369188 status --format={{.Host}}
version_upgrade_test.go:232: (dbg) Non-zero exit: out/minikube-linux-amd64 -p kubernetes-upgrade-369188 status --format={{.Host}}: exit status 7 (111.707658ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:234: status error: exit status 7 (may be ok)
version_upgrade_test.go:243: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-369188 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
E0304 12:17:28.717604  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
version_upgrade_test.go:243: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-369188 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (4m33.252484321s)
version_upgrade_test.go:248: (dbg) Run:  kubectl --context kubernetes-upgrade-369188 version --output=json
version_upgrade_test.go:267: Attempting to downgrade Kubernetes (should fail)
version_upgrade_test.go:269: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-369188 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=crio
version_upgrade_test.go:269: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p kubernetes-upgrade-369188 --memory=2200 --kubernetes-version=v1.16.0 --driver=docker  --container-runtime=crio: exit status 106 (95.409798ms)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-369188] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=18284
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/18284-396872/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/18284-396872/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to K8S_DOWNGRADE_UNSUPPORTED: Unable to safely downgrade existing Kubernetes v1.29.0-rc.2 cluster to v1.16.0
	* Suggestion: 
	
	    1) Recreate the cluster with Kubernetes 1.16.0, by running:
	    
	    minikube delete -p kubernetes-upgrade-369188
	    minikube start -p kubernetes-upgrade-369188 --kubernetes-version=v1.16.0
	    
	    2) Create a second cluster with Kubernetes 1.16.0, by running:
	    
	    minikube start -p kubernetes-upgrade-3691882 --kubernetes-version=v1.16.0
	    
	    3) Use the existing cluster at version Kubernetes 1.29.0-rc.2, by running:
	    
	    minikube start -p kubernetes-upgrade-369188 --kubernetes-version=v1.29.0-rc.2
	    

                                                
                                                
** /stderr **
version_upgrade_test.go:273: Attempting restart after unsuccessful downgrade
version_upgrade_test.go:275: (dbg) Run:  out/minikube-linux-amd64 start -p kubernetes-upgrade-369188 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:275: (dbg) Done: out/minikube-linux-amd64 start -p kubernetes-upgrade-369188 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (21.994524958s)
helpers_test.go:175: Cleaning up "kubernetes-upgrade-369188" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p kubernetes-upgrade-369188
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p kubernetes-upgrade-369188: (2.071305909s)
--- PASS: TestKubernetesUpgrade (352.42s)

                                                
                                    
x
+
TestMissingContainerUpgrade (100.06s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
=== PAUSE TestMissingContainerUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestMissingContainerUpgrade
version_upgrade_test.go:309: (dbg) Run:  /tmp/minikube-v1.26.0.456403295 start -p missing-upgrade-311239 --memory=2200 --driver=docker  --container-runtime=crio
version_upgrade_test.go:309: (dbg) Done: /tmp/minikube-v1.26.0.456403295 start -p missing-upgrade-311239 --memory=2200 --driver=docker  --container-runtime=crio: (28.807824446s)
version_upgrade_test.go:318: (dbg) Run:  docker stop missing-upgrade-311239
version_upgrade_test.go:318: (dbg) Done: docker stop missing-upgrade-311239: (13.024913845s)
version_upgrade_test.go:323: (dbg) Run:  docker rm missing-upgrade-311239
version_upgrade_test.go:329: (dbg) Run:  out/minikube-linux-amd64 start -p missing-upgrade-311239 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:329: (dbg) Done: out/minikube-linux-amd64 start -p missing-upgrade-311239 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (53.434408614s)
helpers_test.go:175: Cleaning up "missing-upgrade-311239" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p missing-upgrade-311239
helpers_test.go:178: (dbg) Done: out/minikube-linux-amd64 delete -p missing-upgrade-311239: (4.186846482s)
--- PASS: TestMissingContainerUpgrade (100.06s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (0.47s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (0.47s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.09s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-195655 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=crio
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p NoKubernetes-195655 --no-kubernetes --kubernetes-version=1.20 --driver=docker  --container-runtime=crio: exit status 14 (85.327465ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-195655] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=18284
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/18284-396872/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/18284-396872/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.09s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (39.73s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-195655 --driver=docker  --container-runtime=crio
no_kubernetes_test.go:95: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-195655 --driver=docker  --container-runtime=crio: (39.439377854s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-amd64 -p NoKubernetes-195655 status -o json
--- PASS: TestNoKubernetes/serial/StartWithK8s (39.73s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (88.04s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:183: (dbg) Run:  /tmp/minikube-v1.26.0.1785979145 start -p stopped-upgrade-244809 --memory=2200 --vm-driver=docker  --container-runtime=crio
version_upgrade_test.go:183: (dbg) Done: /tmp/minikube-v1.26.0.1785979145 start -p stopped-upgrade-244809 --memory=2200 --vm-driver=docker  --container-runtime=crio: (57.264263097s)
version_upgrade_test.go:192: (dbg) Run:  /tmp/minikube-v1.26.0.1785979145 -p stopped-upgrade-244809 stop
version_upgrade_test.go:192: (dbg) Done: /tmp/minikube-v1.26.0.1785979145 -p stopped-upgrade-244809 stop: (5.085792757s)
version_upgrade_test.go:198: (dbg) Run:  out/minikube-linux-amd64 start -p stopped-upgrade-244809 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
version_upgrade_test.go:198: (dbg) Done: out/minikube-linux-amd64 start -p stopped-upgrade-244809 --memory=2200 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (25.688375017s)
--- PASS: TestStoppedBinaryUpgrade/Upgrade (88.04s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (6.05s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-195655 --no-kubernetes --driver=docker  --container-runtime=crio
no_kubernetes_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-195655 --no-kubernetes --driver=docker  --container-runtime=crio: (3.778810554s)
no_kubernetes_test.go:200: (dbg) Run:  out/minikube-linux-amd64 -p NoKubernetes-195655 status -o json
no_kubernetes_test.go:200: (dbg) Non-zero exit: out/minikube-linux-amd64 -p NoKubernetes-195655 status -o json: exit status 2 (290.568593ms)

                                                
                                                
-- stdout --
	{"Name":"NoKubernetes-195655","Host":"Running","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Configured","Worker":false}

                                                
                                                
-- /stdout --
no_kubernetes_test.go:124: (dbg) Run:  out/minikube-linux-amd64 delete -p NoKubernetes-195655
no_kubernetes_test.go:124: (dbg) Done: out/minikube-linux-amd64 delete -p NoKubernetes-195655: (1.975574419s)
--- PASS: TestNoKubernetes/serial/StartWithStopK8s (6.05s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (5.06s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-195655 --no-kubernetes --driver=docker  --container-runtime=crio
no_kubernetes_test.go:136: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-195655 --no-kubernetes --driver=docker  --container-runtime=crio: (5.056130409s)
--- PASS: TestNoKubernetes/serial/Start (5.06s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.28s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-amd64 ssh -p NoKubernetes-195655 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p NoKubernetes-195655 "sudo systemctl is-active --quiet service kubelet": exit status 1 (284.831489ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.28s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (11.54s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-linux-amd64 profile list
no_kubernetes_test.go:169: (dbg) Done: out/minikube-linux-amd64 profile list: (2.871023432s)
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-linux-amd64 profile list --output=json
no_kubernetes_test.go:179: (dbg) Done: out/minikube-linux-amd64 profile list --output=json: (8.673537781s)
--- PASS: TestNoKubernetes/serial/ProfileList (11.54s)

                                                
                                    
x
+
TestPause/serial/Start (45.27s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-linux-amd64 start -p pause-248600 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=crio
pause_test.go:80: (dbg) Done: out/minikube-linux-amd64 start -p pause-248600 --memory=2048 --install-addons=false --wait=all --driver=docker  --container-runtime=crio: (45.26933856s)
--- PASS: TestPause/serial/Start (45.27s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (1.29s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-linux-amd64 stop -p NoKubernetes-195655
no_kubernetes_test.go:158: (dbg) Done: out/minikube-linux-amd64 stop -p NoKubernetes-195655: (1.29206609s)
--- PASS: TestNoKubernetes/serial/Stop (1.29s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (14.31s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-linux-amd64 start -p NoKubernetes-195655 --driver=docker  --container-runtime=crio
no_kubernetes_test.go:191: (dbg) Done: out/minikube-linux-amd64 start -p NoKubernetes-195655 --driver=docker  --container-runtime=crio: (14.305101375s)
--- PASS: TestNoKubernetes/serial/StartNoArgs (14.31s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.32s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-linux-amd64 ssh -p NoKubernetes-195655 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-linux-amd64 ssh -p NoKubernetes-195655 "sudo systemctl is-active --quiet service kubelet": exit status 1 (318.673695ms)

                                                
                                                
** stderr ** 
	ssh: Process exited with status 3

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.32s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (0.88s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:206: (dbg) Run:  out/minikube-linux-amd64 logs -p stopped-upgrade-244809
--- PASS: TestStoppedBinaryUpgrade/MinikubeLogs (0.88s)

                                                
                                    
x
+
TestPause/serial/SecondStartNoReconfiguration (28.27s)

                                                
                                                
=== RUN   TestPause/serial/SecondStartNoReconfiguration
pause_test.go:92: (dbg) Run:  out/minikube-linux-amd64 start -p pause-248600 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio
E0304 12:16:39.047708  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
pause_test.go:92: (dbg) Done: out/minikube-linux-amd64 start -p pause-248600 --alsologtostderr -v=1 --driver=docker  --container-runtime=crio: (28.24075111s)
--- PASS: TestPause/serial/SecondStartNoReconfiguration (28.27s)

                                                
                                    
x
+
TestPause/serial/Pause (0.79s)

                                                
                                                
=== RUN   TestPause/serial/Pause
pause_test.go:110: (dbg) Run:  out/minikube-linux-amd64 pause -p pause-248600 --alsologtostderr -v=5
--- PASS: TestPause/serial/Pause (0.79s)

                                                
                                    
x
+
TestPause/serial/VerifyStatus (0.31s)

                                                
                                                
=== RUN   TestPause/serial/VerifyStatus
status_test.go:76: (dbg) Run:  out/minikube-linux-amd64 status -p pause-248600 --output=json --layout=cluster
status_test.go:76: (dbg) Non-zero exit: out/minikube-linux-amd64 status -p pause-248600 --output=json --layout=cluster: exit status 2 (308.131854ms)

                                                
                                                
-- stdout --
	{"Name":"pause-248600","StatusCode":418,"StatusName":"Paused","Step":"Done","StepDetail":"* Paused 7 containers in: kube-system, kubernetes-dashboard, storage-gluster, istio-operator","BinaryVersion":"v1.32.0","Components":{"kubeconfig":{"Name":"kubeconfig","StatusCode":200,"StatusName":"OK"}},"Nodes":[{"Name":"pause-248600","StatusCode":200,"StatusName":"OK","Components":{"apiserver":{"Name":"apiserver","StatusCode":418,"StatusName":"Paused"},"kubelet":{"Name":"kubelet","StatusCode":405,"StatusName":"Stopped"}}}]}

                                                
                                                
-- /stdout --
--- PASS: TestPause/serial/VerifyStatus (0.31s)

                                                
                                    
x
+
TestPause/serial/Unpause (0.61s)

                                                
                                                
=== RUN   TestPause/serial/Unpause
pause_test.go:121: (dbg) Run:  out/minikube-linux-amd64 unpause -p pause-248600 --alsologtostderr -v=5
--- PASS: TestPause/serial/Unpause (0.61s)

                                                
                                    
x
+
TestPause/serial/PauseAgain (0.75s)

                                                
                                                
=== RUN   TestPause/serial/PauseAgain
pause_test.go:110: (dbg) Run:  out/minikube-linux-amd64 pause -p pause-248600 --alsologtostderr -v=5
--- PASS: TestPause/serial/PauseAgain (0.75s)

                                                
                                    
x
+
TestPause/serial/DeletePaused (2.67s)

                                                
                                                
=== RUN   TestPause/serial/DeletePaused
pause_test.go:132: (dbg) Run:  out/minikube-linux-amd64 delete -p pause-248600 --alsologtostderr -v=5
pause_test.go:132: (dbg) Done: out/minikube-linux-amd64 delete -p pause-248600 --alsologtostderr -v=5: (2.674334119s)
--- PASS: TestPause/serial/DeletePaused (2.67s)

                                                
                                    
x
+
TestPause/serial/VerifyDeletedResources (0.47s)

                                                
                                                
=== RUN   TestPause/serial/VerifyDeletedResources
pause_test.go:142: (dbg) Run:  out/minikube-linux-amd64 profile list --output json
pause_test.go:168: (dbg) Run:  docker ps -a
pause_test.go:173: (dbg) Run:  docker volume inspect pause-248600
pause_test.go:173: (dbg) Non-zero exit: docker volume inspect pause-248600: exit status 1 (15.287768ms)

                                                
                                                
-- stdout --
	[]

                                                
                                                
-- /stdout --
** stderr ** 
	Error response from daemon: get pause-248600: no such volume

                                                
                                                
** /stderr **
pause_test.go:178: (dbg) Run:  docker network ls
--- PASS: TestPause/serial/VerifyDeletedResources (0.47s)

                                                
                                    
x
+
TestNetworkPlugins/group/false (3.95s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false
net_test.go:246: (dbg) Run:  out/minikube-linux-amd64 start -p false-882981 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=crio
net_test.go:246: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p false-882981 --memory=2048 --alsologtostderr --cni=false --driver=docker  --container-runtime=crio: exit status 14 (158.468974ms)

                                                
                                                
-- stdout --
	* [false-882981] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
	  - MINIKUBE_LOCATION=18284
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - KUBECONFIG=/home/jenkins/minikube-integration/18284-396872/kubeconfig
	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/18284-396872/.minikube
	  - MINIKUBE_BIN=out/minikube-linux-amd64
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the docker driver based on user configuration
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 12:17:08.535755  571504 out.go:291] Setting OutFile to fd 1 ...
	I0304 12:17:08.537404  571504 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 12:17:08.537419  571504 out.go:304] Setting ErrFile to fd 2...
	I0304 12:17:08.537424  571504 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 12:17:08.537711  571504 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18284-396872/.minikube/bin
	I0304 12:17:08.538518  571504 out.go:298] Setting JSON to false
	I0304 12:17:08.539768  571504 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-13","uptime":43178,"bootTime":1709511451,"procs":261,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1052-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}
	I0304 12:17:08.539843  571504 start.go:139] virtualization: kvm guest
	I0304 12:17:08.542041  571504 out.go:177] * [false-882981] minikube v1.32.0 on Ubuntu 20.04 (kvm/amd64)
	I0304 12:17:08.544220  571504 out.go:177]   - MINIKUBE_LOCATION=18284
	I0304 12:17:08.544281  571504 notify.go:220] Checking for updates...
	I0304 12:17:08.546063  571504 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 12:17:08.547309  571504 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/18284-396872/kubeconfig
	I0304 12:17:08.548440  571504 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/18284-396872/.minikube
	I0304 12:17:08.549601  571504 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64
	I0304 12:17:08.550732  571504 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 12:17:08.552192  571504 config.go:182] Loaded profile config "cert-expiration-528326": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.28.4
	I0304 12:17:08.552284  571504 config.go:182] Loaded profile config "kubernetes-upgrade-369188": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.16.0
	I0304 12:17:08.552351  571504 config.go:182] Loaded profile config "missing-upgrade-311239": Driver=docker, ContainerRuntime=crio, KubernetesVersion=v1.24.1
	I0304 12:17:08.552434  571504 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 12:17:08.575942  571504 docker.go:122] docker version: linux-25.0.3:Docker Engine - Community
	I0304 12:17:08.576025  571504 cli_runner.go:164] Run: docker system info --format "{{json .}}"
	I0304 12:17:08.625973  571504 info.go:266] docker info: {ID:TS6T:UINC:MIYS:RZPA:KS6T:4JQK:7JHN:D6RA:LDP2:MHAE:G32M:C5NQ Containers:2 ContainersRunning:2 ContainersPaused:0 ContainersStopped:0 Images:4 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Using metacopy false] [Native Overlay Diff true] [userxattr false]] SystemStatus:<nil> Plugins:{Volume:[local] Network:[bridge host ipvlan macvlan null overlay] Authorization:<nil> Log:[awslogs fluentd gcplogs gelf journald json-file local splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:false KernelMemoryTCP:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true PidsLimit:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6Tables:true Debug:false NFd:49 OomKillDisable:true NGoroutines:75 SystemTime:2024-03-04 12:17:08.616593204 +0000 UTC LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:5.15.0-1052-gcp OperatingSystem:Ubuntu 20.04.6 LTS OSType:linux Architecture:x86
_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:{AllowNondistributableArtifactsCIDRs:[] AllowNondistributableArtifactsHostnames:[] InsecureRegistryCIDRs:[127.0.0.0/8] IndexConfigs:{DockerIo:{Name:docker.io Mirrors:[] Secure:true Official:true}} Mirrors:[]} NCPU:8 MemTotal:33647988736 GenericResources:<nil> DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:ubuntu-20-agent-13 Labels:[] ExperimentalBuild:false ServerVersion:25.0.3 ClusterStore: ClusterAdvertise: Runtimes:{Runc:{Path:runc}} DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:ae07eda36dd25f8a1b98dfbf587313b99c0190bb Expected:ae07eda36dd25f8a1b98dfbf587313b99c0190bb} RuncCommit:{ID:v1.1.12-0-g51d5e94 Expected:v1.1.12-0-g51d5e94} InitCommit:{ID:de40ad0 Expected:de40ad0} SecurityOptions:[name=apparmor name=seccomp,profile=builtin] ProductLicense: Warnings:<nil> ServerEr
rors:[] ClientInfo:{Debug:false Plugins:[map[Name:buildx Path:/usr/libexec/docker/cli-plugins/docker-buildx SchemaVersion:0.1.0 ShortDescription:Docker Buildx Vendor:Docker Inc. Version:v0.12.1] map[Name:compose Path:/usr/libexec/docker/cli-plugins/docker-compose SchemaVersion:0.1.0 ShortDescription:Docker Compose Vendor:Docker Inc. Version:v2.24.6] map[Name:scan Path:/usr/libexec/docker/cli-plugins/docker-scan SchemaVersion:0.1.0 ShortDescription:Docker Scan Vendor:Docker Inc. Version:v0.23.0]] Warnings:<nil>}}
	I0304 12:17:08.626106  571504 docker.go:295] overlay module found
	I0304 12:17:08.628084  571504 out.go:177] * Using the docker driver based on user configuration
	I0304 12:17:08.629405  571504 start.go:299] selected driver: docker
	I0304 12:17:08.629425  571504 start.go:903] validating driver "docker" against <nil>
	I0304 12:17:08.629440  571504 start.go:914] status for docker: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 12:17:08.631846  571504 out.go:177] 
	W0304 12:17:08.633144  571504 out.go:239] X Exiting due to MK_USAGE: The "crio" container runtime requires CNI
	X Exiting due to MK_USAGE: The "crio" container runtime requires CNI
	I0304 12:17:08.634444  571504 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:88: 
----------------------- debugLogs start: false-882981 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: false-882981

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: false-882981

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: false-882981

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: false-882981

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: false-882981

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: false-882981

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: false-882981

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: false-882981

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: false-882981

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: false-882981

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: false-882981

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "false-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "false-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "false-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "false-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "false-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "false-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "false-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "false-882981" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "false-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "false-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "false-882981" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt
extensions:
- extension:
last-update: Mon, 04 Mar 2024 12:17:02 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: cluster_info
server: https://192.168.85.2:8443
name: kubernetes-upgrade-369188
- cluster:
certificate-authority: /home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt
extensions:
- extension:
last-update: Mon, 04 Mar 2024 12:16:37 UTC
provider: minikube.sigs.k8s.io
version: v1.26.0
name: cluster_info
server: https://192.168.76.2:8443
name: missing-upgrade-311239
contexts:
- context:
cluster: kubernetes-upgrade-369188
extensions:
- extension:
last-update: Mon, 04 Mar 2024 12:17:02 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: context_info
namespace: default
user: kubernetes-upgrade-369188
name: kubernetes-upgrade-369188
- context:
cluster: missing-upgrade-311239
extensions:
- extension:
last-update: Mon, 04 Mar 2024 12:16:37 UTC
provider: minikube.sigs.k8s.io
version: v1.26.0
name: context_info
namespace: default
user: missing-upgrade-311239
name: missing-upgrade-311239
current-context: kubernetes-upgrade-369188
kind: Config
preferences: {}
users:
- name: kubernetes-upgrade-369188
user:
client-certificate: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/kubernetes-upgrade-369188/client.crt
client-key: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/kubernetes-upgrade-369188/client.key
- name: missing-upgrade-311239
user:
client-certificate: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/missing-upgrade-311239/client.crt
client-key: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/missing-upgrade-311239/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: false-882981

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "false-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p false-882981"

                                                
                                                
----------------------- debugLogs end: false-882981 [took: 3.619410319s] --------------------------------
helpers_test.go:175: Cleaning up "false-882981" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p false-882981
--- PASS: TestNetworkPlugins/group/false (3.95s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (129.55s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-amd64 start -p old-k8s-version-996105 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.16.0
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-996105 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.16.0: (2m9.546656016s)
--- PASS: TestStartStop/group/old-k8s-version/serial/FirstStart (129.55s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (55.2s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-amd64 start -p no-preload-219829 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.29.0-rc.2
E0304 12:18:51.764227  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-219829 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.29.0-rc.2: (55.201509792s)
--- PASS: TestStartStop/group/no-preload/serial/FirstStart (55.20s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (7.24s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-219829 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [f1bad04b-55e8-4713-befd-06706691952c] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [f1bad04b-55e8-4713-befd-06706691952c] Running
E0304 12:19:15.024714  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
start_stop_delete_test.go:196: (dbg) TestStartStop/group/no-preload/serial/DeployApp: integration-test=busybox healthy within 7.003775525s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-219829 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/no-preload/serial/DeployApp (7.24s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.77s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p no-preload-219829 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-219829 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.77s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (11.82s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-amd64 stop -p no-preload-219829 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p no-preload-219829 --alsologtostderr -v=3: (11.819287037s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (11.82s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-219829 -n no-preload-219829
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-219829 -n no-preload-219829: exit status 7 (77.857701ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p no-preload-219829 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.19s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (333.87s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-amd64 start -p no-preload-219829 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p no-preload-219829 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.29.0-rc.2: (5m33.463909291s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p no-preload-219829 -n no-preload-219829
--- PASS: TestStartStop/group/no-preload/serial/SecondStart (333.87s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (8.38s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-996105 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [1269553a-0231-462e-a748-d6ff18bad3dc] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [1269553a-0231-462e-a748-d6ff18bad3dc] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/old-k8s-version/serial/DeployApp: integration-test=busybox healthy within 8.003720888s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-996105 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/old-k8s-version/serial/DeployApp (8.38s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.68s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p old-k8s-version-996105 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-996105 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.68s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (11.84s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-amd64 stop -p old-k8s-version-996105 --alsologtostderr -v=3
E0304 12:20:16.003322  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p old-k8s-version-996105 --alsologtostderr -v=3: (11.844786622s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (11.84s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-996105 -n old-k8s-version-996105
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-996105 -n old-k8s-version-996105: exit status 7 (77.104099ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p old-k8s-version-996105 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.18s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (431.8s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-amd64 start -p old-k8s-version-996105 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.16.0
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p old-k8s-version-996105 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=docker  --container-runtime=crio --kubernetes-version=v1.16.0: (7m11.469697617s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p old-k8s-version-996105 -n old-k8s-version-996105
--- PASS: TestStartStop/group/old-k8s-version/serial/SecondStart (431.80s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (39.43s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-amd64 start -p embed-certs-847525 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=crio --kubernetes-version=v1.28.4
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-847525 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=crio --kubernetes-version=v1.28.4: (39.433894977s)
--- PASS: TestStartStop/group/embed-certs/serial/FirstStart (39.43s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (8.25s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-847525 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [6c6e6c50-b1f6-4e60-bca4-843076a9666b] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [6c6e6c50-b1f6-4e60-bca4-843076a9666b] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/embed-certs/serial/DeployApp: integration-test=busybox healthy within 8.003848883s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-847525 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/embed-certs/serial/DeployApp (8.25s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.86s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p embed-certs-847525 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-847525 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.86s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (11.8s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-amd64 stop -p embed-certs-847525 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p embed-certs-847525 --alsologtostderr -v=3: (11.801707598s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (11.80s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.21s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-847525 -n embed-certs-847525
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-847525 -n embed-certs-847525: exit status 7 (83.015599ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p embed-certs-847525 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.21s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (338.61s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-amd64 start -p embed-certs-847525 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=crio --kubernetes-version=v1.28.4
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p embed-certs-847525 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=docker  --container-runtime=crio --kubernetes-version=v1.28.4: (5m38.194167549s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p embed-certs-847525 -n embed-certs-847525
--- PASS: TestStartStop/group/embed-certs/serial/SecondStart (338.61s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (37.72s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-amd64 start -p default-k8s-diff-port-061354 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=crio --kubernetes-version=v1.28.4
E0304 12:22:28.718070  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-diff-port-061354 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=crio --kubernetes-version=v1.28.4: (37.723056783s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (37.72s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (8.24s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-061354 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: waiting 8m0s for pods matching "integration-test=busybox" in namespace "default" ...
helpers_test.go:344: "busybox" [944db38f-42a1-4b67-b2c2-bf6dbbe6652d] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "busybox" [944db38f-42a1-4b67-b2c2-bf6dbbe6652d] Running
start_stop_delete_test.go:196: (dbg) TestStartStop/group/default-k8s-diff-port/serial/DeployApp: integration-test=busybox healthy within 8.003899392s
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-061354 exec busybox -- /bin/sh -c "ulimit -n"
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (8.24s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.86s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p default-k8s-diff-port-061354 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-061354 describe deploy/metrics-server -n kube-system
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.86s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (11.83s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-amd64 stop -p default-k8s-diff-port-061354 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p default-k8s-diff-port-061354 --alsologtostderr -v=3: (11.832150874s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (11.83s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-061354 -n default-k8s-diff-port-061354
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-061354 -n default-k8s-diff-port-061354: exit status 7 (79.138951ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p default-k8s-diff-port-061354 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.18s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (334.85s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-amd64 start -p default-k8s-diff-port-061354 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=crio --kubernetes-version=v1.28.4
E0304 12:24:15.024958  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p default-k8s-diff-port-061354 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=docker  --container-runtime=crio --kubernetes-version=v1.28.4: (5m34.409674924s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p default-k8s-diff-port-061354 -n default-k8s-diff-port-061354
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (334.85s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (11.01s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-rg9n7" [92bf2362-0758-46ed-bdba-dde437c5d308] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-rg9n7" [92bf2362-0758-46ed-bdba-dde437c5d308] Running
E0304 12:25:16.003324  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory
start_stop_delete_test.go:274: (dbg) TestStartStop/group/no-preload/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 11.004232265s
--- PASS: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (11.01s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.07s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-rg9n7" [92bf2362-0758-46ed-bdba-dde437c5d308] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/no-preload/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.003539436s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-219829 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (5.07s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.22s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-amd64 -p no-preload-219829 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240202-8f1494ea
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.22s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (2.58s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 pause -p no-preload-219829 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-219829 -n no-preload-219829
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-219829 -n no-preload-219829: exit status 2 (291.478622ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-219829 -n no-preload-219829
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-219829 -n no-preload-219829: exit status 2 (281.957099ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 unpause -p no-preload-219829 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p no-preload-219829 -n no-preload-219829
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p no-preload-219829 -n no-preload-219829
--- PASS: TestStartStop/group/no-preload/serial/Pause (2.58s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (36.41s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-linux-amd64 start -p newest-cni-538581 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=crio --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:186: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-538581 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=crio --kubernetes-version=v1.29.0-rc.2: (36.407014217s)
--- PASS: TestStartStop/group/newest-cni/serial/FirstStart (36.41s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.13s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-linux-amd64 addons enable metrics-server -p newest-cni-538581 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:205: (dbg) Done: out/minikube-linux-amd64 addons enable metrics-server -p newest-cni-538581 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain: (1.126664904s)
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (1.13s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (1.24s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-linux-amd64 stop -p newest-cni-538581 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-linux-amd64 stop -p newest-cni-538581 --alsologtostderr -v=3: (1.238680315s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (1.24s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-538581 -n newest-cni-538581
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-538581 -n newest-cni-538581: exit status 7 (89.308903ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-linux-amd64 addons enable dashboard -p newest-cni-538581 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.20s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (26.07s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-linux-amd64 start -p newest-cni-538581 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=crio --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:256: (dbg) Done: out/minikube-linux-amd64 start -p newest-cni-538581 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=docker  --container-runtime=crio --kubernetes-version=v1.29.0-rc.2: (25.75893811s)
start_stop_delete_test.go:262: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p newest-cni-538581 -n newest-cni-538581
--- PASS: TestStartStop/group/newest-cni/serial/SecondStart (26.07s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.22s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-amd64 -p newest-cni-538581 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230809-80a64d96
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240202-8f1494ea
--- PASS: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.22s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (2.45s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 pause -p newest-cni-538581 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-538581 -n newest-cni-538581
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-538581 -n newest-cni-538581: exit status 2 (294.615993ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-538581 -n newest-cni-538581
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-538581 -n newest-cni-538581: exit status 2 (289.289513ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 unpause -p newest-cni-538581 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p newest-cni-538581 -n newest-cni-538581
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p newest-cni-538581 -n newest-cni-538581
--- PASS: TestStartStop/group/newest-cni/serial/Pause (2.45s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (51.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p auto-882981 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p auto-882981 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=docker  --container-runtime=crio: (51.304561542s)
--- PASS: TestNetworkPlugins/group/auto/Start (51.30s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (11.01s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-xp5pf" [8f945d1a-3e2e-407f-9e00-5abec54f080e] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
E0304 12:27:18.069987  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-xp5pf" [8f945d1a-3e2e-407f-9e00-5abec54f080e] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 11.00394675s
--- PASS: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (11.01s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.08s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-xp5pf" [8f945d1a-3e2e-407f-9e00-5abec54f080e] Running
E0304 12:27:28.718010  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/ingress-addon-legacy-577846/client.crt: no such file or directory
start_stop_delete_test.go:287: (dbg) TestStartStop/group/embed-certs/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.004270415s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-847525 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (5.08s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/KubeletFlags (0.25s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p auto-882981 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/auto/KubeletFlags (0.25s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/NetCatPod (9.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context auto-882981 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-qwhqc" [c35b6e8d-26d2-44cb-841f-0dda14fff482] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-qwhqc" [c35b6e8d-26d2-44cb-841f-0dda14fff482] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/auto/NetCatPod: app=netcat healthy within 9.003542637s
--- PASS: TestNetworkPlugins/group/auto/NetCatPod (9.18s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-amd64 -p embed-certs-847525 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230809-80a64d96
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240202-8f1494ea
--- PASS: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.23s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (2.61s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 pause -p embed-certs-847525 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-847525 -n embed-certs-847525
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-847525 -n embed-certs-847525: exit status 2 (286.338527ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-847525 -n embed-certs-847525
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-847525 -n embed-certs-847525: exit status 2 (291.220697ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 unpause -p embed-certs-847525 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p embed-certs-847525 -n embed-certs-847525
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p embed-certs-847525 -n embed-certs-847525
--- PASS: TestStartStop/group/embed-certs/serial/Pause (2.61s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-tnswc" [3af7702a-4fcc-44b2-ac36-edd8599c5834] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 6.00384614s
--- PASS: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (49.72s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p kindnet-882981 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p kindnet-882981 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=docker  --container-runtime=crio: (49.719011977s)
--- PASS: TestNetworkPlugins/group/kindnet/Start (49.72s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/DNS (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/DNS
net_test.go:175: (dbg) Run:  kubectl --context auto-882981 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/auto/DNS (0.14s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Localhost (0.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Localhost
net_test.go:194: (dbg) Run:  kubectl --context auto-882981 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/auto/Localhost (0.12s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/HairPin (0.11s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/HairPin
net_test.go:264: (dbg) Run:  kubectl --context auto-882981 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/auto/HairPin (0.11s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.08s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-84b68f675b-tnswc" [3af7702a-4fcc-44b2-ac36-edd8599c5834] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.003910633s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-996105 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (5.08s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.26s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-amd64 -p old-k8s-version-996105 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20210326-1e038dc5
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240202-8f1494ea
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.26s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (3s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 pause -p old-k8s-version-996105 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-996105 -n old-k8s-version-996105
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-996105 -n old-k8s-version-996105: exit status 2 (342.758025ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-996105 -n old-k8s-version-996105
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-996105 -n old-k8s-version-996105: exit status 2 (329.571292ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 unpause -p old-k8s-version-996105 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p old-k8s-version-996105 -n old-k8s-version-996105
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p old-k8s-version-996105 -n old-k8s-version-996105
--- PASS: TestStartStop/group/old-k8s-version/serial/Pause (3.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (63.92s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p calico-882981 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p calico-882981 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=docker  --container-runtime=crio: (1m3.924484246s)
--- PASS: TestNetworkPlugins/group/calico/Start (63.92s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (56.66s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p custom-flannel-882981 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=crio
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p custom-flannel-882981 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=docker  --container-runtime=crio: (56.659043271s)
--- PASS: TestNetworkPlugins/group/custom-flannel/Start (56.66s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: waiting 10m0s for pods matching "app=kindnet" in namespace "kube-system" ...
helpers_test.go:344: "kindnet-fc7sj" [2d75db6f-f4cf-443b-abd7-61cb11788c77] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/kindnet/ControllerPod: app=kindnet healthy within 6.005568159s
--- PASS: TestNetworkPlugins/group/kindnet/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/KubeletFlags (0.31s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p kindnet-882981 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/kindnet/KubeletFlags (0.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/NetCatPod (11.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context kindnet-882981 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-n7mzs" [53d8960b-d5df-40eb-92bf-8ac37c848bfb] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-n7mzs" [53d8960b-d5df-40eb-92bf-8ac37c848bfb] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/kindnet/NetCatPod: app=netcat healthy within 11.003678873s
--- PASS: TestNetworkPlugins/group/kindnet/NetCatPod (11.24s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/DNS (0.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/DNS
net_test.go:175: (dbg) Run:  kubectl --context kindnet-882981 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/kindnet/DNS (0.13s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Localhost (0.11s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Localhost
net_test.go:194: (dbg) Run:  kubectl --context kindnet-882981 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/kindnet/Localhost (0.11s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/HairPin (0.1s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/HairPin
net_test.go:264: (dbg) Run:  kubectl --context kindnet-882981 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/kindnet/HairPin (0.10s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (13.01s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-clhgh" [2ce6b9a0-ca13-4d79-9ddc-1644a2e94b51] Pending / Ready:ContainersNotReady (containers with unready status: [kubernetes-dashboard]) / ContainersReady:ContainersNotReady (containers with unready status: [kubernetes-dashboard])
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-clhgh" [2ce6b9a0-ca13-4d79-9ddc-1644a2e94b51] Running
start_stop_delete_test.go:274: (dbg) TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 13.004296026s
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (13.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: waiting 10m0s for pods matching "k8s-app=calico-node" in namespace "kube-system" ...
helpers_test.go:344: "calico-node-4twxj" [c1d3c818-f0a6-4be5-ad49-ec448fce332a] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/calico/ControllerPod: k8s-app=calico-node healthy within 6.004661234s
--- PASS: TestNetworkPlugins/group/calico/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p custom-flannel-882981 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/custom-flannel/KubeletFlags (0.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/NetCatPod (10.23s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context custom-flannel-882981 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-5fm54" [a50afffa-e9ce-40d1-9fa3-07664dc750a5] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-5fm54" [a50afffa-e9ce-40d1-9fa3-07664dc750a5] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/custom-flannel/NetCatPod: app=netcat healthy within 10.003268855s
--- PASS: TestNetworkPlugins/group/custom-flannel/NetCatPod (10.23s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/KubeletFlags (0.3s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p calico-882981 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/calico/KubeletFlags (0.30s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/NetCatPod (11.27s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context calico-882981 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-7564g" [b637cba5-24c6-43ca-aa0e-1c89f7393aa5] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-7564g" [b637cba5-24c6-43ca-aa0e-1c89f7393aa5] Running
net_test.go:163: (dbg) TestNetworkPlugins/group/calico/NetCatPod: app=netcat healthy within 11.059947593s
--- PASS: TestNetworkPlugins/group/calico/NetCatPod (11.27s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/DNS (0.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context custom-flannel-882981 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/custom-flannel/DNS (0.13s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Localhost (0.11s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context custom-flannel-882981 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/Localhost (0.11s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/HairPin (0.11s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context custom-flannel-882981 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/custom-flannel/HairPin (0.11s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.08s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: waiting 9m0s for pods matching "k8s-app=kubernetes-dashboard" in namespace "kubernetes-dashboard" ...
helpers_test.go:344: "kubernetes-dashboard-8694d4445c-clhgh" [2ce6b9a0-ca13-4d79-9ddc-1644a2e94b51] Running
start_stop_delete_test.go:287: (dbg) TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop: k8s-app=kubernetes-dashboard healthy within 5.003375629s
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-061354 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (5.08s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (69.04s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p enable-default-cni-882981 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=crio
E0304 12:29:12.358092  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/no-preload-219829/client.crt: no such file or directory
E0304 12:29:12.363387  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/no-preload-219829/client.crt: no such file or directory
E0304 12:29:12.373699  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/no-preload-219829/client.crt: no such file or directory
E0304 12:29:12.393994  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/no-preload-219829/client.crt: no such file or directory
E0304 12:29:12.434924  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/no-preload-219829/client.crt: no such file or directory
E0304 12:29:12.515523  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/no-preload-219829/client.crt: no such file or directory
E0304 12:29:12.675814  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/no-preload-219829/client.crt: no such file or directory
E0304 12:29:12.996612  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/no-preload-219829/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p enable-default-cni-882981 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=docker  --container-runtime=crio: (1m9.035065598s)
--- PASS: TestNetworkPlugins/group/enable-default-cni/Start (69.04s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/DNS (0.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/DNS
net_test.go:175: (dbg) Run:  kubectl --context calico-882981 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/calico/DNS (0.13s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Localhost (0.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Localhost
net_test.go:194: (dbg) Run:  kubectl --context calico-882981 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
E0304 12:29:13.637743  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/no-preload-219829/client.crt: no such file or directory
--- PASS: TestNetworkPlugins/group/calico/Localhost (0.13s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/HairPin (0.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/HairPin
net_test.go:264: (dbg) Run:  kubectl --context calico-882981 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/calico/HairPin (0.13s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.3s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-linux-amd64 -p default-k8s-diff-port-061354 image list --format=json
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20240202-8f1494ea
start_stop_delete_test.go:304: Found non-minikube image: kindest/kindnetd:v20230809-80a64d96
start_stop_delete_test.go:304: Found non-minikube image: gcr.io/k8s-minikube/busybox:1.28.4-glibc
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.30s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (3.28s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 pause -p default-k8s-diff-port-061354 --alsologtostderr -v=1
E0304 12:29:14.918864  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/no-preload-219829/client.crt: no such file or directory
E0304 12:29:15.024181  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/addons-975865/client.crt: no such file or directory
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-061354 -n default-k8s-diff-port-061354
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-061354 -n default-k8s-diff-port-061354: exit status 2 (334.043424ms)

                                                
                                                
-- stdout --
	Paused

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-diff-port-061354 -n default-k8s-diff-port-061354
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-diff-port-061354 -n default-k8s-diff-port-061354: exit status 2 (349.847015ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:311: status error: exit status 2 (may be ok)
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 unpause -p default-k8s-diff-port-061354 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p default-k8s-diff-port-061354 -n default-k8s-diff-port-061354
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Kubelet}} -p default-k8s-diff-port-061354 -n default-k8s-diff-port-061354
E0304 12:29:17.479443  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/no-preload-219829/client.crt: no such file or directory
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Pause (3.28s)
E0304 12:29:53.321270  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/no-preload-219829/client.crt: no such file or directory
E0304 12:30:02.531940  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/old-k8s-version-996105/client.crt: no such file or directory
E0304 12:30:02.537221  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/old-k8s-version-996105/client.crt: no such file or directory
E0304 12:30:02.547445  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/old-k8s-version-996105/client.crt: no such file or directory
E0304 12:30:02.567739  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/old-k8s-version-996105/client.crt: no such file or directory
E0304 12:30:02.608042  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/old-k8s-version-996105/client.crt: no such file or directory
E0304 12:30:02.689098  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/old-k8s-version-996105/client.crt: no such file or directory
E0304 12:30:02.849547  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/old-k8s-version-996105/client.crt: no such file or directory
E0304 12:30:03.170623  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/old-k8s-version-996105/client.crt: no such file or directory
E0304 12:30:03.811801  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/old-k8s-version-996105/client.crt: no such file or directory
E0304 12:30:05.092812  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/old-k8s-version-996105/client.crt: no such file or directory
E0304 12:30:07.653596  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/old-k8s-version-996105/client.crt: no such file or directory
E0304 12:30:12.774712  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/old-k8s-version-996105/client.crt: no such file or directory
E0304 12:30:16.003645  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/functional-093444/client.crt: no such file or directory

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (58.61s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p flannel-882981 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=crio
E0304 12:29:22.599944  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/no-preload-219829/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p flannel-882981 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=docker  --container-runtime=crio: (58.608045958s)
--- PASS: TestNetworkPlugins/group/flannel/Start (58.61s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (68.15s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-linux-amd64 start -p bridge-882981 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=crio
E0304 12:29:32.840996  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/no-preload-219829/client.crt: no such file or directory
net_test.go:112: (dbg) Done: out/minikube-linux-amd64 start -p bridge-882981 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=docker  --container-runtime=crio: (1m8.148826085s)
--- PASS: TestNetworkPlugins/group/bridge/Start (68.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p enable-default-cni-882981 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/enable-default-cni/KubeletFlags (0.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/NetCatPod (9.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context enable-default-cni-882981 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-q6rvc" [141083bd-04aa-4a03-8377-0432a4a2748f] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-q6rvc" [141083bd-04aa-4a03-8377-0432a4a2748f] Running
E0304 12:30:23.014950  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/old-k8s-version-996105/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/enable-default-cni/NetCatPod: app=netcat healthy within 9.003921848s
--- PASS: TestNetworkPlugins/group/enable-default-cni/NetCatPod (9.17s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/ControllerPod (6.01s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/ControllerPod
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: waiting 10m0s for pods matching "app=flannel" in namespace "kube-flannel" ...
helpers_test.go:344: "kube-flannel-ds-p2qzx" [6fd29aaa-5d70-475f-a6bc-537ffde02e53] Running
net_test.go:120: (dbg) TestNetworkPlugins/group/flannel/ControllerPod: app=flannel healthy within 6.003637547s
--- PASS: TestNetworkPlugins/group/flannel/ControllerPod (6.01s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/KubeletFlags (0.26s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p flannel-882981 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/flannel/KubeletFlags (0.26s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/NetCatPod (9.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context flannel-882981 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-8ndpw" [4a700ecc-33ac-450f-8d0b-0440a9aab864] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-8ndpw" [4a700ecc-33ac-450f-8d0b-0440a9aab864] Running
E0304 12:30:34.282418  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/no-preload-219829/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/flannel/NetCatPod: app=netcat healthy within 9.004573767s
--- PASS: TestNetworkPlugins/group/flannel/NetCatPod (9.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/DNS (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/DNS
net_test.go:175: (dbg) Run:  kubectl --context enable-default-cni-882981 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/enable-default-cni/DNS (0.14s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Localhost (0.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Localhost
net_test.go:194: (dbg) Run:  kubectl --context enable-default-cni-882981 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/Localhost (0.12s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/HairPin (0.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/HairPin
net_test.go:264: (dbg) Run:  kubectl --context enable-default-cni-882981 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/enable-default-cni/HairPin (0.12s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/DNS (0.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/DNS
net_test.go:175: (dbg) Run:  kubectl --context flannel-882981 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/flannel/DNS (0.13s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Localhost (0.11s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Localhost
net_test.go:194: (dbg) Run:  kubectl --context flannel-882981 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/flannel/Localhost (0.11s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/HairPin (0.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/HairPin
net_test.go:264: (dbg) Run:  kubectl --context flannel-882981 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/flannel/HairPin (0.12s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/KubeletFlags (0.28s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/KubeletFlags
net_test.go:133: (dbg) Run:  out/minikube-linux-amd64 ssh -p bridge-882981 "pgrep -a kubelet"
--- PASS: TestNetworkPlugins/group/bridge/KubeletFlags (0.28s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/NetCatPod (10.18s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/NetCatPod
net_test.go:149: (dbg) Run:  kubectl --context bridge-882981 replace --force -f testdata/netcat-deployment.yaml
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: waiting 15m0s for pods matching "app=netcat" in namespace "default" ...
helpers_test.go:344: "netcat-56589dfd74-v2qxl" [cf44afc9-7256-4f69-a2fa-12a09f286828] Pending / Ready:ContainersNotReady (containers with unready status: [dnsutils]) / ContainersReady:ContainersNotReady (containers with unready status: [dnsutils])
helpers_test.go:344: "netcat-56589dfd74-v2qxl" [cf44afc9-7256-4f69-a2fa-12a09f286828] Running
E0304 12:30:43.495870  403649 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/old-k8s-version-996105/client.crt: no such file or directory
net_test.go:163: (dbg) TestNetworkPlugins/group/bridge/NetCatPod: app=netcat healthy within 10.00364874s
--- PASS: TestNetworkPlugins/group/bridge/NetCatPod (10.18s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/DNS (0.14s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/DNS
net_test.go:175: (dbg) Run:  kubectl --context bridge-882981 exec deployment/netcat -- nslookup kubernetes.default
--- PASS: TestNetworkPlugins/group/bridge/DNS (0.14s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Localhost (0.1s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Localhost
net_test.go:194: (dbg) Run:  kubectl --context bridge-882981 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z localhost 8080"
--- PASS: TestNetworkPlugins/group/bridge/Localhost (0.10s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/HairPin (0.12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/HairPin
net_test.go:264: (dbg) Run:  kubectl --context bridge-882981 exec deployment/netcat -- /bin/sh -c "nc -w 5 -i 5 -z netcat 8080"
--- PASS: TestNetworkPlugins/group/bridge/HairPin (0.12s)

                                                
                                    

Test skip (27/320)

x
+
TestDownloadOnly/v1.16.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.16.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.16.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.16.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.16.0/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.16.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.28.4/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.28.4/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.28.4/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.29.0-rc.2/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.29.0-rc.2/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/kubectl
aaa_download_only_test.go:167: Test for darwin and windows
--- SKIP: TestDownloadOnly/v1.29.0-rc.2/kubectl (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:498: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerFlags (0s)

                                                
                                                
=== RUN   TestDockerFlags
docker_test.go:41: skipping: only runs with docker container runtime, currently testing crio
--- SKIP: TestDockerFlags (0.00s)

                                                
                                    
x
+
TestDockerEnvContainerd (0s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with crio true linux amd64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
driver_install_or_update_test.go:105: Skip if not darwin.
--- SKIP: TestHyperKitDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade (0s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade
driver_install_or_update_test.go:169: Skip if not darwin.
--- SKIP: TestHyperkitDriverSkipUpgrade (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv
=== PAUSE TestFunctional/parallel/DockerEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DockerEnv
functional_test.go:459: only validate docker env with docker container runtime, currently testing crio
--- SKIP: TestFunctional/parallel/DockerEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing crio
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
functional_test_tunnel_test.go:99: DNS forwarding is only supported for Hyperkit on Darwin, skipping test DNS forwarding
--- SKIP: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (0.00s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestImageBuild (0s)

                                                
                                                
=== RUN   TestImageBuild
image_test.go:33: 
--- SKIP: TestImageBuild (0.00s)

                                                
                                    
x
+
TestChangeNoneUser (0s)

                                                
                                                
=== RUN   TestChangeNoneUser
none_test.go:38: Test requires none driver and SUDO_USER env to not be empty
--- SKIP: TestChangeNoneUser (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestSkaffold (0s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:45: skaffold requires docker-env, currently testing crio container runtime
--- SKIP: TestSkaffold (0.00s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.15s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-825778" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p disable-driver-mounts-825778
--- SKIP: TestStartStop/group/disable-driver-mounts (0.15s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet (3.41s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet
net_test.go:93: Skipping the test as crio container runtimes requires CNI
panic.go:626: 
----------------------- debugLogs start: kubenet-882981 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-882981

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: kubenet-882981

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: kubenet-882981

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: kubenet-882981

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: kubenet-882981

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: kubenet-882981

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: kubenet-882981

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: kubenet-882981

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: kubenet-882981

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: kubenet-882981

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: kubenet-882981

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "kubenet-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "kubenet-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "kubenet-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "kubenet-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "kubenet-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "kubenet-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "kubenet-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "kubenet-882981" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "kubenet-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "kubenet-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "kubenet-882981" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt
extensions:
- extension:
last-update: Mon, 04 Mar 2024 12:17:02 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: cluster_info
server: https://192.168.85.2:8443
name: kubernetes-upgrade-369188
- cluster:
certificate-authority: /home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt
extensions:
- extension:
last-update: Mon, 04 Mar 2024 12:16:37 UTC
provider: minikube.sigs.k8s.io
version: v1.26.0
name: cluster_info
server: https://192.168.76.2:8443
name: missing-upgrade-311239
contexts:
- context:
cluster: kubernetes-upgrade-369188
extensions:
- extension:
last-update: Mon, 04 Mar 2024 12:17:02 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: context_info
namespace: default
user: kubernetes-upgrade-369188
name: kubernetes-upgrade-369188
- context:
cluster: missing-upgrade-311239
extensions:
- extension:
last-update: Mon, 04 Mar 2024 12:16:37 UTC
provider: minikube.sigs.k8s.io
version: v1.26.0
name: context_info
namespace: default
user: missing-upgrade-311239
name: missing-upgrade-311239
current-context: kubernetes-upgrade-369188
kind: Config
preferences: {}
users:
- name: kubernetes-upgrade-369188
user:
client-certificate: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/kubernetes-upgrade-369188/client.crt
client-key: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/kubernetes-upgrade-369188/client.key
- name: missing-upgrade-311239
user:
client-certificate: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/missing-upgrade-311239/client.crt
client-key: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/missing-upgrade-311239/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: kubenet-882981

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "kubenet-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p kubenet-882981"

                                                
                                                
----------------------- debugLogs end: kubenet-882981 [took: 3.239847056s] --------------------------------
helpers_test.go:175: Cleaning up "kubenet-882981" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p kubenet-882981
--- SKIP: TestNetworkPlugins/group/kubenet (3.41s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (5.62s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:626: 
----------------------- debugLogs start: cilium-882981 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-882981

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-882981

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-882981

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-882981

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-882981

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-882981

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-882981

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-882981

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-882981

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-882981

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-882981

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-882981" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-882981

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-882981

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-882981

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-882981

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-882981" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-882981" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters:
- cluster:
certificate-authority: /home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt
extensions:
- extension:
last-update: Mon, 04 Mar 2024 12:17:02 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: cluster_info
server: https://192.168.85.2:8443
name: kubernetes-upgrade-369188
- cluster:
certificate-authority: /home/jenkins/minikube-integration/18284-396872/.minikube/ca.crt
extensions:
- extension:
last-update: Mon, 04 Mar 2024 12:16:37 UTC
provider: minikube.sigs.k8s.io
version: v1.26.0
name: cluster_info
server: https://192.168.76.2:8443
name: missing-upgrade-311239
contexts:
- context:
cluster: kubernetes-upgrade-369188
extensions:
- extension:
last-update: Mon, 04 Mar 2024 12:17:02 UTC
provider: minikube.sigs.k8s.io
version: v1.32.0
name: context_info
namespace: default
user: kubernetes-upgrade-369188
name: kubernetes-upgrade-369188
- context:
cluster: missing-upgrade-311239
extensions:
- extension:
last-update: Mon, 04 Mar 2024 12:16:37 UTC
provider: minikube.sigs.k8s.io
version: v1.26.0
name: context_info
namespace: default
user: missing-upgrade-311239
name: missing-upgrade-311239
current-context: kubernetes-upgrade-369188
kind: Config
preferences: {}
users:
- name: kubernetes-upgrade-369188
user:
client-certificate: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/kubernetes-upgrade-369188/client.crt
client-key: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/kubernetes-upgrade-369188/client.key
- name: missing-upgrade-311239
user:
client-certificate: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/missing-upgrade-311239/client.crt
client-key: /home/jenkins/minikube-integration/18284-396872/.minikube/profiles/missing-upgrade-311239/client.key

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-882981

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-882981" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-882981"

                                                
                                                
----------------------- debugLogs end: cilium-882981 [took: 5.444271137s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-882981" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-linux-amd64 delete -p cilium-882981
--- SKIP: TestNetworkPlugins/group/cilium (5.62s)

                                                
                                    
Copied to clipboard